(Desktop) IA User Testing

Summary

With the desktop prototype, we tested the following features in different user testing sessions, each with 4 to 6 participants. All participants have prior experience with web conferencing tools such as Skype for Business, Webex, and Gotomeetings. The tasks including Frist time experiece (FTE), use phone for audio (PSTN), scheduling flow, and the filter functions

We also tested the idea of "team" and "space" to see whether the design fits the users mental model. Most users were able to utilize the filter to facilitate the Team, but the "team" v.s. "space" idea still seemed confusing to others.

In tasks testing whether the users understand the global scheduling function v.s. the in-space scheduling function, we found that most users tend to schedule the meeting from existing spaces, rather than starting with the global activity button.

In the task testing the invite people function, most users first clicked on the global action button since that was the most familiar button to them right after the FTE. No users thought about finding the invite function under "Mystuff" in the first try. The in-meeting panel and roster seemed to also match users' mental model without much struggle. The filter was however not an easy to find feature, that almost all testee missed it on the first try.

Platform

Desktop

Instructions

On Desktop

1) Use Chrome browser to view the prototype to see the self-view video working

2) Choose Day 1 to test first time experience (FTE)

3) Choose Day 2 to experience OBPT, PSTN (press 1 to trigger OBTP), and joining a team space

Key Findings

1) Users defined Cisco Spark as a collaboration tool

2) Confusion still exists in diffrienciating "Space" v.s. "Activities"

3) Switching spaces during a call caused confusion for first time users

4) Join meeting with video fits the users' mental model

5) Join with audio, especially in PSTN situation confused the users

6) Team v.s. Space concept is confusing to some users

7) Global scheduling didn't get to utilize as much as the users tend to schedule the meetings within space

8) The users understand where to find "meetings" under "My Stuff" on desktop

9) Filter under search was hard to find for the testees

10) Most users clicked on global action button first when being asked to invite more users to join Cisco Spark

User Testing

Tested Features:

Desktop

1) Coachmarks (First use scenario) - whether people read the coachmarks and whether the coachmarks help them to navigate through the app easier (feature not shown in this current PT)

2) Global v.s. Local activities concept

3) Getting to understand how easy/difficult it is for the users to contact someone through the app as a first-time user

4) Overall experience for OBTP and PSTN

5) OBTP Toast - Whether the toast makes sense to the users

6) Filters - Discoverablility and whether the user understand the concept differences between teams and spaces

7) Scheduling - Global scheduling v.s. In-space scheduling

8) Meeting List / My Stuff

9) New In-meeting panel

10) Invite people to Cisco Spark

11) New Search/Filter Interface

Test 1 Session Recording Links (Main focus: FTE)

Findings Report

Test 2 Session Recording Links (Main Focus: OBPT and PSTN)

Findings Report

Test 3 Desktop Filters/Scheduling/Meeting List

(password: Ciscotest1)