Docsity
Docsity

Prepare for your exams
Prepare for your exams

Study with the several resources on Docsity


Earn points to download
Earn points to download

Earn points by helping other students or get them with a premium plan


Guidelines and tips
Guidelines and tips

Mental Models: Understanding User Expectations for AI Products, Exercises of Medical Sciences

A workshop for creating mental models of user expectations for AI products. It includes exercises for analyzing user groups, their goals, and current processes, as well as creating onboarding messages and testing user comprehension. The goal is to help teams develop effective AI products by understanding user mental models.

What you will learn

  • What are the different user groups for the AI product?
  • What are the primary goals of each user group?
  • What is the current step-by-step process for each user group to accomplish the task the AI will do?
  • Where might the user's mental model break when encountering the AI's functionality?
  • What mental models might already be in place for each user group?

Typology: Exercises

2021/2022

Uploaded on 02/11/2022

abha
abha 🇺🇸

4.7

(9)

249 documents

1 / 13

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
Mental Models
Chapter worksheet
Instructions
Block out time to get as many cross-functional leads as possible together in a room to work
through these exercises & checklists.
Exercises
1. Existing vs. new mental models [~2 hours]
Determine existing user mental models to understand how your product will break or
reinforce them.
2. Creating onboarding [~1 hour]
Craft your onboarding message and test user comprehension of cause and effect.
Page 1 of 13
pf3
pf4
pf5
pf8
pf9
pfa
pfd

Partial preview of the text

Download Mental Models: Understanding User Expectations for AI Products and more Exercises Medical Sciences in PDF only on Docsity!

Chapter worksheet

Instructions

Block out time to get as many cross-functional leads as possible together in a room to work

through these exercises & checklists.

Exercises

1. Existing vs. new mental models [~2 hours]

Determine existing user mental models to understand how your product will break or

reinforce them.

2. Creating onboarding [~1 hour]

Craft your onboarding message and test user comprehension of cause and effect.

  1. Existing vs. new mental models analysis

Discuss the following questions as a group, then capture answers in the boxes below. Review

your answers as a team to determine what approaches your product will need to take to help

users establish good mental models.

Example product: AI that automatically prioritizes new emails and sorts inbox according to their priority Key questions

Who are your different user groups? Add more boxes as needed.

User group A Example: employee at large company using email for work User group B Example: Everyday consumer using a free email service

What is the step-by-step process that novice users from each group currently use to accomplish

the task that the AI system will accomplish? How uniform or variable is this process?

Note: user research may be needed to answer this question

User group A Example: Process - Frequently check email, individually triage each message. Uniformity - Highly variable. User group B Example: Process - Scan inbox for important mail, ignoring the rest Uniformity - Highly variable.

What is the step-by-step process that expert users from each group currently use to accomplish

the task that the AI system will accomplish? How uniform or variable is this process?

Note: user research may be needed to answer this question

User group A Example: Process - Set up multiple custom filters, notifications, and labels and folders Uniformity - Highly variable. User group B Example: Process - Set up filters, systematically unsubscribe from lists to free up inbox. Uniformity - Highly variable.

Given all the above, what cause and effect relationships does the user need to understand —

even in simplified terms or by analogy — to successfully use the AI product?

User group A Example: Priority of email varies by: ● Number of recipients (just user or large group) ● Frequency of sending emails to contact ● Speed at which user opens and replies to email User group B Example: Priority of email varies by: ● Contact's membership in a specific group ● Active orders or subscriptions ● Length of communication

Given the mental model we want users to have, how might anthropomorphizing the product alter

the mental model?

User group A Example: Making the system seem “human” might imply that the AI actually does have the same knowledge and context as the user, which conflicts with the key cause and effect relationships the user needs to understand. User group B

What if anything might need to change about how the AI works in order to accommodate mental

models?

All users Example: AI works as a binary yes / no categorizer for censoring content in an online forum, but users expect gradations of control.

  1. Creating onboarding

Start crafting your onboarding message using this template, and try a few different versions:

  1. Onboarding template

This is __ { your product or feature } ___, and it’ll help you by __ { core benefits } __.

It’s NOT able to __ { primary limitations of AI } __.

Over time, it’ll change to become more relevant to you.

You can help it get better by __ { actions users can take to help the system learn } ____.

Version 1 Version 2 Version 3

  1. Test user mental models

Pick your best draft onboarding messaging + next action concepts, or pick several to test, then

conduct user research.

Research protocol questions ● First, show users your initial onboarding concepts, then ask them questions like: ○ Explain in your own words what [product] is. ○ Explain in your own words how [product] works. ○ Based on what you saw, describe what using [product] will be like. ○ Based on what you saw, how useful do you expect [product] to be for you? ○ Any additional expectations you have about [product] based on what you read? ● Next, if you have any wireframes or demos or working prototypes of your product or feature, show it to the user after walking through your onboarding experience concepts. ● Lastly, after interacting with both the design concepts and the AI prototype, have users describe how the AI experience compared to their expectations.