User testing - HackMD

# User testing ## Qualitative interview guide **Introduction** *Introduce yourself, briefly explain the purpose of the test and allow the participant(s) to comment or ask questions.* Q1:The purpose is to test an app that diagnoses skin conditions with AI based technology. Q2:After taking a picture of your skin, this innovative technology will automatically detect which part of your skin needs the most care. Q3:After explaining to the user what area of his/her face needs the most attention, the app will recommend skin care products to purchase. **General information related to the topic** *Query the tester with general questions. Talk about his habits.* Q4:Would you like to have free medical advice on how to treat your skin condition properly? Q5:Do you struggle finding products that fit your skin needs? Q6:Have you ever used apps to get skincare advice? **Behavior related to particular issues** *Ask him to express himself on your application, product or service. Feel free to use the prototype for this part.* Q7:Do you like the theme of the app? (Does the blue and white colors remind you of the medical sector?) Q8:Do you think the purpose of the app is easily understandable? Q9:Is there anything you wish it had and didn’t find it on the app? (Like being in touch with a real medical advisor, or a text which explains why the active substance of a certain product treats a specific area of the face). **Constructive suggestions for improvement** *Ask him how you could improve your prototype* Q10:Are there any components or interfaces I can add to help my customers understand the root cause of their skin conditions? --- :::warning ## Testcard ## Pre-testing **Name:** Harry Black **Age:** 23 **Occupation:** Student at Stanford University **Context of the meeting (where, with who, etc.):** Due to COVID-19, we did an online Zoom where I shared my prototype, and I was able to analyze his acts. **Duration of the meeting:** *4O minutes* ## User scenarios testing ## TEST 1 **1st instruction** : You are a 23-year-old guy and have been dating a girl for 2 years now. Your girlfriend has under eyes circles even after good nights of rest and her biggest dream is to get rid of them. You have to buy her a present for a birthday and wants to figure out which cream can treat the root cause of her hyperpigmentation around her eyes. **Observations:** - There is a lot of texts. It takes a lot of time to read all of it. - The app forces me to take a picture for the skin diagnosis and since it’s a surprise for my girlfriend, I want to be able to choose a photo from my phone and upload it on the app. - When I want to buy the product, it redirects me on the website which is not really convenient. I’d rather pay quickly with Apple Pay. --- **2nd instruction:** : You are a 25-year-old guy who recently graduated from Stanford University. You are extremely busy and spend most of your time at the office, in front of your computer working for hours. You realize that your under eyes circles have darkened, probably because of blue light exposure. You have to get rid of your under eyes circles and decided to get good advice on how to decrease the darkness of your hyper pigmentation. **Observations:** - It’s pretty easy to log on the app - I don’t have to create an account to start the diagnosis which is good because I’m busy and I don’t have time to waste - There is a lot of texts. It takes a lot of time to read all of it. - The app advises me to take a cream but does not give me true advice on how to treat the root cause of my symptom. I feel like the cream will only hide the symptoms but I’m sure lifestyle shifts could lighten undereye circles, and I wish I could have more advice on that specific area. ## Qualitative testing **Positive feedback:** - The app is easy to use, and we are quickly offered a product to buy - The blue and white colors chosen for the app totally fit the mindset of the app. It makes me think I can trust this professional platform. - A personal account is not required which makes the use of the app even. --- **Neutral feedback:** - Add more arrows to go back to the previous page - There is only one product which is offered. I think more products could be suggested to users. - In my opinion, an interface is missing on the last screen. Let’s say I’m not satisfied with the diagnosis; I need to be able to either start a new skin diagnosis or get in touch with a real medical advisor. --- **Negative feedback:** - There is too much text throughout the app. It is more relevant to use keywords for the skin diagnosis and add an option to explain it in more detail. - The app does not allow me to use a photo that I already have on my phone for the face mapping --- **Learning & insights:** From that, we've learn that the app was pretty easy to use and straightforward. However, some key functionalities are missing. Such as: - Simplified payment to purchase an item - The possibility to have medical care advice and support from a real dermatologist - The possibility to do another face mapping after the first one has been done. --- **Decisions & actions:** To iterate, we will : - Add a component “skip intro” for people who are in a hurry and who don’t want to read all the text - Change the 3rd screen by adding the possibility to take a photo or to choose a photo from the phone library - We will shorten the text and use key words and visual components instead - On the last screen, we will have a quick pay option such as Apple Pay or PayPal - Instead of showing only one product to buy we will offer multiple products that fit our user’s skin needs - We will add an option on the last screen that allows our users to take an online appointment with a real medical doctor. Our user could therefore ask the dermatologist all the questions they might have about the results of their face mapping. ## TEST 2 ## Pre-testing **Name:** Sandra Clerc **Age:** 24 **Occupation:** Student at **Context of the meeting (where, with who, etc.):** Due to COVID-19, we did an online Zoom where I shared my prototype, and I was able to analyze his acts. **Duration of the meeting:** *4O minutes* **Instruction** : You are a 24-year-old girl and are studying hard at school. You never had acne or skin breakouts as a teenager but for some reason you happen to have a lot of acne on your forehead at age 24 and you are wondering why. You have to get rid of your acne and you connect on Derma Beauty app to buy a product which will help you clear out your skin. If you wish, after the face mapping, you can get expert advice for free. **Observations:** - Everything is really understandable. All the explanations are easy to read and very comprehensive. - I get to take a picture of myself and have a face mapping without wasting time creating an account, that’s great! - I like the fact that I have the choice between purchasing either one product or a whole skincare routine package. - I wish I could have saved the photo taken for the face mapping in order to show it to the dermatologist expert. - The app allows me to have an online appointment with a dermatologist expert on zoom. I think the online appointment should be held directly on the Derma Beauty app. - After the appointment with the medical expert, I want to be able to have all her/his advice listed on a profile section on the app. On this profile section, I also want to be able to save all the pictures from my face mappings so that I can track my skin’s improvements. --- ## Qualitative testing **Positive feedback:** - All in all, the app is quite user friendly, and it doesn’t take much time to understand that the purpose of the app is to get great skin care advice. - The user doesn’t have to waste time creating an account before completing a face map - The option of purchasing a whole skincare routine package rather than just purchasing one product is a great added value --- **Neutral feedback:** - It would be more convenient to be able to save the photo taken for the face mapping in order to show it to the dermatologist expert. - The app allows our users to have an online appointment with a dermatologist expert on zoom. The online appointment should be held directly on the Derma Beauty app. --- **Negative feedback:** - After the appointment with the medical expert, all the advice given should be saved somewhere in the app. - There is no option that can let the user to save all the pictures from his face mappings to let him track his skin’s improvements. --- **Learning & insights:** From that, we’ve learned that the app was user friendly, and the purpose of the app was easy to understand. Some improvements need to be done on the appointment interface: - The appointment should not be held on zoom but on the beauty derma app. - After the appointment with the medical expert, all his/her advice will be listed on the user’s profile section on the app. On this profile section the user has to be able to save all the pictures from my his/her face mappings so that he/she can track his/her skin’s improvements. --- **Decisions & actions:** To iterate, we will: - Create a profile section. The profile will also be a place where the user saves his face mapping diagnosis and the advice he got from the dermatological expert. Therefore, he could see the improvements of his skin after buying the cream. - Create a “call interface” where medical appointments could be held (instead of sending a zoom invitation) ## TEST 3 ## Pre-testing **Name:** Chloe Schwarz **Age:** 22 **Occupation:** Studying business **Context of the meeting (where, with who, etc.):** Due to COVID-19, we did an online Zoom where I shared my prototype, and I was able to analyze his acts. **Duration of the meeting:** *4O minutes* **Instruction** : You are a 22-year-old girl and are studying at emlyon business school. You just finished your internship at a private bank. It’s the first time you earned a salary, and you want to offer a great present to your mother who constantly complains about her face wrinkles. You have to connect on the app and purchase a cream that will perfectly targets her needs. **Observations:** - I just finished taking my appointment with an online dermatologist practitioner but now I have to press on “back arrows” 10 times to do a new face mapping. This is pretty annoying to use. There should be a menu on the bottom of the screen or on the right of the screen to easily go from the “face mapping” interface to the “get an appointment with a dermatologist” interface. - Since, I want to buy a present for my mother I would love to have an option where the cream I buy can be wrapped up in a gift box. - I like the fact that the app offers both a cream to buy and a list of advice about how adopting a specific healthy lifestyle can prevent early aging for example. --- ## Qualitative testing **Positive feedback:** - I like the fact that we can combine both a face mapping based on AI technology and a one-to-one meeting with a real medical expert. - I think promoting both great skin care products and influencing people to operate healthy lifestyle shifts for great skin is a brand-new approach in the beauty and wellness industry and it should be even more emphasized and promoted on the app. - Combining the purchase of a beauty product and healthy lifestyle advice is rare in the dermatology industry. I think it’s an innovative approach of skin care and it should be even more emphasized on the app. --- **Neutral feedback:** - There is no menu where the user could choose to create a profile. - Creating a profile will be more convenient for multiple payments options. (Mastercard, Paypal, Apple pay etc…) - The profile could also be a place where the user saves her/his face mapping diagnosis. Therefore, he/she could see the improvements of his/her skin after buying the cream. --- **Negative feedback:** - Some options are missing such as buying the product as a present and wrapping it up in a present box. - A menu should be created to go easily from one interface to another. --- **Learning & insights:** From that, we’ve learned that promoting both great skin care products and influencing people to operate healthy lifestyle shifts for great skin is a brand-new approach in the beauty and wellness industry and we should promote it more on the Beauty Derma app. However, some key functionalities are missing: - A menu should be created to go easily from one interface to another - A profile interface should be added to simplify payments options - In the payment interface: a “buying the product as a present” option should be integrated. --- **Decisions & actions:** To iterate, we will: - Emphasize more the “lifestyle approach” of skin care by creating a downable “healthy guide challenge” to help our users operate lifestyle shifts and boost the efficiency of the beauty product. - Create a menu to make our functionalities easier to reach. The menu would have 3 components: a profile, a “get a face mapping” option, and a “get an appointment” option. - Simplify the payment interface by adding a profile section where the user could choose to pay by credit card, pay pal or apple pay. In the payment interface: a “buying the product as a present” option will be integrated. ## TEST 4 ## Pre-testing **Name:** Rachel Hamburger **Age:** 23 **Occupation:** Student at EDHEC Business School **Context of the meeting (where, with who, etc.):** Due to COVID-19, we did an online Zoom where I shared my prototype, and I was able to analyze his acts. **Duration of the meeting:** *4O minutes* **Instruction** : You are a 23-year-old girl and are studying at EDHEC business school. You are currently working really hard to get a Master of Finance. You never liked make-up and have always been attracted to natural beauty. However, the stress from your intense studies causes you skin breakouts. You therefore decide to use the Derma Beauty app to see how you can treat the root cause of your skin conditions by adopting a healthier lifestyle. **Observations:** - So, I can either do a face-mapping or get an appointment. I’m not really sure which one is best for lifestyle shift habits. - Ok, I can’t take an appointment if I didn’t do at least one face-mapping, so I guess I’m going to start by the face-mapping - The face-mapping is really easy to use. I like the downable guide challenge which lists all the good lifestyle shifts. --- ## Qualitative testing **Positive feedback:** - The app is easy to use. The menu section is user friendly, and it’s easy to go from one interface to another. - The payment interface is smooth. - The profile section is exhaustive. --- **Neutral feedback:** - You should specify that a first user need to do at least one face mapping before taking an appointment. - The lifestyle challenge is easy to follow. --- **Negative feedback:** - The lifestyle challenge is not personalized enough. - The downable guide is not personalized enough and not enough motivating. For example, it says I have to meditate to reduce stress and treat the root cause of my pimples. However, it doesn’t provide me with a guide explain to me how to do it, when, with who etc… --- **Learning & insights:** From that, we’ve learned that : - All the interfaces are smooth and easy to use - The lifestyle challenge is not personalized enough and must be more interactive --- **Decisions & actions:** To iterate: - We will make sure that the lifestyle challenge is personalized, and tailor made to our users. There will be a challenge on the app which targets the specific lifestyle shift our user need to operate according to his skin type. - The lifestyle guide will not be as a pdf but as an interactive interface where our users could add their lifestyle challenge to my google calendar. ## TEST 5 ## Pre-testing **Name:** Victoire Stone **Age:** 24 **Occupation:** working as an IT consultant **Context of the meeting (where, with who, etc.):** Due to COVID-19, we did an online Zoom where I shared my prototype, and I was able to analyze his acts. **Duration of the meeting:** *4O minutes* **Instruction** : Let’s say you did your face-mapping, you got your lifestyle advice, but you have some specific questions to ask to the dermatologist. You have to take an appointment with her and ask him/her all of your questions. **Observations:** - It’s such a pity that I didn’t see that I could save my face-map picture on my profile. It would have been more convenient to automatically save all the pictures on my profile. - The meeting with my dermatologist was really nice: I learned a lot about the connection about lifestyle and skin. However, there was a lot of information and I couldn’t take notes. I would love to have an option where a sum up of my meeting is automatically generated in my profile. --- ## Qualitative testing **Positive feedback:** - Online meetings with dermatologists are great - Online meetings are perfect to teach our users about the connection between lifestyle and skin --- **Neutral feedback:** - People can forget about their dermatologists’ appointments. I think the users should be notified prior to their appointment. --- **Negative feedback:** - Face map pictures are not saved automatically - No finale report is generated after online meetings --- **Learning & insights:** From that, we’ve learned that our users really enjoy online meetings with dermatologists. However, some options should be added to make these appointments even more enjoyable and easy to use. --- **Decisions & actions:** To iterate, we will: - After the appointment, we will ask our users to the overall Online dermatology experience - All face-map pictures will be saved automatically on the profile interface - We will add an option where a sum up of online meetings will automatically be generated on our users’ profile. :::