Represent
A Virtual Reality(VR) speech training App via system feedback and self-reflection
Re-present
Unlocks strengths and weaknesses of your speech
Duration
2019.9 - 2019.12
Role
UX, UI, Visual Design, Prototyping, Semi-structure Interview, Iterative Testing, UX Research, Innovation, UI/UX Design, Prototyping, 3D modeling, Unity 3D
Represent is a project that initiates from the CMU Eberly Center and aims for improving student's speech skills.
Currently, there are more than 200+ students used this VR App, over 98% believe it helps them improve their speaking skills.
In this introductory section, you will see how we identified the human problems and a quick peek at the end result.
Project Goals
It all begins with an idea. Maybe you want to launch a business. Maybe you want to turn a hobby into something more. Or maybe you have a creative project to share with the world. Whatever it is, the way you tell your story online can make all the difference.
Don’t worry about sounding professional. Sound like you. There are over 1.5 billion websites out there, but your story is what’s going to separate this one from the rest. If you read the words back and don’t hear your own voice in your head, that’s a good sign you still have more work to do.
Be clear, be confident and don’t overthink it. The beauty of your story is that it’s going to continue to evolve and your site can evolve with it. Your goal should be to make it feel right for right now. Later will take care of itself. It always does.
Define The Problem
Adding Micro Features Without Considering the Macro Experience
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Nunc mattis enim ut tellus elementum sagittis vitae et. Vestibulum rhoncus est pellentesque elit ullamcorper dignissim cras. Et tortor at risus viverra adipiscing at in tellus integer. Integer vitae justo eget magna. Elit duis tristique sollicitudin nibh sit amet commodo. Nunc scelerisque viverra mauris in aliquam sem fringilla. Et pharetra pharetra massa massa ultricies mi quis hendrerit. Nisi porta lorem mollis aliquam ut porttitor leo a. Euismod elementum nisi quis eleifend quam adipiscing vitae proin. Sed libero enim sed faucibus turpis. Penatibus et magnis dis parturient montes nascetur ridiculus mus mauris. Vestibulum morbi blandit cursus risus at ultrices. Tristique magna sit amet purus gravida quis.
The Solution - Represent
A VR Training App and Research Tool
Research
Gathering Inputs from as Many Sources as Possible
It all begins with an idea. Maybe you want to launch a business. Maybe you want to turn a hobby into something more. Or maybe you have a creative project to share with the world. Whatever it is, the way you tell your story online can make all the difference.
How to evaluate public speaking performance?
It all begins with an idea. Maybe you want to launch a business. Maybe you want to turn a hobby into something more. Or maybe you have a creative project to share with the world. Whatever it is, the way you tell your story online can make all the difference.
It all begins with an idea. Maybe you want to launch a business. Maybe you want to turn a hobby into something more. Or maybe you have a creative project to share with the world. Whatever it is, the way you tell your story online can make all the difference.
It all begins with an idea. Maybe you want to launch a business. Maybe you want to turn a hobby into something more. Or maybe you have a creative project to share with the world. Whatever it is, the way you tell your story online can make all the difference.
What's wrong with the existing ways of practicing?
It all begins with an idea. Maybe you want to launch a business. Maybe you want to turn a hobby into something more. Or maybe you have a creative project to share with the world. Whatever it is, the way you tell your story online can make all the difference.
It all begins with an idea. Maybe you want to launch a business. Maybe you want to turn a hobby into something more. Or maybe you have a creative project to share with the world. Whatever it is, the way you tell your story online can make all the difference.
Insights Summary
Competitor Sucks
One App has overall darkroom settings, but the PPT are pure white, makes it terrible to see, and they don’t provide whether I did good or wrong, even if they have, no rationale for it
Sell it.
It all begins with an idea. Maybe you want to launch a business. Maybe you want to turn a hobby into something more. Or maybe you have a creative project to share with the world. Whatever it is, the way you tell your story online can make all the difference.
Build it.
It all begins with an idea. Maybe you want to launch a business. Maybe you want to turn a hobby into something more. Or maybe you have a creative project to share with the world. Whatever it is, the way you tell your story online can make all the difference.
Make it.
It all begins with an idea. Maybe you want to launch a business. Maybe you want to turn a hobby into something more. Or maybe you have a creative project to share with the world. Whatever it is, the way you tell your story online can make all the difference.
Grow it.
It all begins with an idea. Maybe you want to launch a business. Maybe you want to turn a hobby into something more. Or maybe you have a creative project to share with the world. Whatever it is, the way you tell your story online can make all the difference.
Share it.
It all begins with an idea. Maybe you want to launch a business. Maybe you want to turn a hobby into something more. Or maybe you have a creative project to share with the world. Whatever it is, the way you tell your story online can make all the difference.
How do we get here - Process
Design Principles
To differentiate with existing products, I synthesized all our inputs into three core principles which guided the rest of our design journey.
Challenge I - Motivating, Design a motivating and effective practice loop in VR and fit in the course outline?
How we end up designing an experience with practice and playback mode? Why save for recording? why design real-world-like settings? How to work with the course outline?
User Flow Diagramming Exercise
Exact same Classroom settings, realistic environment, PDF uploaded as presentation, experimentation, they practice in VR and go back to the places they present in real life
Challenge II - Unlock insight and shed light on the pros and cons
It all begins with an idea. Maybe you want to launch a business. Maybe you want to turn a hobby into something more. Or maybe you have a creative project to share with the world. Whatever it is, the way you tell your story online can make all the difference.
Leading the Design Sprint and Crazy 8 method for the team to flush out ideas, and it works,
Eye gaze map UI, Gaze Cone
Performance Summary Page,
Labelling System
Listening to yourselves is already unlocking something, self-review
Challenge III - Design a comfortable and easy-to-use VR experience
Virtual Audience Design
User’s avatar design
Unlock your gesture
Interaction Design
Joystick interaction
Control panel
VR UI Design
Curved timeline, click joystick to navigate or tap to navigate
Performance Screen Design consideration, Visual Design, and UI design perspective
…
avatar design - Between Anthropomorphic Form and Uncanny valley, be very careful about the audience and avatar design
Eventually, we initially want to let the user to choose their skin and personalize their avatar, it’s a cool idea, we only got around 4-8 weeks to implement, and body gesture tracking in the end a trade-off is being made, a wooden figurine that avoid the racial issue, reduce implementation effort, reflect user’s gesture, and a balance of uncanny valley chart
Alignment - Testing
It all begins with an idea. Maybe you want to launch a business. Maybe you want to turn a hobby into something more. Or maybe you have a creative project to share with the world. Whatever it is, the way you tell your story online can make all the difference.
Onsite Implementation
It all begins with an idea. Maybe you want to launch a business. Maybe you want to turn a hobby into something more. Or maybe you have a creative project to share with the world. Whatever it is, the way you tell your story online can make all the difference.
Vision
Labeling system, customize your own avatar, the different mode for different scenarios, different settings, research-driven iteration, audience race, and gender bias
Result
200+
students
Implementation - Re-present start being used in courses STRATEGIC PRESENTATION, 90-718, CMU
2019, Spring, Pittsburgh
5
semesters
“It all begins with an idea. Maybe you want to launch a business. Maybe you want to turn a hobby into something more. Or maybe you have a creative project to share with the world. Whatever it is, the way you tell your story online can make all the difference.”
98%
of user think it’s helpful
“It all begins with an idea. Maybe you want to launch a business. Maybe you want to turn a hobby into something more. Or maybe you have a creative project to share with the world. Whatever it is, the way you tell your story online can make all the difference.”
⬆Course Satisfaction Rate
Student's average course satisfaction rate
CMU Teaching & Innovation Award
CMU Teaching Innovation Award 2020 - Affiliated with recipient Kim Hyatt
2020, Pittsburgh
[Source]
Research Paper Published
Research Papers - The performance data and results from Kim’s class are published in research papers
2020, Pittsburgh
[Source]
Finalist - iLRN 2020 Immersive Learning Project Showcase & Competition
2020, Virtual
Selected for the showcase - CMU Teaching & Learning Summit 2018
2018, Fall, Pittsburgh
What People Are Saying.
“It is going to have an enormous impact and help many students and faculty, and it demonstrates the importance we at CMU place on developing the student as a complete individual — excellent in their discipline of study and outstanding at communication” [Source]
Ramayya Krishnan
— Dean of the Heinz College, Carnegie Mellon University
“Kim’s system (Re-present) has immediate implications for classes beyond her own discipline, In any field where students must present their work, they can benefit from an opportunity to improve their performance, Hyatt’s system (Re-present) also offers the opportunity for critical research on pedagogy.” [Source]
Jessica Hammer
— Assistant Professor at HCII, Thomas and Lydia Moran Assistant Professor of Learning Science, Carnegie Mellon University
"With this technology, the course transforms from just a required course to an exciting chance to try something new. Because students receive instant feedback, they can begin to improve immediately, such as improving eye contact and lessening their filler words. I hear the students gain confidence each time they practice their speeches." [Source]
Andreya Cherry
— CMU Student, Teaching Assistant
“"The Re-Present team went above and beyond expectations to develop a VR application for my graduate course, Strategic Presentation Skills, at CMU. Based on the integration of this app and the type of data collected, I was the recipient of the 2020 CMU Teaching Innovation Award, ...going forward, the app will have an enormous impact by helping students and faculty across disciplines on campus, the app proved to be an incredibly successful instructional tool with data to support continued research in this area” [Source]
Kim Hyatt
— Associate Professor, Carnegie Mellon University
Reflection
It all begins with an idea. Maybe you want to launch a business. Maybe you want to turn a hobby into something more. Or maybe you have a creative project to share with the world. Whatever it is, the way you tell your story online can make all the difference.
Don’t worry about sounding professional. Sound like you. There are over 1.5 billion websites out there, but your story is what’s going to separate this one from the rest. If you read the words back and don’t hear your own voice in your head, that’s a good sign you still have more work to do.
Be clear, be confident and don’t overthink it. The beauty of your story is that it’s going to continue to evolve and your site can evolve with it. Your goal should be to make it feel right for right now. Later will take care of itself. It always does.