top of page
PALLY
AR for social transition
Pally is a HoloLens augmented reality (AR) simulation game designed to help students with special needs advance social interaction outside of the classroom in an augmented reality environment. The experience is customized by the teacher(admin) based on individual needs.
Main Achievements
​
Featured on CBS <Mission Unstoppable>, 2019
ISTE 2019 Young Educators Ignite Talk
​
2019 Verizon 5G EdTech Challenge Winner
Problems & Background
What do we want to solve?
Why is this important?
Who is this app for?
National Center for Education Statistics reported 88% of higher education enrolled students with disabilities (Raue et al., 2011)
​
​
Within those institution, 56% reported enrollment of students who are on the autism spectrum disorders (Raue et al., 2011)
​
​
Those students reported high levels of academic success, but they are commonly accompanied with difficulties in social behaviors (Gelbar et al., 2015)
​
​
50% students with autism had trouble obtaining and sustaining friendships,
and they had difficulties participating in normal social events (Taylor, 2005)
“ What Teachers say about SOCIAL - EMOTIONAL LEARNING “
LACK OF RESOURCES
“Resource room time is insufficient to learn and practice social skills because time is mostly devoted to academic studies” (Special Ed Teacher)
VERY DIFFERENT SPECIAL NEEDS
“Although symptoms and needs vary from child to child,
one common learning need is social interaction skills” (Special Ed Teacher)
LACK OF OPPORTUNITY FOR REPETITIVE LEARNING
“Repetition and reinforcement of learning is important,
especially to generalize concepts learned” (ABA Specialist)
Our Solution
What is Pally?
What does it do?
Pally is a HoloLens simulation game that allows students practice social communication in a safe and relevant environment. Augmented reality (AR) technology overlays digital holographic characters onto the physical world and students interact with the characters in diverse situations.
User Experience on HoloLense
(Featured on CBS <Mission Unstoppable>, 2019)
User Flow
What does the Pally experience look like?
How does the app work?
How it works
Realistic & Experiential
Learners engage in social-emotional learning by interacting with holographic virtual characters.
Learners encounter real-life scenarios.
Repetitive
Learning can be repeated numerous times at the individual’s pace.
Learners practice in a safe space, where it is okay to make mistakes.
Personalized
Each learning experience is tailored to specific individual needs.
Collect meaningful data to enhance learning design.
Technology
Hardware
(Device)
Head Mounted Display (HMD) - Microsoft HoloLens
3D Holographic Character
3D Volumetric Capture Studio
Cloud computing
Platform
- Microsoft Azure
Spatial Anchor
Cognitive Service ( Language Understanding)
Network
5G Network
bottom of page