About

Team Questure is a diverse team of six graduate students from CMU’s Entertainment Technology Center. The team aims to develop an educational video game dedicated to teaching sign language through entertaining and engaging experiences. To capture players’ hand gestures as game inputs, the team leverages Google MediaPipe tracking technology and machine learning for the gesture detection and recognition.

In collaboration with Jonathan Tsay, a researcher with a background in theoretical mathematics, physical rehabilitation, and cognitive neuroscience, the game’s foundational structure and learning curves are effectively shaped. The project is designed to make learning American Sign Language (ASL) both fun and interactive. Instead of traditional classroom methods, it invites learners to dive into role-play and problem solving. This approach makes learning more enjoyable and memorable, with visual elements that help in understanding and retaining ASL more effectively. The game mixes learning and testing in a playful setting, making ASL not only easier to grasp but also bridging the communication gap with the deaf and hard of hearing communities.

Client

Jonathan S. Tsay

Jonathan Tsay is incoming assistant professor of psychology at Carnegie Mellon University. He has a background in theoretical mathematics (B.A. from Northwestern University), physical rehabilitation (D.P.T. from Northwestern University’s Feinberg School of Medicine), and cognitive neuroscience (Ph.D. from UC Berkeley).