Challenges
We had two major challenges in tech and design this week.
Tech – Motion Model Training
This is our current demo for motion detection. Although we have some results, the model is not very stable. We plan to spend another week investigating this direction and from week 8, we will focus on our games first and make sure at least the alphabets work well. The more detailed approaches are introduced in another blog for special edition.
Design – Mini Game 3 Refinement
Finalizing the concept for mini-game 3 has also been challenging as we aim to balance visual appeal with simplicity and the generation of valuable data for our client’s future research. Building on our initial idea of finding a hidden cat, we considered a conveyor belt setting to minimize the need for 3D assets and significantly reduce the art workload by using 2D images. However, feedback from our client suggests that a moving belt might distract players.
Therefore, while maintaining the engaging visualization offered by 2D images, we are exploring alternative ideas that provide incremental feedback. These alternatives should also enable us to measure players’ reaction times, from the moment an object appears to when the corresponding words are spelled out.
Art Update
Balloon UI
We changed the balloon shader so that it can be filled up when the player holding the correct gesture. In this case, the player don’t have to focus on the whole screen for UI indication and focusing on the letter would be enough.
Cat Animation
We have three new clips of cat animation, which have also been integrated into the game.
UI Update
Latest Demo
Playtesting on Friday
This Friday, we have some middle school students playtesting our game and got the following feedback and findings:
- Choose how many times in total (15-20) or change depending on the number of letters selected
- Able to memorize 3 out of 5 after a round without being told to memorize
- Time settings feel good
- People would play multiple times
Meeting with Camille
We also reached out to Camille who teaches Sign Language course on the main campus. Here’re some takeaways from our conversation:
- Start with – daily conversations – greetings
- Facial expression & body movement – tones
- Difficulty of teaching
- Similar gestures (with slightly different angles)
- Hearing people perspective
- Fun ones – city / sky / animals
- ASL vs. PSE vs. SEE
- PSE – Pidgin Signed English – ASL + English grammars
- SEE – Signing Exact English
- 30 terms per class (1h 20min), slow in the first two weeks and build upon the previous range
Think About Demographic Info Collection
Additionally, our client is interested in collecting some demographic information through the game. We need to ensure that this is done in a manner that respects everyone’s rights and privacy.
Basic demographic variables of interest:
- Handedness: left/right
- Which hand do you want to play with: left/right.
- Age, biological sex
- Screen size / browser / computer model