{"id":377,"date":"2024-04-05T17:41:42","date_gmt":"2024-04-05T17:41:42","guid":{"rendered":"https:\/\/projects.etc.cmu.edu\/questure\/?p=377"},"modified":"2024-04-09T20:07:21","modified_gmt":"2024-04-09T20:07:21","slug":"week-11-april-5-2024","status":"publish","type":"post","link":"https:\/\/projects.etc.cmu.edu\/questure\/week-11-april-5-2024\/","title":{"rendered":"Week 11 \u2013 April 5, 2024"},"content":{"rendered":"\n

Sign Language Tracker<\/h2>\n\n\n\n

In response to the overfitting issue identified last week in our Sign Language Tracker, we implemented several strategies to improve model performance:<\/p>\n\n\n\n

Model Adjustment Strategies:<\/strong><\/p>\n\n\n\n

We adjusted the model’s weights to prevent overfitting. This included incorporating dropout layers to regulate the learning rate, implementing early stopping to halt training before overfitting starts, and experimenting with the addition of regularizers to penalize complex models.<\/p>\n\n\n\n

Data Augmentation:<\/strong><\/p>\n\n\n\n

To enhance the model’s generalization capabilities, we added noise data to our training set, including ‘thumbs up’, ‘thumbs down’, and various random gestures. This diversity in data helps the model learn to distinguish between intentional sign language gestures and non-sign movements.<\/p>\n\n\n\n

We will keep testing and try to strike a balance between accuracy and generalizability, ensuring the tracker performs reliably across a wide range of inputs.<\/p>\n\n\n\n

Two Sets of UI<\/h2>\n\n\n\n

We\u2019ve introduced two UI setups tailored for left-handed and right-handed users. Players can now easily select their preferred hand via the settings on the main page, having a more personalized gaming experience.<\/p>\n\n\n\n

\n
\n
\"\"
Mini 1 Right Version<\/figcaption><\/figure><\/div><\/div>\n\n\n\n
\n
\"\"
Mini 1 Left Version<\/figcaption><\/figure><\/div><\/div>\n<\/div>\n\n\n\n
\n
\n
\"\"
Mini 2 Right Version<\/figcaption><\/figure><\/div><\/div>\n\n\n\n
\n
\"\"
Mini 2 Left Version<\/figcaption><\/figure><\/div><\/div>\n<\/div>\n\n\n\n

Skeleton Experiments<\/h2>\n\n\n\n

This week, we conducted further experiments with the skeleton model, testing various colors, sizes, and levels of transparency. Of all the variations, a bluish color scheme was most harmonious with our scene. We also streamlined the design by removing superfluous dots from the skeleton, achieving a simpler and clearer visual.<\/p>\n\n\n

\n
\"\"
Experiment I<\/figcaption><\/figure><\/div>\n\n\n
\n
\n
\"\"<\/figure>\n<\/div>\n\n\n\n
\n
\"\"
Experiment II<\/figcaption><\/figure><\/div><\/div>\n\n\n\n
\n
\"\"<\/figure>\n<\/div>\n<\/div>\n\n\n\n

UI Update<\/h2>\n\n\n\n

We’ve refined the UI for Mini Game 3, the game selection page, and the ready page, creating two versions for each to present to our client. After reviewing both options, we reached a consensus with our client in favor of the right version for each interface. These selected UI designs were successfully implemented into the game in time for our playtesting day as well.<\/p>\n\n\n\n

\n
\n
\"\"
Mini 3 I<\/figcaption><\/figure><\/div><\/div>\n\n\n\n
\n
\"\"
Mini 3 II<\/figcaption><\/figure><\/div><\/div>\n<\/div>\n\n\n\n
\n
\n
\"\"
Game Selection I<\/figcaption><\/figure><\/div><\/div>\n\n\n\n
\n
\"\"
Game Selection II<\/figcaption><\/figure><\/div><\/div>\n<\/div>\n\n\n\n
\n
\n
\"\"
Ready Page I<\/figcaption><\/figure><\/div><\/div>\n\n\n\n
\n
\"\"
Ready Page II<\/figcaption><\/figure><\/div><\/div>\n<\/div>\n\n\n\n

For the ready page, we’re considering centralizing the hint image and the skeleton to eliminate the need for separate layouts for left-handed and right-handed users. This way, we would only need to swap the hint image to correspond with the user’s hand preference, whether it be for the left or right hand.<\/p>\n\n\n\n

Hint Options & Parameters<\/h2>\n\n\n\n

We’ve refined the hint options across various levels and games, introducing the ability to customize the delay before a hint appears, particularly for the beginner level. This feature will be parameterized, allowing our client to adjust the timing according to future research needs.<\/p>\n\n\n\n

 <\/td>Beginner<\/td>Intermediate<\/td>Advanced<\/td><\/tr>
Mini Game 1<\/td>Hint appears after 2 sec<\/td>Hint appears after 5 sec<\/td> <\/td><\/tr>
Mini Game 2<\/td>Hint appears after 1.5 sec<\/td>Hint appears only when the alphabet was not hit last time<\/td>No hint<\/td><\/tr>
Mini Game 3<\/td> <\/td> <\/td>No hint<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

Art Update<\/h2>\n\n\n\n

Intro Animation<\/strong><\/p>\n\n\n\n

We\u2019ve decided to integrate comic-style animations before the start of each game to provide players with additional context on the narrative, aiming to enhance their engagement. Below is the introductory animation for mini game 1.<\/p>\n\n\n\n