{"id":353,"date":"2024-04-01T16:32:11","date_gmt":"2024-04-01T16:32:11","guid":{"rendered":"https:\/\/projects.etc.cmu.edu\/questure\/?p=353"},"modified":"2024-04-01T16:32:11","modified_gmt":"2024-04-01T16:32:11","slug":"week-10-mar-29-2024","status":"publish","type":"post","link":"https:\/\/projects.etc.cmu.edu\/questure\/week-10-mar-29-2024\/","title":{"rendered":"Week 10 \u2013 Mar 29, 2024"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">Parametric Game System<\/h2>\n\n\n\n<p>Following our discussion last week about the parametric game system, we have extracted several key parameters as listed below. These parameters will be managed through a JSON file, and we will provide a comprehensive document explaining each parameter. This will enable our client to easily modify them in the future.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"505\" height=\"559\" src=\"https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/ConfigScreenshot.png\" alt=\"\" class=\"wp-image-368\" style=\"width:329px;height:auto\" srcset=\"https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/ConfigScreenshot.png 505w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/ConfigScreenshot-271x300.png 271w\" sizes=\"(max-width: 505px) 100vw, 505px\" \/><figcaption class=\"wp-element-caption\">Parameters<\/figcaption><\/figure><\/div>\n\n\n<h2 class=\"wp-block-heading\">Research Data Collection<\/h2>\n\n\n\n<p>For the research data collection aspect, we have successfully integrated our game with Google Firebase. Now, whenever someone plays one of the mini-games, the data is directly uploaded to the online database in Google Firebase. At the moment, we&#8217;re using our personal Google account for this purpose. However, it will be straightforward for our client to switch to their own account later by simply replacing a configuration file.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"679\" src=\"https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/firebase-1024x679.png\" alt=\"\" class=\"wp-image-365\" srcset=\"https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/firebase-1024x679.png 1024w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/firebase-300x199.png 300w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/firebase-768x510.png 768w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/firebase-1536x1019.png 1536w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/firebase-2048x1359.png 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">Google Firebase<\/figcaption><\/figure><\/div>\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"685\" height=\"676\" src=\"https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/firebase1.png\" alt=\"\" class=\"wp-image-366\" style=\"width:417px;height:auto\" srcset=\"https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/firebase1.png 685w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/firebase1-300x296.png 300w\" sizes=\"(max-width: 685px) 100vw, 685px\" \/><figcaption class=\"wp-element-caption\">Data Detail<\/figcaption><\/figure><\/div>\n\n\n<h2 class=\"wp-block-heading\">ML Model Update<\/h2>\n\n\n\n<p><strong>J &amp; Z Integration<\/strong><\/p>\n\n\n\n<p>We&#8217;ve integrated the letters J and Z into our sign language tracker. Unlike other static gestures, these cannot be held, so we assigned them a higher priority. Now, the system identifies J and Z before detecting static gestures.<\/p>\n\n\n\n<figure class=\"wp-block-video aligncenter\"><video controls src=\"https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/JZDemo.mp4\"><\/video><figcaption class=\"wp-element-caption\">J and Z Demo<\/figcaption><\/figure>\n\n\n\n<p><strong>Challenge<\/strong><\/p>\n\n\n\n<p>During more extensive playtesting this week, we encountered an overfitting issue with the current model. When a gesture outside the 26-letter range is shown, the model mistakenly classifies it as a specific letter with high confidence. We&#8217;re addressing this by adjusting the model weights and introducing noise data. Expect further updates on this next week.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Skeleton Update<\/h2>\n\n\n\n<p><strong>Position, Scale<\/strong><\/p>\n\n\n\n<p>Additionally, we&#8217;ve made improvements to the skeleton. Previously, the skeleton was anchored to the bottom point of the palm, causing it to move unpredictably and resize based on the hand-camera distance. We&#8217;ve now recentered it on the palm and constrained the scale, ensuring consistent positioning and size regardless of the hand&#8217;s proximity to the camera.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"564\" height=\"382\" src=\"https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton_old.gif\" alt=\"\" class=\"wp-image-364\"\/><figcaption class=\"wp-element-caption\">Old Version<\/figcaption><\/figure><\/div>\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"520\" height=\"358\" src=\"https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton.gif\" alt=\"\" class=\"wp-image-363\" style=\"width:628px;height:auto\"\/><figcaption class=\"wp-element-caption\">New Version<\/figcaption><\/figure><\/div>\n\n\n<p><strong>Style<\/strong><\/p>\n\n\n\n<p>We&#8217;ve also refined the skeleton style, based on feedback from our client suggesting that simplification could be achieved by removing unnecessary landmark points. Our latest version is clearer and more user-friendly for hand tracking. We plan to further experiment with the color scheme and adjust the size of the tips to finalize an improved version.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"675\" height=\"1024\" src=\"https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton_old-675x1024.png\" alt=\"\" class=\"wp-image-362\" style=\"width:246px;height:auto\" srcset=\"https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton_old-675x1024.png 675w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton_old-198x300.png 198w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton_old-768x1165.png 768w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton_old.png 876w\" sizes=\"(max-width: 675px) 100vw, 675px\" \/><figcaption class=\"wp-element-caption\">Old Version<\/figcaption><\/figure><\/div>\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-layout-1 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\"><div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"817\" height=\"789\" src=\"https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton_simple3.png\" alt=\"\" class=\"wp-image-359\" srcset=\"https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton_simple3.png 817w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton_simple3-300x290.png 300w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton_simple3-768x742.png 768w\" sizes=\"(max-width: 817px) 100vw, 817px\" \/><figcaption class=\"wp-element-caption\">New Version 1<\/figcaption><\/figure><\/div><\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\"><div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"550\" height=\"1024\" src=\"https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton_simple1-550x1024.png\" alt=\"\" class=\"wp-image-361\" style=\"width:209px;height:auto\" srcset=\"https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton_simple1-550x1024.png 550w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton_simple1-161x300.png 161w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton_simple1-768x1431.png 768w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton_simple1-824x1536.png 824w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton_simple1.png 871w\" sizes=\"(max-width: 550px) 100vw, 550px\" \/><figcaption class=\"wp-element-caption\">New Version 2<\/figcaption><\/figure><\/div><\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\"><div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"654\" height=\"1024\" src=\"https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton_simple2-654x1024.png\" alt=\"\" class=\"wp-image-360\" style=\"width:249px;height:auto\" srcset=\"https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton_simple2-654x1024.png 654w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton_simple2-192x300.png 192w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton_simple2-768x1202.png 768w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton_simple2-981x1536.png 981w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton_simple2-1024x1603.png 1024w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/skeleton_simple2.png 1116w\" sizes=\"(max-width: 654px) 100vw, 654px\" \/><figcaption class=\"wp-element-caption\">New Version 3<\/figcaption><\/figure><\/div><\/div>\n<\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Mini Game 2 Demo<\/h2>\n\n\n\n<p>In the latest demo for mini-game 2, we&#8217;ve enhanced the skybox to evoke a dreamlike atmosphere, introduced a letter shaking feature for improved gameplay feedback, and added background music to the game.<\/p>\n\n\n\n<figure class=\"wp-block-video aligncenter\"><video controls src=\"https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/demo_game2_w10_trim-1.mp4\"><\/video><figcaption class=\"wp-element-caption\">Mini Game 2 Demo<\/figcaption><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Mini Game 3 Assets<\/h2>\n\n\n\n<p>For mini-game 3, we&#8217;ve incorporated several items we&#8217;ve painted ourselves, selecting objects that are easily recognizable and categorizing them accordingly. We&#8217;re planning to conduct tests to ensure these items are identifiable by most players. Feedback on the mango, kiwi, and duck has prompted us to revise their images. Additionally, we&#8217;re introducing a &#8216;skip&#8217; option and will display the object&#8217;s name as a hint if the player struggles to start spelling within 3-5 seconds.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"755\" src=\"https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/Weixin-Image_20240326180646-1024x755.png\" alt=\"\" class=\"wp-image-357\" srcset=\"https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/Weixin-Image_20240326180646-1024x755.png 1024w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/Weixin-Image_20240326180646-300x221.png 300w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/Weixin-Image_20240326180646-768x566.png 768w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/Weixin-Image_20240326180646-1536x1132.png 1536w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/Weixin-Image_20240326180646.png 1617w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">Mini Game 3 Assets<\/figcaption><\/figure><\/div>\n\n\n<p>All objects are configured in a JSON file, making it straightforward for our client to expand the game&#8217;s vocabulary in the future by simply adding a new image and corresponding entry to the JSON file.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"710\" height=\"1024\" src=\"https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/Weixin-Image_20240326181719-710x1024.png\" alt=\"\" class=\"wp-image-358\" style=\"width:310px;height:auto\" srcset=\"https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/Weixin-Image_20240326181719-710x1024.png 710w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/Weixin-Image_20240326181719-208x300.png 208w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/Weixin-Image_20240326181719-768x1107.png 768w, https:\/\/projects.etc.cmu.edu\/questure\/wp-content\/uploads\/2024\/03\/Weixin-Image_20240326181719.png 964w\" sizes=\"(max-width: 710px) 100vw, 710px\" \/><figcaption class=\"wp-element-caption\">Json File<\/figcaption><\/figure><\/div>\n\n\n<h2 class=\"wp-block-heading\">Meeting with Charles<\/h2>\n\n\n\n<p>This week, we had a consultation with Charles, who provided valuable feedback:<\/p>\n\n\n\n<ul>\n<li>Letter Selection Page: The instructions need to be clearer and more concise.<\/li>\n\n\n\n<li>Mini Game 3: Suggests adding more items that are culturally relevant to America.<\/li>\n\n\n\n<li>Background Music (BGM): Future selections should be unobtrusive and comfortable for players.<\/li>\n<\/ul>\n\n\n\n<p>Charles also invited two guests to playtest our game, leading to mostly positive feedback along with some suggestions, which align with our previous discussions.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Playtesting Experience Goals<\/h2>\n\n\n\n<p>As part of our preparation for next week&#8217;s Playtesting Day, we participated in a Playtesting workshop this Wednesday. Following the workshop, we defined our playtesting experience goals and formulated several questions related to these goals:<\/p>\n\n\n\n<p><strong>Educational Effectiveness<\/strong><\/p>\n\n\n\n<ul>\n<li>On a scale of 1 (I still know nothing) to 5 (I\u2019m very confident in my sign language skills now), how much has your knowledge of the sign language alphabet improved after playing the game?<\/li>\n\n\n\n<li>Were there any specific letters or signs that were difficult to learn through the game? If so, which ones, and why? (Show letters and hint images.)<\/li>\n\n\n\n<li>How helpful was the feedback for correct and incorrect answers during the game, on a scale from 1 (confusing) to 5 (very clear)? (Show game screenshots.)<\/li>\n\n\n\n<li>Did the game&#8217;s pacing and difficulty progression align with your learning pace?<\/li>\n<\/ul>\n\n\n\n<p><strong>User Engagement<\/strong><\/p>\n\n\n\n<ul>\n<li>How enjoyable was the game, on a scale from 1 (not enjoyable) to 5 (very enjoyable)?<\/li>\n\n\n\n<li>Which game elements motivated you the most to continue playing and learning?<\/li>\n\n\n\n<li>Did you ever feel bored or frustrated while playing? If so, please describe when and why?<\/li>\n\n\n\n<li>How likely are you to recommend this game to others interested in learning the sign language alphabet, on a scale from 1 (not likely) to 5 (very likely)?<\/li>\n\n\n\n<li>What improvements or additional features could make the game more engaging for you?&#8221;<\/li>\n<\/ul>\n\n\n\n<p>These questions are designed to gather comprehensive feedback that will inform future enhancements to the game.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Parametric Game System Following our discussion last week about the parametric game system, we have extracted several key parameters as listed below. These parameters will be managed through a JSON file, and we will provide a comprehensive document explaining each parameter. This will enable our client to easily modify them in the future. Research Data [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":363,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[],"_links":{"self":[{"href":"https:\/\/projects.etc.cmu.edu\/questure\/wp-json\/wp\/v2\/posts\/353"}],"collection":[{"href":"https:\/\/projects.etc.cmu.edu\/questure\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/projects.etc.cmu.edu\/questure\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/questure\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/questure\/wp-json\/wp\/v2\/comments?post=353"}],"version-history":[{"count":5,"href":"https:\/\/projects.etc.cmu.edu\/questure\/wp-json\/wp\/v2\/posts\/353\/revisions"}],"predecessor-version":[{"id":375,"href":"https:\/\/projects.etc.cmu.edu\/questure\/wp-json\/wp\/v2\/posts\/353\/revisions\/375"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/questure\/wp-json\/wp\/v2\/media\/363"}],"wp:attachment":[{"href":"https:\/\/projects.etc.cmu.edu\/questure\/wp-json\/wp\/v2\/media?parent=353"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/questure\/wp-json\/wp\/v2\/categories?post=353"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/questure\/wp-json\/wp\/v2\/tags?post=353"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}