{"id":92,"date":"2024-02-07T16:11:22","date_gmt":"2024-02-07T16:11:22","guid":{"rendered":"https:\/\/projects.etc.cmu.edu\/questure\/?p=92"},"modified":"2024-02-22T17:09:01","modified_gmt":"2024-02-22T17:09:01","slug":"week-3","status":"publish","type":"post","link":"https:\/\/projects.etc.cmu.edu\/questure\/week-3\/","title":{"rendered":"Week 3 – Feb 2, 2024"},"content":{"rendered":"\n

Tech Demo<\/h2>\n\n\n\n

We decided to utilize Unity for our development platform because we want to maintain the simplicity and accessibility of our deliverables. Our pipeline preference is “unity” + “Python” + “Google MediaPipe” And this week we have achieved 85% accuracy for almost all alphabet except some minors and letter gestures with motion.<\/p>\n\n\n\n

<\/p>\n\n\n\n

Game Prototype<\/h2>\n\n\n\n

Based on the tech, we also came up with two simple prototypes for the first and second games. Even with only three letters, “A” “B” and “C” We can already see the speed and accuracy are in reasonable margins.<\/p>\n\n\n

\n
\"\"
Mini Game 1 Prototype<\/figcaption><\/figure><\/div>\n\n\n

<\/p>\n\n\n

\n
\"\"
Mini Game 2 Prototype<\/figcaption><\/figure><\/div>\n\n\n

Three Mini-games<\/h2>\n\n\n\n

In terms of gameplay, our main focus is simplicity. We’ve developed three games that tackle various aspects of learning, effectively covering a full educational cycle.<\/p>\n\n\n\n

    \n
  • The first game<\/strong> serves as a tutorial level, where we provide players with a slower-paced gaming experience to gradually familiarize them with certain letter gestures.<\/li>\n\n\n\n
  • In the second level<\/strong>, we gradually increase the pace to challenge players’ reaction times and enhance their memory retention.<\/li>\n\n\n\n
  • In the third stage<\/strong>, we aim for players to autonomously spell out some words, transitioning from input to output, thereby completing an educational loop.<\/li>\n<\/ul>\n\n\n\n
    \"\"<\/figure>\n\n\n\n

    UI Design<\/h2>\n\n\n\n

    In UI design, we want to consider the players’ gaming experience as much as possible. This includes allowing players to see their hands within the game screen and providing corresponding versions for left-handed players.<\/p>\n\n\n\n

    \"\"<\/figure>\n\n\n\n

    Concept Art & Characters<\/h2>\n\n\n\n

    We’ve also generated numerous concept designs for characters and storylines. We aim to intricately interconnect the three games through an engaging narrative, forming a seamless and complete experience. Regarding characters, we ultimately settled on featuring a cat riding on top of a Roomba cleaner\u2014after all, who could resist such a charming duo?<\/p>\n\n\n\n

    \"\"<\/figure>\n\n\n\n

    Quarter Feedback<\/h2>\n\n\n\n

    We received a lot of valuable feedback during quarter this week. Here’s a summary.<\/p>\n\n\n\n

    Research<\/strong><\/p>\n\n\n\n

      \n
    • Pimsleur – learning theory research\n
        \n
      • Should there be interpretation in real time?<\/li>\n\n\n\n
      • What do people usually struggle with? Vocabulary? Memorize? <\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n

        Design<\/strong><\/p>\n\n\n\n

          \n
        • Keep in mind\n
            \n
          • Watch the lines – be careful of the deaf community<\/li>\n\n\n\n
          • Be mindful of hand color<\/li>\n<\/ul>\n<\/li>\n\n\n\n
          • Consider players\u2019 transformation, chunk letters and create a learning ramp<\/li>\n\n\n\n
          • Design to encourage interest curve<\/li>\n\n\n\n
          • Avoid resetting for each mini-game<\/li>\n\n\n\n
          • Think about the order of games (Verify)<\/li>\n\n\n\n
          • Add levels to each mini-game (Difficulty level)<\/li>\n\n\n\n
          • Onboarding should guide the player to the right spot and make sure the hand in the frame<\/li>\n\n\n\n
          • Add auditory feedback (need to be tested)<\/li>\n\n\n\n
          • Runner – Add penalty when signing the wrong gesture – maybe run faster?<\/li>\n\n\n\n
          • Runner – Add jump?<\/li>\n\n\n\n
          • Word Puzzle – scavenger hunt – given an image, spell out items<\/li>\n<\/ul>\n\n\n\n

            Art<\/strong><\/p>\n\n\n\n

              \n
            • Develop more on the concept art – consistent, realistic and simple<\/li>\n\n\n\n
            • Characteristics of a roomba – use the association; don\u2019t make it random<\/li>\n\n\n\n
            • Have a setting that makes sense (chasing a running character?)<\/li>\n<\/ul>\n\n\n\n

              Tech<\/strong><\/p>\n\n\n\n

                \n
              • Pick the closest hand instead of a random hand<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"

                Tech Demo We decided to utilize Unity for our development platform because we want to maintain the simplicity and accessibility of our deliverables. Our pipeline preference is “unity” + “Python” + “Google MediaPipe” And this week we have achieved 85% accuracy for almost all alphabet except some minors and letter gestures with motion. Game Prototype […]<\/p>\n","protected":false},"author":2,"featured_media":152,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[],"_links":{"self":[{"href":"https:\/\/projects.etc.cmu.edu\/questure\/wp-json\/wp\/v2\/posts\/92"}],"collection":[{"href":"https:\/\/projects.etc.cmu.edu\/questure\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/projects.etc.cmu.edu\/questure\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/questure\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/questure\/wp-json\/wp\/v2\/comments?post=92"}],"version-history":[{"count":13,"href":"https:\/\/projects.etc.cmu.edu\/questure\/wp-json\/wp\/v2\/posts\/92\/revisions"}],"predecessor-version":[{"id":235,"href":"https:\/\/projects.etc.cmu.edu\/questure\/wp-json\/wp\/v2\/posts\/92\/revisions\/235"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/questure\/wp-json\/wp\/v2\/media\/152"}],"wp:attachment":[{"href":"https:\/\/projects.etc.cmu.edu\/questure\/wp-json\/wp\/v2\/media?parent=92"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/questure\/wp-json\/wp\/v2\/categories?post=92"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/questure\/wp-json\/wp\/v2\/tags?post=92"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}