{"id":112,"date":"2025-02-06T20:05:34","date_gmt":"2025-02-06T20:05:34","guid":{"rendered":"https:\/\/projects.etc.cmu.edu\/stringers\/?p=112"},"modified":"2025-02-14T21:45:17","modified_gmt":"2025-02-14T21:45:17","slug":"week-4","status":"publish","type":"post","link":"https:\/\/projects.etc.cmu.edu\/stringers\/week-4\/","title":{"rendered":"Week 4"},"content":{"rendered":"\n<div class=\"wp-block-group alignfull has-contrast-color has-text-color has-link-color wp-elements-7d4e143acf2ca93552c83713b38c2d68 has-global-padding is-layout-constrained wp-container-core-group-is-layout-4 wp-block-group-is-layout-constrained\" style=\"padding-top:var(--wp--preset--spacing--30);padding-right:var(--wp--preset--spacing--30);padding-bottom:var(--wp--preset--spacing--30);padding-left:var(--wp--preset--spacing--30)\">\n<div class=\"wp-block-group alignwide is-content-justification-space-between is-layout-flex wp-container-core-group-is-layout-3 wp-block-group-is-layout-flex\">\n<div class=\"wp-block-group is-layout-flex wp-container-core-group-is-layout-2 wp-block-group-is-layout-flex\"><div class=\"is-default-size wp-block-site-logo\"><a href=\"https:\/\/projects.etc.cmu.edu\/stringers\/\" class=\"custom-logo-link\" rel=\"home\"><img loading=\"lazy\" decoding=\"async\" width=\"2389\" height=\"994\" src=\"https:\/\/projects.etc.cmu.edu\/stringers\/wp-content\/uploads\/2025\/02\/Screenshot-2025-02-14-163003.png\" class=\"custom-logo\" alt=\"STRINGERS\" srcset=\"https:\/\/projects.etc.cmu.edu\/stringers\/wp-content\/uploads\/2025\/02\/Screenshot-2025-02-14-163003.png 2389w, https:\/\/projects.etc.cmu.edu\/stringers\/wp-content\/uploads\/2025\/02\/Screenshot-2025-02-14-163003-300x125.png 300w, https:\/\/projects.etc.cmu.edu\/stringers\/wp-content\/uploads\/2025\/02\/Screenshot-2025-02-14-163003-1024x426.png 1024w, https:\/\/projects.etc.cmu.edu\/stringers\/wp-content\/uploads\/2025\/02\/Screenshot-2025-02-14-163003-768x320.png 768w, https:\/\/projects.etc.cmu.edu\/stringers\/wp-content\/uploads\/2025\/02\/Screenshot-2025-02-14-163003-1536x639.png 1536w, https:\/\/projects.etc.cmu.edu\/stringers\/wp-content\/uploads\/2025\/02\/Screenshot-2025-02-14-163003-2048x852.png 2048w\" sizes=\"auto, (max-width: 2389px) 100vw, 2389px\" \/><\/a><\/div>\n\n\n<div class=\"wp-block-group is-vertical is-layout-flex wp-container-core-group-is-layout-1 wp-block-group-is-layout-flex\"><h1 class=\"has-link-color wp-elements-d6202aa7d337f2ce08aedc8ed261a84e wp-block-site-title\"><a href=\"https:\/\/projects.etc.cmu.edu\/stringers\" target=\"_self\" rel=\"home\">STRINGERS<\/a><\/h1>\n\n<p class=\"wp-block-site-tagline has-small-font-size\"> &#8211; An ETC Project website<\/p><\/div>\n<\/div>\n\n\n<nav class=\"has-small-font-size is-responsive items-justified-right wp-block-navigation is-content-justification-right is-layout-flex wp-container-core-navigation-is-layout-1 wp-block-navigation-is-layout-flex\" aria-label=\"Navigation\" \n\t\t data-wp-interactive=\"core\/navigation\" data-wp-context='{\"overlayOpenedBy\":{\"click\":false,\"hover\":false,\"focus\":false},\"type\":\"overlay\",\"roleAttribute\":\"\",\"ariaLabel\":\"Menu\"}'><button aria-haspopup=\"dialog\" aria-label=\"Open menu\" class=\"wp-block-navigation__responsive-container-open \" \n\t\t\t\tdata-wp-on-async--click=\"actions.openMenuOnClick\"\n\t\t\t\tdata-wp-on--keydown=\"actions.handleMenuKeydown\"\n\t\t\t><svg width=\"24\" height=\"24\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 24 24\" aria-hidden=\"true\" focusable=\"false\"><rect x=\"4\" y=\"7.5\" width=\"16\" height=\"1.5\" \/><rect x=\"4\" y=\"15\" width=\"16\" height=\"1.5\" \/><\/svg><\/button>\n\t\t\t\t<div class=\"wp-block-navigation__responsive-container  \"  id=\"modal-1\" \n\t\t\t\tdata-wp-class--has-modal-open=\"state.isMenuOpen\"\n\t\t\t\tdata-wp-class--is-menu-open=\"state.isMenuOpen\"\n\t\t\t\tdata-wp-watch=\"callbacks.initMenu\"\n\t\t\t\tdata-wp-on--keydown=\"actions.handleMenuKeydown\"\n\t\t\t\tdata-wp-on-async--focusout=\"actions.handleMenuFocusout\"\n\t\t\t\ttabindex=\"-1\"\n\t\t\t>\n\t\t\t\t\t<div class=\"wp-block-navigation__responsive-close\" tabindex=\"-1\">\n\t\t\t\t\t\t<div class=\"wp-block-navigation__responsive-dialog\" \n\t\t\t\tdata-wp-bind--aria-modal=\"state.ariaModal\"\n\t\t\t\tdata-wp-bind--aria-label=\"state.ariaLabel\"\n\t\t\t\tdata-wp-bind--role=\"state.roleAttribute\"\n\t\t\t>\n\t\t\t\t\t\t\t<button aria-label=\"Close menu\" class=\"wp-block-navigation__responsive-container-close\" \n\t\t\t\tdata-wp-on-async--click=\"actions.closeMenuOnClick\"\n\t\t\t><svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 24 24\" width=\"24\" height=\"24\" aria-hidden=\"true\" focusable=\"false\"><path d=\"m13.06 12 6.47-6.47-1.06-1.06L12 10.94 5.53 4.47 4.47 5.53 10.94 12l-6.47 6.47 1.06 1.06L12 13.06l6.47 6.47 1.06-1.06L13.06 12Z\"><\/path><\/svg><\/button>\n\t\t\t\t\t\t\t<div class=\"wp-block-navigation__responsive-container-content\" \n\t\t\t\tdata-wp-watch=\"callbacks.focusFirstElement\"\n\t\t\t id=\"modal-1-content\">\n\t\t\t\t\t\t\t\t<ul class=\"wp-block-navigation__container has-small-font-size is-responsive items-justified-right wp-block-navigation has-small-font-size\"><ul class=\"has-small-font-size wp-block-page-list\"><li class=\"wp-block-pages-list__item wp-block-navigation-item open-on-hover-click\"><a class=\"wp-block-pages-list__item__link wp-block-navigation-item__content\" href=\"https:\/\/projects.etc.cmu.edu\/stringers\/9-2\/\">About<\/a><\/li><li class=\"wp-block-pages-list__item wp-block-navigation-item open-on-hover-click\"><a class=\"wp-block-pages-list__item__link wp-block-navigation-item__content\" href=\"https:\/\/projects.etc.cmu.edu\/stringers\/blog-posts\/\">Blog Posts<\/a><\/li><li class=\"wp-block-pages-list__item wp-block-navigation-item open-on-hover-click\"><a class=\"wp-block-pages-list__item__link wp-block-navigation-item__content\" href=\"https:\/\/projects.etc.cmu.edu\/stringers\/sample-page\/\">Contact Us<\/a><\/li><li class=\"wp-block-pages-list__item wp-block-navigation-item open-on-hover-click\"><a class=\"wp-block-pages-list__item__link wp-block-navigation-item__content\" href=\"https:\/\/projects.etc.cmu.edu\/stringers\/media\/\">Media<\/a><\/li><li class=\"wp-block-pages-list__item wp-block-navigation-item open-on-hover-click\"><a class=\"wp-block-pages-list__item__link wp-block-navigation-item__content\" href=\"https:\/\/projects.etc.cmu.edu\/stringers\/our-team\/\">Our Team<\/a><\/li><\/ul><\/ul>\n\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div><\/nav><\/div>\n<\/div>\n\n\n\n<p>We took our team photo!<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"768\" src=\"https:\/\/projects.etc.cmu.edu\/stringers\/wp-content\/uploads\/2025\/02\/IMG_0171-1-1024x768.jpg\" alt=\"\" class=\"wp-image-121\" srcset=\"https:\/\/projects.etc.cmu.edu\/stringers\/wp-content\/uploads\/2025\/02\/IMG_0171-1-1024x768.jpg 1024w, https:\/\/projects.etc.cmu.edu\/stringers\/wp-content\/uploads\/2025\/02\/IMG_0171-1-300x225.jpg 300w, https:\/\/projects.etc.cmu.edu\/stringers\/wp-content\/uploads\/2025\/02\/IMG_0171-1-768x576.jpg 768w, https:\/\/projects.etc.cmu.edu\/stringers\/wp-content\/uploads\/2025\/02\/IMG_0171-1-1536x1152.jpg 1536w, https:\/\/projects.etc.cmu.edu\/stringers\/wp-content\/uploads\/2025\/02\/IMG_0171-1.jpg 1594w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h5 class=\"wp-block-heading\"><strong>Production:<\/strong><\/h5>\n\n\n\n<p><strong>Long Story Short: <\/strong>After considering time limitations, technological constraints, the availability of collectible data, and limited human resources, we have been advised to shift our focus away from the ukulele\u2014whether it involves hand tracking, chord detection, or pitch detection\u2014and instead explore face detection, which is much more accessible from a technological standpoint.<\/p>\n\n\n\n<h5 class=\"wp-block-heading\"><strong>Programming:<\/strong><\/h5>\n\n\n\n<p>Before arriving at this decision to change technologies, we thoroughly investigated the practicality of ukulele-based detection:<\/p>\n\n\n\n<p><em>Hand Detection:<\/em> Highly unstable when playing the ukulele (using MediaPipe)<\/p>\n\n\n\n<p><em>Ukulele Detection: <\/em>High cost, high risk<\/p>\n\n\n\n<p><em>Chord Shape Detection: <\/em>High cost, high risk<\/p>\n\n\n\n<h5 class=\"wp-block-heading\"><strong>1. Hand Detection (Based on Initial Project Concept)<\/strong><\/h5>\n\n\n\n<p>Our original plan followed a process similar to Gesture Quest. However, left-hand tracking is often occluded by the fretboard, while the right hand becomes unidentifiable when strumming. Additionally, training a machine learning model from scratch requires time, and we are uncertain whether it will function effectively without this extended training period.<\/p>\n\n\n\n<h5 class=\"wp-block-heading\"><strong>2. Alternative Approach: Sound Detection<\/strong><\/h5>\n\n\n\n<p><em>A. Chord Detection:<\/em><\/p>\n\n\n\n<p>Chord detection differs significantly from pitch detection. It requires sound-related algorithms and ideally machine learning to train a model that extracts individual notes from a chord.<\/p>\n\n\n\n<p><em>B. Pitch Detection:<\/em><\/p>\n\n\n\n<p>Pitch detection is feasible; however, it would mean completely eliminating left-hand detection (chord tracking), which is a core requirement for our clients.<\/p>\n\n\n\n<h5 class=\"wp-block-heading\"><strong>Decision Making<\/strong><\/h5>\n\n\n\n<p>After multiple discussions and practical considerations, we have decided to spend the following week rethinking a game that utilizes face detection as an alternative controller, aiming to craft an intuitive experience for motor skill progression.<\/p>\n\n\n\n<h5 class=\"wp-block-heading\"><strong>Game Design + Art Direction<\/strong><\/h5>\n\n\n\n<p>Since our original plan was to brainstorm a generalized art direction that could work for both ukulele and face detection, we developed the following concept:<\/p>\n\n\n\n<p><strong>Game Content: <\/strong>Side-scrolling, 3D art, low-poly style with a strong emphasis on environmental aesthetics and stylized rendering.<\/p>\n\n\n\n<p><strong>Gameplay features: <\/strong>Environmental puzzles and platforming mechanics.<\/p>\n\n\n\n<p><strong>Game Controls:<\/strong><\/p>\n\n\n\n<p>Basic movement: Click or keyboard control move the character.<\/p>\n\n\n\n<p>Puzzle mechanics: Utilize special inputs (e.g., sound, gestures, object interactions).<\/p>\n\n\n\n<p><strong>Game Loop:<\/strong><\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Basic character movement<\/li>\n\n\n\n<li>Encounter puzzle\/obstacle<\/li>\n\n\n\n<li>Use special input to solve the puzzle\/progress<\/li>\n\n\n\n<li>Resume basic movement<\/li>\n<\/ol>\n\n\n\n<p>\u2193 Here is an early idea of the game layout: While the UI will vary based on different input methods, the 3D assets will be reusable. Next week, after receiving refined client requirements and direction based on face detection, we will restart the process and frame a few concept pitches for this new approach.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh7-rt.googleusercontent.com\/docsz\/AD_4nXfpddHoQHyLUEDcgJBfYag4hz0AI8snBiif9lBCTdfvE2kcYZFmkvPfcvJ4S7-72qN2Gxx7twdUsInzN96yVqEWTVmHcBMrfBTNCWMrEftE8wEvk0cOC6pObNq11AFIg_WocJ8YTA?key=x-gr6DbU9-kLk4LFWL0du69S\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh7-rt.googleusercontent.com\/docsz\/AD_4nXdyE3nKy3IVnBQTgWBZ2k1wZ5z3q-7KKqlvv3Rvqa0Vd-Zvlj-nMabr4NM0pUSDwEschYs64cZZMybDQxOsuSmxqd3OehlT60llHV_i9yUYetA32u_PCmEpjedYEall30X0EN-ERg?key=x-gr6DbU9-kLk4LFWL0du69S\" alt=\"\"\/><\/figure>\n\n\n\n<div class=\"wp-block-group alignfull is-style-section-5 has-global-padding is-layout-constrained wp-block-group-is-layout-constrained is-style-section-5--2\" style=\"padding-top:var(--wp--preset--spacing--60);padding-bottom:var(--wp--preset--spacing--60)\">\n<div class=\"wp-block-group is-vertical is-content-justification-stretch is-layout-flex wp-container-core-group-is-layout-5 wp-block-group-is-layout-flex\"><h2 style=\"font-style:normal;font-weight:400;text-transform:uppercase;\" class=\"has-text-align-center wp-block-site-title has-x-large-font-size\"><a href=\"https:\/\/projects.etc.cmu.edu\/stringers\" target=\"_self\" rel=\"home\">STRINGERS<\/a><\/h2>\n\n<nav style=\"font-style:normal;font-weight:400;text-transform:uppercase;\" class=\"has-x-large-font-size items-justified-center wp-block-navigation is-content-justification-center is-layout-flex wp-container-core-navigation-is-layout-2 wp-block-navigation-is-layout-flex\" aria-label=\"Navigation 2\"><ul style=\"font-style:normal;font-weight:400;text-transform:uppercase;\" class=\"wp-block-navigation__container has-x-large-font-size items-justified-center wp-block-navigation has-x-large-font-size\"><li class=\"has-x-large-font-size wp-block-navigation-item wp-block-navigation-link\"><a class=\"wp-block-navigation-item__content\"  href=\"#\"><span class=\"wp-block-navigation-item__label\">For ukulele<\/span><\/a><\/li><\/ul><\/nav><\/div>\n\n\n\n<div style=\"height:var(--wp--preset--spacing--30)\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"has-text-align-center has-small-font-size\">By Entertainment Technology Center<\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>We took our team photo! Production: Long Story Short: After considering time limitations, technological constraints, the availability of collectible data, and limited human resources, we have been advised to shift our focus away from the ukulele\u2014whether it involves hand tracking, chord detection, or pitch detection\u2014and instead explore face detection, which is much more accessible from [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-112","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/projects.etc.cmu.edu\/stringers\/wp-json\/wp\/v2\/posts\/112","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/projects.etc.cmu.edu\/stringers\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/projects.etc.cmu.edu\/stringers\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/stringers\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/stringers\/wp-json\/wp\/v2\/comments?post=112"}],"version-history":[{"count":3,"href":"https:\/\/projects.etc.cmu.edu\/stringers\/wp-json\/wp\/v2\/posts\/112\/revisions"}],"predecessor-version":[{"id":146,"href":"https:\/\/projects.etc.cmu.edu\/stringers\/wp-json\/wp\/v2\/posts\/112\/revisions\/146"}],"wp:attachment":[{"href":"https:\/\/projects.etc.cmu.edu\/stringers\/wp-json\/wp\/v2\/media?parent=112"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/stringers\/wp-json\/wp\/v2\/categories?post=112"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/stringers\/wp-json\/wp\/v2\/tags?post=112"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}