{"id":552,"date":"2026-03-24T18:58:20","date_gmt":"2026-03-24T18:58:20","guid":{"rendered":"https:\/\/projects.etc.cmu.edu\/soulos\/?page_id=552"},"modified":"2026-03-24T19:12:09","modified_gmt":"2026-03-24T19:12:09","slug":"week-09","status":"publish","type":"page","link":"https:\/\/projects.etc.cmu.edu\/soulos\/week-09\/","title":{"rendered":"Week 09"},"content":{"rendered":"\n<div class=\"wp-block-group has-global-padding is-layout-constrained wp-block-group-is-layout-constrained\">\n<p><strong>Gameplay Finalization<\/strong><\/p>\n\n\n\n<p style=\"font-style:normal;font-weight:500\">In Week 09, we finalized the overall gameplay structure within the oxygen-based time-limited escape framework. The progression across all three levels\u2014restoring power, fixing the robot, and escaping together\u2014has been clearly defined, with refined cooperative mechanics and player roles. We strengthened the oxygen depletion system as the central tension driver, ensuring that each interaction meaningfully contributes to urgency and pacing. The interaction logic between AR and physical components is now structured and consistent across levels, making the core experience cohesive and readable.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\">Technical Architecture Upgrade \u2013 AR Mapping<\/h4>\n\n\n\n<p style=\"font-style:normal;font-weight:500\">On the technical side, we focused on improving the mapping between the AR avatar and the physical robot. We identified spatial misalignment, drift, and latency in the current synchronization pipeline. To address these issues, we designed a new system architecture introducing a Digital Twin running on the Host PC. The Digital Twin acts as the central synchronization layer: it instantly updates based on hand-tracking input, sends joint commands to the physical robot, and reconciles state differences using hardware feedback. This reduces perceived latency and improves motion stability.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\">OpenCV-Based Spatial Correction<\/h4>\n\n\n\n<p style=\"font-style:normal;font-weight:500\">In addition, we plan to integrate OpenCV as a visual grounding layer to correct long-term spatial drift. By detecting the robot\u2019s real-world pose through camera-based tracking, we can compute pose differences between the physical robot and the Digital Twin, then apply real-time transform corrections to the AR avatar. This approach aims to stabilize both temporal and spatial alignment, significantly enhancing embodiment and interaction reliability.<\/p>\n<\/div>\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Gameplay Finalization In Week 09, we finalized the overall gameplay structure within the oxygen-based time-limited escape framework. The progression across all three levels\u2014restoring power, fixing the robot, and escaping together\u2014has been clearly defined, with refined cooperative mechanics and player roles. We strengthened the oxygen depletion system as the central tension driver, ensuring that each interaction [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-552","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/projects.etc.cmu.edu\/soulos\/wp-json\/wp\/v2\/pages\/552","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/projects.etc.cmu.edu\/soulos\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/projects.etc.cmu.edu\/soulos\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/soulos\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/soulos\/wp-json\/wp\/v2\/comments?post=552"}],"version-history":[{"count":2,"href":"https:\/\/projects.etc.cmu.edu\/soulos\/wp-json\/wp\/v2\/pages\/552\/revisions"}],"predecessor-version":[{"id":555,"href":"https:\/\/projects.etc.cmu.edu\/soulos\/wp-json\/wp\/v2\/pages\/552\/revisions\/555"}],"wp:attachment":[{"href":"https:\/\/projects.etc.cmu.edu\/soulos\/wp-json\/wp\/v2\/media?parent=552"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}