Gameplay Finalization

In Week 09, we finalized the overall gameplay structure within the oxygen-based time-limited escape framework. The progression across all three levels—restoring power, fixing the robot, and escaping together—has been clearly defined, with refined cooperative mechanics and player roles. We strengthened the oxygen depletion system as the central tension driver, ensuring that each interaction meaningfully contributes to urgency and pacing. The interaction logic between AR and physical components is now structured and consistent across levels, making the core experience cohesive and readable.

Technical Architecture Upgrade – AR Mapping

On the technical side, we focused on improving the mapping between the AR avatar and the physical robot. We identified spatial misalignment, drift, and latency in the current synchronization pipeline. To address these issues, we designed a new system architecture introducing a Digital Twin running on the Host PC. The Digital Twin acts as the central synchronization layer: it instantly updates based on hand-tracking input, sends joint commands to the physical robot, and reconciles state differences using hardware feedback. This reduces perceived latency and improves motion stability.

OpenCV-Based Spatial Correction

In addition, we plan to integrate OpenCV as a visual grounding layer to correct long-term spatial drift. By detecting the robot’s real-world pose through camera-based tracking, we can compute pose differences between the physical robot and the Digital Twin, then apply real-time transform corrections to the AR avatar. This approach aims to stabilize both temporal and spatial alignment, significantly enhancing embodiment and interaction reliability.