{"id":150,"date":"2025-02-17T23:50:27","date_gmt":"2025-02-17T23:50:27","guid":{"rendered":"https:\/\/projects.etc.cmu.edu\/ppp\/?p=150"},"modified":"2025-02-21T22:30:12","modified_gmt":"2025-02-21T22:30:12","slug":"week-5","status":"publish","type":"post","link":"https:\/\/projects.etc.cmu.edu\/ppp\/week-5\/","title":{"rendered":"Week 5: More technical possibilities"},"content":{"rendered":"\n

This week was packed with exciting developments, inspiring discussions, and some technical challenges that we were able to overcome. Here\u2019s a breakdown of what we\u2019ve been up to:<\/p>\n\n\n\n

\n\n\n\n

Soft Circuits and Touch Interactions<\/strong><\/h3>\n\n\n\n

We had the pleasure of meeting with Olivia Robinson<\/a><\/strong>, one of our faculty consultants and an expert in soft technologies at IDeATe, to discuss the technical details of successfully building our physical pet plush. Olivia introduced us to a variety of soft circuits built with conductive yarn, which enable touch interactions such as squeezing, pulling, and petting.<\/p>\n\n\n\n

We were particularly inspired by the potential of these soft circuits to deliver analog data via all these different touch interactions, and by their ability to fit better within our plush than hard, pre-built force-sensing resistors. After 1\/2s, we plan to experiment with integrating Olivia\u2019s designs into our pet, exploring how these touch-sensitive materials can deepen the connection between the user and their companion.<\/p>\n\n\n\n

\n
\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n
An example of a homemade force sensor made by Olivia.<\/figcaption><\/figure>\n\n\n\n
\n\n\n\n

The Magical Moment: Linking Physical and Virtual Pets<\/strong><\/h3>\n\n\n\n

To solve the storytelling challenge of linking the physical and virtual pet, Jerry designed the\u00a0Magical Moment<\/strong> of our experience\u2014the point where the physical and virtual pets are linked for the player. This moment is framed within the context of a\u00a0ritual<\/strong>, designed to feel seamless and magical. Here\u2019s how it works:<\/p>\n\n\n\n

    \n
  1. The player puts on the headset and hears a sleeping sound. Only the sleeping physical pet is visible.<\/li>\n\n\n\n
  2. They touch the physical pet to “charge” it with energy. <\/li>\n\n\n\n
  3. When the pet has enough energy, it wakes up and the virtual pet pops out of the physical pet.<\/li>\n<\/ol>\n\n\n\n
    \"\"
    A storyboard of the Magical Moment<\/figcaption><\/figure>\n\n\n\n

    This approach not only simplifies the technical challenges with object tracking but also ensures that the moment feels natural and effortless for the user.<\/p>\n\n\n\n

    \n\n\n\n

    ESP32 Challenges and Solutions<\/strong><\/h3>\n\n\n\n

    On the technical side, we ran into an issue with the\u00a0ESP32. Specifically, the\u00a0Apple Vision Pro was unable to read physical keyboard inputs in-game, which posed a problem for our force sensor inputs. Thankfully, Jerry and Brian discovered this issue sooner rather than later and were able to troubleshoot this quickly by implementing a\u00a0hidden text box\u00a0as a workaround.<\/p>\n\n\n\n

    Brian is now working on converting the force sensor inputs into Xbox controller inputs, which not only resolves the issue but also gives us more analog freedom in how we interpret and use the sensor data. This solution opens up new possibilities for nuanced interactions, allowing us to better capture the subtleties of touch and pressure.<\/p>\n\n\n\n

    \n\n\n\n

    Looking Ahead<\/strong><\/h3>\n\n\n\n

    With these updates, we\u2019re making steady progress toward our goals. Here\u2019s what\u2019s next:<\/p>\n\n\n\n

      \n
    • Preparing for 1\/2s<\/strong>: As 1\/2s presentations are in Week 7, we will be sprinting towards completing a prototype and rehearsing our presentation.<\/li>\n\n\n\n
    • Refining the Magical Moment<\/strong>: We\u2019ll continue to build and polish this key interaction, ensuring that the transition between the physical and virtual pets feels as magical and seamless as possible.<\/li>\n\n\n\n
    • Finalizing the ESP32 setup<\/strong>: Once Brian\u2019s work on converting force sensor inputs to Xbox controller inputs is complete, we can connect it to the physical pet and have a working prototype.<\/li>\n<\/ul>\n\n\n\n

      We\u2019re excited to keep pushing forward and can\u2019t wait to share more updates as we continue to bring this project to life!<\/p>\n","protected":false},"excerpt":{"rendered":"

      This week was packed with exciting developments, inspiring discussions, and some technical challenges […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-150","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/projects.etc.cmu.edu\/ppp\/wp-json\/wp\/v2\/posts\/150","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/projects.etc.cmu.edu\/ppp\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/projects.etc.cmu.edu\/ppp\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/ppp\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/ppp\/wp-json\/wp\/v2\/comments?post=150"}],"version-history":[{"count":9,"href":"https:\/\/projects.etc.cmu.edu\/ppp\/wp-json\/wp\/v2\/posts\/150\/revisions"}],"predecessor-version":[{"id":201,"href":"https:\/\/projects.etc.cmu.edu\/ppp\/wp-json\/wp\/v2\/posts\/150\/revisions\/201"}],"wp:attachment":[{"href":"https:\/\/projects.etc.cmu.edu\/ppp\/wp-json\/wp\/v2\/media?parent=150"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/ppp\/wp-json\/wp\/v2\/categories?post=150"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/ppp\/wp-json\/wp\/v2\/tags?post=150"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}