During this week’s instructor meeting, we clarified several design questions and explored more ambitious interactions between physical and digital elements. Following this discussion, the team also did brainstorming focusing on the \u201cmagic painting\u201d concepts. We explored how users might interact with a physical painting frame while seeing the environment transformed through mixed reality.<\/p>\n\n\n\n
A significant portion of the week was dedicated to technical research and debugging. One focus area was improving the positioning accuracy of April Tags, which are crucial for spatial tracking in our system. We investigated ways to stabilize detection and reduce positional jitter, while also fixing several bugs related to the current implementation. We also encountered issues with our photogrammetry model, which required additional adjustments and cleanup. Fixing the model ensured that it could be properly integrated into the mixed-reality environment. Besides this, the team members conducted fabrication training, exploring materials and techniques that could support the physical components of our installation.<\/p>\n\n\n\n
On the technical side, we continued experimenting with local post-processing volumes to test how specific areas of the real environment can be visually transformed. These experiments are closely related to the painting concept, where the world inside the frame may appear stylized or altered. In parallel, we researched the potential techniques for erasing or masking real-world objects, which could allow virtual elements to convincingly replace parts of the physical environment. Finally, we debugged the ArUco marker detection system and its associated shader, which are for linking the physical markers to visual effects in the virtual scene. Resolving these issues will be important for achieving stable tracking and consistent visual results.<\/p>\n","protected":false},"excerpt":{"rendered":"
During this week’s instructor meeting, we clarified several design questions and explored more ambitious interactions between physical and digital elements. Following this discussion, the team also did brainstorming focusing on the \u201cmagic painting\u201d concepts. We explored how users might interact with a physical painting frame while seeing the environment transformed through mixed reality. A significant […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[],"class_list":["post-186","post","type-post","status-publish","format-standard","hentry","category-blog"],"_links":{"self":[{"href":"https:\/\/projects.etc.cmu.edu\/liminal\/wp-json\/wp\/v2\/posts\/186","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/projects.etc.cmu.edu\/liminal\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/projects.etc.cmu.edu\/liminal\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/liminal\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/liminal\/wp-json\/wp\/v2\/comments?post=186"}],"version-history":[{"count":3,"href":"https:\/\/projects.etc.cmu.edu\/liminal\/wp-json\/wp\/v2\/posts\/186\/revisions"}],"predecessor-version":[{"id":238,"href":"https:\/\/projects.etc.cmu.edu\/liminal\/wp-json\/wp\/v2\/posts\/186\/revisions\/238"}],"wp:attachment":[{"href":"https:\/\/projects.etc.cmu.edu\/liminal\/wp-json\/wp\/v2\/media?parent=186"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/liminal\/wp-json\/wp\/v2\/categories?post=186"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/liminal\/wp-json\/wp\/v2\/tags?post=186"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}