{"id":309,"date":"2026-04-04T00:09:57","date_gmt":"2026-04-04T00:09:57","guid":{"rendered":"https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/?page_id=309"},"modified":"2026-04-04T00:09:57","modified_gmt":"2026-04-04T00:09:57","slug":"week-11-blog","status":"publish","type":"page","link":"https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/week-11-blog\/","title":{"rendered":"Week 11 Blog"},"content":{"rendered":"\n<p>Our final music video\u2019s basic structure is now soft-locked. This week, we focused on placing and animating cameras and characters in Unreal Engine, then bringing those screen recordings into Premiere Pro to continue building out an animatic, which will help us better understand how the full piece is coming together.&nbsp;<\/p>\n\n\n\n<p>This week\u2019s major additions to the animatic, in order of appearance, are:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Light picks up the apple in the supermarket<\/li>\n\n\n\n<li>Light and Shadow hold the apple together as the supermarket transitions into the garden<\/li>\n\n\n\n<li>Light and Shadow walk down the hallway<\/li>\n\n\n\n<li>The hallway transitions into the snow scene<\/li>\n\n\n\n<li>The snow fight scene using motion-captured animation<\/li>\n\n\n\n<li>The TouchDesigner clock pulsing in time with the music<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">In more detail<\/h2>\n\n\n\n<p>Grace continued working on the hand animation sequences. We currently have two close-up hand scenes planned, and they serve two important purposes.<\/p>\n\n\n\n<p>First, they add emotional richness to the story. In the first scene, Light hands Shadow an apple during their \u201cmeet-cute.\u201d Near the end of the piece, there is a visual callback: Shadow reaches for Light, trying to hold on, but she is out of the picture (metaphorically and figuratively).&nbsp;<\/p>\n\n\n\n<p>Second, these scenes support the overall visual language of the piece. Including two animated close-up sequences makes the use of animation feel intentional rather than a one-off stylistic choice. They also provide a useful way to break up scenes and transition between larger environments without requiring additional transition shots.<\/p>\n\n\n\n<p>Oliver, our sound designer, experimented with rendering video from TouchDesigner with a transparent background. This will allow us to overlay the pulsing, particle-like clock visual into the final fight scene. In addition, Oliver continued refining the music.&nbsp;<\/p>\n\n\n\n<p>Alex and Christina completed another motion capture shoot, with Christina performing the fight choreography. Through this process, we are continuing to learn about the limitations of our simple six-point motion capture setup. Motions such as squatting, crossing arms, or any pose where body parts touch each other do not translate well with our current system.<\/p>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-28f84493 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"1024\" src=\"https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/wp-content\/uploads\/2026\/04\/mocap-device-1-1024x1024.jpg\" alt=\"\" class=\"wp-image-316\" srcset=\"https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/wp-content\/uploads\/2026\/04\/mocap-device-1-1024x1024.jpg 1024w, https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/wp-content\/uploads\/2026\/04\/mocap-device-1-300x300.jpg 300w, https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/wp-content\/uploads\/2026\/04\/mocap-device-1-150x150.jpg 150w, https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/wp-content\/uploads\/2026\/04\/mocap-device-1-768x768.jpg 768w, https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/wp-content\/uploads\/2026\/04\/mocap-device-1-1536x1536.jpg 1536w, https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/wp-content\/uploads\/2026\/04\/mocap-device-1-2048x2048.jpg 2048w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">Thanks to our fellow ETC student, Cheryl, for lending us her gears<\/figcaption><\/figure>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"1024\" src=\"https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/wp-content\/uploads\/2026\/04\/christina-in-mocap-gear-1-1024x1024.jpg\" alt=\"\" class=\"wp-image-317\" srcset=\"https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/wp-content\/uploads\/2026\/04\/christina-in-mocap-gear-1-1024x1024.jpg 1024w, https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/wp-content\/uploads\/2026\/04\/christina-in-mocap-gear-1-300x300.jpg 300w, https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/wp-content\/uploads\/2026\/04\/christina-in-mocap-gear-1-150x150.jpg 150w, https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/wp-content\/uploads\/2026\/04\/christina-in-mocap-gear-1-768x768.jpg 768w, https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/wp-content\/uploads\/2026\/04\/christina-in-mocap-gear-1-1536x1536.jpg 1536w, https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/wp-content\/uploads\/2026\/04\/christina-in-mocap-gear-1-2048x2048.jpg 2048w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">Christina in the motion-capture gears<\/figcaption><\/figure>\n<\/div>\n<\/div>\n\n\n\n<p>Alex then worked on remapping the motion capture data onto our character models. Once this process was completed, Hazel placed the animated characters into the snow environment, and added camera movements. Once we are confident in the scene, Hazel can begin creating additional camera angles and cuts to make the sequence more visually dynamic. <\/p>\n\n\n\n<p>During this process, however, Hazel experienced multiple Unreal Engine crashes, suggesting that the 3DGS environment file may be too large or otherwise difficult for Unreal to handle. Christina reached out to our SMEs, who advised that keeping the number of splats under 5 million should generally be safe. However, our current scene does not appear to exceed that threshold, making the exact cause of the crashes unclear.<\/p>\n\n\n\n<p>Earlier this week, Grace and Christina had already begun cleaning up several 3DGS scenes in an effort to reduce file size and improve Unreal performance. However, Hazel had already completed work in the current Hallway scene, so replacing its backdrop with a newly optimized 3DGS file would require redoing that work.<\/p>\n\n\n\n<p>For that reason, unless we encounter problems during rendering, we plan to keep the Hallway scene\u2019s current backdrop as-is. Moving forward, however, all new scenes will use the cleaned-up, smaller 3DGS files to reduce the likelihood of future crashes.<\/p>\n\n\n\n<p>Alivia continued developing the space scene, focusing primarily on keyframing the motion-captured characters within that environment.&nbsp;<\/p>\n\n\n\n<p>For scene transitions, Alex provided Grace with a morphing version of the supermarket environment, which Grace integrated into the supermarket scene in Unreal. This is helping us create the effect of the supermarket dissolving into the next world (the garden scene).&nbsp;<\/p>\n\n\n\n<p>Outside of production, Christina became interested in a video about Gaussian Splatting released by Corridor Crew on March 29, 2026. After watching the video, she reached out to our Subject Matter Experts for their thoughts. Dominic responded with several insights into possible applications of 3D Gaussian Splatting, particularly noting that the video did not discuss 3DGS\u2019s potential for training robots.&nbsp;<\/p>\n\n\n\n<p>This connected back to a conversation the team had during Playtest Day, when one group mentioned using 3DGS street captures to help train autonomous driving systems. Following up on this, Christina also reached out to Vivian Shen, an ETC professor specializing in robotics, to ask about 3DGS applications in robotics and to gather additional resources.&nbsp;<\/p>\n\n\n\n<p>Looking ahead, our top priorities for next week are:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Developing a system that allows the characters\u2019 brightness levels to change over time<\/li>\n\n\n\n<li>Continuing to build out scenes and camera movements in Unreal<\/li>\n\n\n\n<li>Nice to have: Expanding the snow scene with more shot variety<\/li>\n\n\n\n<li>Continuing to refine transitions between environments<\/li>\n<\/ul>\n\n\n\n<p>Here is our animatic as of April 3, 2026:<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-4-3 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Animatic as of April 3, 2026\" width=\"500\" height=\"375\" src=\"https:\/\/www.youtube.com\/embed\/nK74yfFjVw4?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p>3\/30-4\/3\/2026<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Our final music video\u2019s basic structure is now soft-locked. This week, we focused on placing and animating cameras and characters in Unreal Engine, then bringing those screen recordings into Premiere Pro to continue building out an animatic, which will help us better understand how the full piece is coming together.&nbsp; This week\u2019s major additions to [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-309","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/wp-json\/wp\/v2\/pages\/309","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/wp-json\/wp\/v2\/comments?post=309"}],"version-history":[{"count":2,"href":"https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/wp-json\/wp\/v2\/pages\/309\/revisions"}],"predecessor-version":[{"id":318,"href":"https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/wp-json\/wp\/v2\/pages\/309\/revisions\/318"}],"wp:attachment":[{"href":"https:\/\/projects.etc.cmu.edu\/dots-to-depth-studios\/wp-json\/wp\/v2\/media?parent=309"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}