{"id":75,"date":"2025-02-08T20:58:48","date_gmt":"2025-02-08T20:58:48","guid":{"rendered":"https:\/\/projects.etc.cmu.edu\/colleido\/?p=75"},"modified":"2025-04-10T22:10:12","modified_gmt":"2025-04-10T22:10:12","slug":"week-5","status":"publish","type":"post","link":"https:\/\/projects.etc.cmu.edu\/colleido\/week-5\/","title":{"rendered":"Week 5"},"content":{"rendered":"\n
\n
\n

Character<\/strong> &<\/strong> Mocap<\/strong><\/h2>\n\n\n\n

As we have one of our own characters’ base models being fully rigged and modeled through UE5’s metahuman, we were able to use our own model to test out the draft mocap pipeline that we lay out in the previous week through free online models.<\/p>\n\n\n\n

draft mocap pipeline: MotionBuilder (clean and retarget mocap data) ->Maya (edit animation) ->UE5\uff08render animation).<\/p>\n\n\n\n

Metahuman is an official functionality of UE5, its rig controls works well on UE5, and it would not be possible of exporting the rig controls to Maya. <\/p>\n\n\n\n

In addition, we found out that the Maya also has basic mocap functionality same as the Motion Builder, and it is sufficient of the level of complexity that we need.<\/p>\n\n\n\n

As a result, we modify and finalized our mocap pipeline.<\/p>\n\n\n\n

finalized mocap pipeline: UE5(character rigged and modeling, export skeleton) -> Maya (clean and retarget mocap data) ->UE5\uff08edit and render animation).<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n

<\/p>\n\n\n\n

Shader<\/strong><\/h2>\n\n\n\n

This week, we developed the oil painting and glitch shaders, which could be used for the ADHD perspective.<\/p>\n\n\n\n

For the oil painting shader, she explored the Houdini to Unreal pipeline for importing digital assets. She added brush pieces in Houdini using a geometry node (e.g., the duck model, which can be replaced with any model in Unreal) and applied a toon shader in Unreal. The oil painting style can be adjusted by modifying the brush shape, as well as the number and size range of the brush pieces in Unreal.<\/p>\n\n\n\n

For the glitch shader, she adapted it to resemble the style from Spider-Man: Across the Spider-Verse<\/em>. Attached is a GIF showcasing the shader. The glitch speed, overlay texture, and piece shapes can be adjusted later.<\/p>\n\n\n\n

\n
\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n<\/figure>\n\n\n\n

<\/p>\n\n\n\n

Storyboards<\/strong><\/h2>\n\n\n\n

The dialogue has been created, and the boards of four versions are matched in a form. As the full story is done, the gap between each important events has been filled. The story now has its continuity. <\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

The storyboards for international and ADHD perspectives had been polished. We had another meeting with our advisor Ayana and got advise from her about First-gen perspective. The introvert version is in progress and about to finish, the First-gen version will be finished next week.<\/p>\n\n\n\n

<\/h2>\n\n\n\n

AI tools for 3D Assets<\/strong><\/h2>\n\n\n\n

We want to have some of our models made by AI to improve efficiency. We explored different 3D AI tools to generate 3D assets for environment. We have decided to use Midjourney and Meshy among all the tools explored. Licenses are being applied.<\/p>\n\n\n\n

The wireframe and UV of the AI generated assets are usable but need to be cleaned up, the textures and materials are not very satisfying and will be fixed or remade by ourselves.<\/p>\n\n\n\n

3D Asset pipeline: Midjourney (Prompt to image)\/Meshy(Prompt to image)\u2192Meshy (Image to model)\u2192Maya\/Blender (Clean up wireframes and UVs)\u2192Substance Painter (Fix and remake textures and materials)\u2192UE (Environment)<\/p>\n\n\n\n

<\/p>\n\n\n\n

\n
\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n<\/figure>\n\n\n\n
\n
\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n<\/figure>\n\n\n\n

<\/p>\n\n\n\n

Website<\/strong><\/h2>\n\n\n\n

The Colleido website has been set up.<\/p>\n\n\n\n

<\/p>\n\n\n\n

Cinematography<\/strong><\/h2>\n\n\n\n

We continued working on the international student camera shots.<\/p>\n\n\n\n

\n
\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n<\/figure>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

Character & Mocap As we have one of our own characters’ base models being fully rigged and modeled through UE5’s metahuman, we were able to use our own model to test out the draft mocap pipeline that we lay out in the previous week through free online models. draft mocap pipeline: MotionBuilder (clean and retarget […]<\/p>\n","protected":false},"author":4,"featured_media":314,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[],"class_list":["post-75","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-blogs"],"_links":{"self":[{"href":"https:\/\/projects.etc.cmu.edu\/colleido\/wp-json\/wp\/v2\/posts\/75","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/projects.etc.cmu.edu\/colleido\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/projects.etc.cmu.edu\/colleido\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/colleido\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/colleido\/wp-json\/wp\/v2\/comments?post=75"}],"version-history":[{"count":18,"href":"https:\/\/projects.etc.cmu.edu\/colleido\/wp-json\/wp\/v2\/posts\/75\/revisions"}],"predecessor-version":[{"id":588,"href":"https:\/\/projects.etc.cmu.edu\/colleido\/wp-json\/wp\/v2\/posts\/75\/revisions\/588"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/colleido\/wp-json\/wp\/v2\/media\/314"}],"wp:attachment":[{"href":"https:\/\/projects.etc.cmu.edu\/colleido\/wp-json\/wp\/v2\/media?parent=75"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/colleido\/wp-json\/wp\/v2\/categories?post=75"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/projects.etc.cmu.edu\/colleido\/wp-json\/wp\/v2\/tags?post=75"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}