Weekly Overview

This week, we finalized our production plans for the semester and successfully completed our first pipeline shooting test. We made significant progress by finishing some of our hero assets and addressing key technical issues with nDisplay. Additionally, we locked in the concept designs for both our environment and character. During the test, we experimented with a new solution for synchronized shooting, and the resulting sample shots exceeded our expectations. This success has boosted our confidence as we continue developing assets and resolving the remaining technical challenges with nDisplay.

Shooting Test

Semester Goal

A Starter Unreal Virtual Production Package for CMU ETC

Overview 

This package provides a comprehensive Unreal Virtual Production (VP) setup designed for the CMU Entertainment Technology Center (ETC). It includes configurations for N-display, virtual cameras, motion capture, working scenario demos, and a curated asset package and documentations.

Goal 

To establish a foundational VP pipeline and studio environment at ETC, enabling future projects and students to leverage this setup for their work and electives related to virtual production. The package is designed for incremental updates to incorporate emerging technologies over time.

Package Contents

  • 1 Sample Level: A level featuring essential assets for virtual production.
  • 2 Technical Pipeline
    • N-Display Configuration(ICVFX): Setups for various devices (e.g., Cavern, 4K TV).
    • Motion Capture Setup(MOCAP): Configurations utilizing MetaHuman for realistic character animation.
  • 3 Camera Sequences: Demonstrations showcasing the functionality of the aforementioned technologies. ICVFX clip, Mocap, and game cutscenes. 
  • 1 Documentation: Comprehensive guides detailing package usage and technology setup.

Rationale 

As the first VP studio at ETC, our objective is to lay the groundwork for future students to create virtual production projects. While our technology may not match industry standards, we aim to build a pipeline that mirrors industry practices and is adaptable for future advancements. By providing working demo clips and a sample scene, we intend to validate the effectiveness of our pipeline in producing high-quality VP projects. 

Theme

Alice in Wonderland

Assets Progress

The asset creation process has been smooth and on schedule. We decided to pursue a stylized Alice in Wonderland theme, as we believe its whimsical tone and aesthetic serve as the perfect bridge between the virtual and real worlds. The story’s diverse elements and characters also provide us with the opportunity to experiment with scale and explore more unconventional forms of virtual production.

N Display Pipeline

In terms of technical setup, we’ve configured the TV for the nDisplay pipeline. While we successfully completed a shooting test, we are still facing issues with the server and signal transmission between the Switchboard and Unreal Engine. Resolving this problem is a priority since it aligns with industry standards and best practices. However, the good news is that we have an alternative solution in place for shooting, should we be unable to fix the issue. Ultimately, we are committed to ensuring that this project results in a fully executable template for the virtual production pipeline.

Meta Human