Week 4 Blog

With the help of our Subject Matter Experts, Matt and Dom, we finally established the pipeline: from filming with Insta360 X5 cameras to a 3D model in PostShot.

Step 1: Filming

  • Holding the camera: the screen should always face you, and the camera on the opposite side should always face the object you want to film
    • For objects: Walk around the object in a complete circle
    • For environments: Walk around the room in a complete loop
  • Film three different angles: a mid angle, a high angle, and a low angle.
    • For the low angle, you can turn the camera upside-down to get a lower angle, just make sure the screen is still facing you and the camera is still facing the object.

Step 2: Insta360 Studio

To import footage to your computer

  • Insta360 Studio
    • Plug in the camera to your computer and open Insta360 Studio
    • Click on the video you want to export from your camera
    • On the right hand side, click the top Stabilization Type, toggle on FlowState Stabilization, and check Direction Lock. This way, when you preview the video, the object you filmed will always be in view.
    • Click Export on the top. Export as 360 Video, turn Bitrate all the way up, and Start Export.
    • Repeat these steps with your two other videos of different angles.

Step 3: Blender

To remap the 360-degree video to a sequence of images.

  • Install the 360 Extractor Blender plugin: Edit → preferences → add-ons → Add-on settings (on the right hand side, looks like a down arrow) → install from disk
    • If Blender updates, the plugin
  • Click Add Equirectangular Video and choose all three videos
    • Equirectangular is the standard way of “unwrapping” a sphere onto a flat, 2D rectangle. Think of it like a world map (Mercator projection). The Earth is a sphere, but to see the whole thing at once on a piece of paper, we stretch it into a rectangle.
  • Click on the High angle video, under Camera Setup, name it High, then click Create Camera Group. Repeat for the other two videos.
  • Toggle the camera view on.
  • Under Camera Setup, click on High, adjust the Height to 10, and Link the High video (important). Repeat for the low video and adjust height to -10. Mid can stay at 1.
  • Moving on to the right panel. Feel free to delete Camera, Cube, and Light.
  • In the Output tab, edit the Resolution X and Y to the desired numbers. We usually use a square of 1920×1920. You will see a square when you toggle on the camera view.
  • Under Scene Collection, click on all the cameras to check which ones have yourself in the square. Delete those cameras so they don’t confuse the algorithm later. Repeat for the other two angles.
  • Moving back to the Plugin window. Under Render Output, choose a folder location. Change the Frame Step to a desired number; you can check how many photos you will get by clicking on Render Selected Camera Groups. Ideally, you want 300-500 photos total. It’s recommended to not exceed 1000 photos. We usually use a Frame Step of 30-60, which means that for every 30-60 frames, 1 photo is extracted.
  • Click ok. There is no progress bar, so simply go to the folder you chose to find all three folders of photos gradually forming.

Step 4: RealityScan

To quickly align images, which is the process where a computer looks at your photos to figure out exactly where you were standing and which way you were pointing the camera for every single shot.

  • In the Workflow tab, import all three folders of photos.
  • In the Alignment tab, click Align Images. It usually takes only minutes to complete. This is also why we do this step in RealityScan instead of in PostShot, which is a lot slower at image alignment.
575 images from all three angles are aligned in the software RealityScan.
  • In the Workflow tab, click Export, and export two things:
    • Under Camera Alignment, click Internal/External Camera Parameters. The downloaded file should be a csv file (Excel file).
    • Under Sparse Scene Structures, click Sparse point cloud as Polygon File Format (*.ply). In the export parameter details, toggle Export ascii to False. The downloaded file should be a .ply file.

Step 5: PostShot

To create a 3D point cloud using Gaussian Splatting.

  • Import all three folders containing the photos, and the two files exported from RealityScan, into PostShot.
    • You should see that Import becomes an option in Camera Poses, because PostShot is now reading the csv and ply files.
  • There should be an Import Files pop-up.
    • For Image Selection: Use all images
    • For Radiance Field Profile, Splat3 is theoretically good for textures. Splat MCMC is theoretically good for polished surfaces.
  • The screen should show the Radiance Field changing (insert photo), and you will quickly see if the scan is successful or not.
  • File → Export scene radiance field → name-rad-field → save it in the shared folder (DotsToDepth)

Step 6: Unreal Engine

  • Window → Import 3D Gaussians
  • Content Drawer → Under the ThreeDGaussians folder, find the file you exported from PostShot, and drag it into the scene.

Fun Experimentation with Image Count

These are two different PostShot renderings of the same scene. There is a noticeable improvement in render quality when the image count is increased from 415 to 575. It remains to be seen if there will be diminishing returns if the image count is increased to 700-800.

Result from 415 images
Result from 575 images

February 2-6, 2026