Week 4

UIUX Playtesting And Cloud Service Research

PlaytestUsability Test

Tester: 6 CMU Students age around 18-24

Place: Hunt Library

Test Goal:

  • Evaluate testers’ Familiarity Level
  • Assess the Suitability of SHAP-E

Result:

Shap-E doesn’t really work for us because the time it takes is too long to generate the models. Also, Shap_E doesn’t provide ways for users to customize the models. The model quality for Shap-E is not qualified.

Playtesting Results Affinity Clustering

ProgrammerCloud Service Research

Google Colab:

Colab is a hosted Jupyter Notebook service that requires no setup to use and provides free access to computing resources, including GPUs and TPUs. Colab is especially well suited to machine learning, data science, and education.

Amazon Web Services :

A comprehensive cloud platform offering a wide range of services, including computing power, storage, databases, machine learning, and more.

Microsoft Azure:

Microsoft’s cloud platform provides services for computing, analytics, storage, and networking. It is especially integrated with Microsoft products.

IBM Cloud

Provides a range of cloud services, including IaaS, PaaS, and SaaS, with an emphasis on hybrid and multicloud solutions.

Research Result:

Google colab is perfect for our project because it is free!Anyone with a link would be able to generate models based on given prompts after a period of training (which should take around 1h-2h).

This is a showcase of how to run it on google colab, which doesn’t necessarily require a PC as it is ran on a cloud service.

And by running some extra scripting, it can generate output videos or the direct mesh of the model (together with its texture).

However, the model’s quality is still not good enough, and on the repo, the author mentioned that he will be working on updated in threestudio, so I will be working on exploring stable dreamfusion in threestudio afterwards.

Programmer – Progress update

We created the first version of the Java UI, and connected it to the Python script that used SHAP-E. We were also able to convert the SHAP-E model from PLY to DAE (Collada) and manually apply a texture to it. After that, we could successfully import it into Alice. This was necessary since only textured Collada models can be imported.
So, we were able to successfully create and import a model into Alice, but part of the process was still manual.

Model Generation Example:

Object: A WW2 tank

Texture: modern, clean, metallic

Object: a Japanese battle mech

Texture: Samurai outfit that fuses with Japanese batik style

 

Object: A monster mask

Texture: red fangs, Samurai outfit that fuses with Japanese batik style

       

Scroll to Top