UIUX Playtesting And Cloud Service Research
Playtest – Usability Test
Tester: 6 CMU Students age around 18-24
Place: Hunt Library
Test Goal:
- Evaluate testers’ Familiarity Level
- Assess the Suitability of SHAP-E
Result:
Shap-E doesn’t really work for us because the time it takes is too long to generate the models. Also, Shap_E doesn’t provide ways for users to customize the models. The model quality for Shap-E is not qualified.
Playtesting Results Affinity Clustering
Programmer – Cloud Service Research
Google Colab:
Colab is a hosted Jupyter Notebook service that requires no setup to use and provides free access to computing resources, including GPUs and TPUs. Colab is especially well suited to machine learning, data science, and education.
Amazon Web Services :
A comprehensive cloud platform offering a wide range of services, including computing power, storage, databases, machine learning, and more.
Microsoft Azure:
Microsoft’s cloud platform provides services for computing, analytics, storage, and networking. It is especially integrated with Microsoft products.
IBM Cloud:
Provides a range of cloud services, including IaaS, PaaS, and SaaS, with an emphasis on hybrid and multicloud solutions.
Research Result:
Google colab is perfect for our project because it is free!Anyone with a link would be able to generate models based on given prompts after a period of training (which should take around 1h-2h).
This is a showcase of how to run it on google colab, which doesn’t necessarily require a PC as it is ran on a cloud service.
And by running some extra scripting, it can generate output videos or the direct mesh of the model (together with its texture).
However, the model’s quality is still not good enough, and on the repo, the author mentioned that he will be working on updated in threestudio, so I will be working on exploring stable dreamfusion in threestudio afterwards.
Programmer – Progress update
We created the first version of the Java UI, and connected it to the Python script that used SHAP-E. We were also able to convert the SHAP-E model from PLY to DAE (Collada) and manually apply a texture to it. After that, we could successfully import it into Alice. This was necessary since only textured Collada models can be imported.
So, we were able to successfully create and import a model into Alice, but part of the process was still manual.
Model Generation Example:
Object: A WW2 tank
Texture: modern, clean, metallic
Object: a Japanese battle mech
Texture: Samurai outfit that fuses with Japanese batik style
Object: A monster mask
Texture: red fangs, Samurai outfit that fuses with Japanese batik style