Experiential Design: Project 2

12/11/2024 - 15/12/2024
Ng Zheng Kai 0359424
Bachelor of Design in Creative Media
Experiential Design
Project 2

---

INSTRUCTIONS

Project 2 progress:

In this task, we are going to create a MVP (Minimum Viable Product) prototype showcasing on what has been done and what yet to be done. 

Initially, I tried to use Polycam to 3D scan my laptop and upload it to Vuforia's Model Target Generator.

Fig 1.1 Polycam 3D scanned model of my laptop

But then, for some reason, Vuforia cannot accept my 3D scanned laptop.

Fig 1.2 Vuforia not accepting my 3D scanned model of my laptop

So for plan B, I browsed around the web to look for a 3D model of my laptop (Dell G3 3500) or something similar to my laptop. Luckily I found a model that is similar to my laptop in SketchFab.

Fig 1.3 3D model from SketchFab 

After downloading the model, I tried to upload it into Vuforia's Model Target Generator and it turned out to be accurate and it is able to recognize my laptop in Unity's AR camera.

Fig 1.4 I made sure to set it to "Non-realistic appearance to because the actual laptop looks slightly different than the 3D model

In the inspector menu for my model target, I turned on the guide view mode in order to have a highlighted version of the laptop in view when the camera is open so that the user can easily align the guide with the actual laptop.

Fig 1.5 Inspector menu for model target

Initial Testings:

For my initial testings, I want to make sure that Unity recognizes my laptop, and when it does recognized it, a cube and a sphere will appear to proof that it works.

Fig 1.6 Cube and Sphere test

The test was successful and I was glad it worked or else this project would all go down the drain ;) .

After that, I added a force field effect from Unity asset store for my laptop so that it would appear when Unity detects my laptop. I also added a UI sample from the Unity asset store to make it as buttons for my AR app.

Fig 1.7 Ultimate 10+ Shaders

Fig 1.8 UI Samples 

Fig 1.9 Force Field 

I added a button to see if it works if I press it via the AR camera and it works. In the video below, when the press the rectangle, if a cube appears, it means it's a success.

Fig 1.10 Button test success!

Final Prototype:

Fig 1.11 Final Prototype

Prototype Presentation :

Experiential Design Prototype Presentation by Ng Zheng Kai

Presentation Video

Fig 1.12 Presentation Video

Reflection:

This project has been both challenging and rewarding. Initially, I attempted to 3D scan my laptop with Polycam for Vuforia’s Model Target Generator, but Vuforia couldn’t accept the scanned model. Switching to plan B, I sourced a similar 3D model from SketchFab, which worked successfully after adjustments. This highlighted the importance of adaptability when facing technical challenges. Integrating the model into Unity and enabling features like guide view mode for user alignment were significant steps in enhancing usability. The successful testing phase, where Unity recognized the laptop and displayed objects like a cube and sphere, was a crucial milestone. Adding features like a force field effect and interactive buttons further refined the prototype. Overall, this project has enhanced my skills in AR development and problem-solving, while underscoring the importance of user-friendly design. I’m excited to continue refining this prototype.