A downloadable game

Assignment 3 report

Introduction

An AR application that is designed to revolve around it being used in tandem with a textbook or the like to learn more about and show learning models in 3D for a better understanding of it.

Description of application

Interface Problem - Students may want to have a more interactive learning aid when they are going through their studies but as one might expect some specific learning aids are either harder to get than others, or just pointless in terms of scale.

For example, most organs are generally unobtainable by medical students, in addition, merely having a sample of a crystal in hand doesn't mean they can observe it down to a molecular level. Hence a solution in the form of an interactive AR application is conceived.

This application allows the user to have more ease of access to a more effective learning aid, allowing them to visualize the study material in question and obtaining a better understanding of it since they will be able to interact with "the real thing" right in front of their eyes through the lens something as common as a smartphone.

Interaction Design

The buttons that exist in the app serve to rotate the models in directions that are relevant, allowing the user to view the models from all sorts of angles, immersing themselves into a better headspace and understanding of the object of study at their own leisure.

A world space canvas was used to create the multiple buttons that exist on the different images that can be scanned to produce an image. Once clicked, the 3D model displayed will rotate in the direction that the button implies. To stop the rotation and change the direction of rotation, simply push any other button once and then the button associated with the desired direction of rotation, it could not be more simple.

Technical Development

it was previously mentioned that this application would be used on smart devices such as smartphones but for this specific version of the project, it is designed to be used on windows instead. as for any profound reasoning as to why...... there really isn't one, not one that's profound anyways. Simply speaking i just found it easier under my current circumstances to this with windows instead for the time being. Tragic I know.

Putting that aside, the basis of this application is made using Vuforia video tracking in unity to track specific image targets tot orientate the 3D models in relation to the camera and the image target's position.

The user would then be able to tap on the buttons that show up on their screens to interact with the 3D models.

Possible Problems with implementation & Project Appendix

Possible Problems with implementation:

- one of the main problems I can see with undergoing this project would be obtaining the specific 3D models needed which more often than not would require hiring someone to make them from scratch

- occlusion and possible stains on the textbooks could also cause it so that the image target is unable to be tracked by the camera

Project Appendix:

- an attempt was made to include a function where-in tapping a specified part of the model would show a small pop up window using a world canvas to give a description of the part in question, evidence of which is a random 3D collision box present on one part of the skeleton. Needless to say, the fact that this is being mentioned here means that it never got past development due to a simple lack of time.

- the 3 bunnies hopping around a giant sprout admittedly are of no educational importance whatsoever but instead serve to be more of a proof of concept that multiple 3D models can occupy the same image target and be interacted with all at once. The lack of buttons that let you control vertical rotations is also simply because I saw no purpose to include it.