System Architecture
The System architecture for this project is based off the above diagram. We have used scripts here for downloading pictures and videos and the major components here.
-
Mixed Reality Toolkit
The Mixed Reality Toolkit is super useful towards using prefabs and preliminary scenes to integrate into projects. Overall, the major utilities from MRToolkit used here are related to:-
- Speech to Text using Dictation
- Gestures and clicks on 3-D surfaces
- Spatial anchors to place objects
-
Unity
We add icons for the recipes, and provide a UI that's simple and intuitive towards interaction as mentioned in th e Design section. Also, we make sure that we have tags and instructions for every recipe as part of the database and we feed this to the frontend along with another items.
- Flow of items
An item is checked from our database, we use this for the following steps which involve parsing the database for the recipe or a different search strategy, and we use resources such as images and videos which are indexed to the name of the recipe in our objects list. This helps us get all required items for our application and the flow of information is detailed using the RECIPE-FRONTEND with queries between Unity and our C# code based on the same.