Playing with objects and compositions on AR, using different elements that have to be placed in space so that they remain user-friendly: for example, semi-transparent floor and walls that let see still what is happening in the real world.

Background information and knowledge

So apart from being curious and asking a lot, what would help in this process maybe more as a hard skill would be to start to get confident with spatial design. Design something in 3D, even something simple, or draw some sketches in scale, try to learn about perspective and isometry.

I personally have a background in architecture which has been very helpful not only in the special feeling that is necessary for AR but also for lighting, materials, standard measures, and all other parts of design like proportions, compositions, etc.

Approaches and methods: same as 2D UX/UI?

Hey, wait! Not everything is about 3D? No! There’s still our good old 2D Interface, which we should not forget because this has also different functions and purposes than the 3D UI. Our user that is used to 2D UI should still be available to manage our App without a manual or an architect’s degree 😉

For this, is important to observe through tests what your users are doing when presenting a prototype. Is their first reaction when placing a 3D Object in space to try and grab it (as in real life) or do they actually use some of the 2D interfaces to manipulate it?

Patterns, patterns, patterns …

Some people would say (me too) that just using patterns kills the innovation, but for the first tests is not a bad idea to take good examples from existing gestures. And I don’t mean necessarily with this getting ideas just from apps that do exactly the same (because this is in our case also very difficult), but taking inspiration also from real life or analogue interfaces, like for example, how we actually move the pieces of a puzzle with our hands, or how do we grab things when cooking, etc.

So go and make a good mood board of good inspirations.

Analyzing the movement of the wrist while holding a Pineapple. Credit: Martin Sanchez (Unsplash)

For Prototyping something there are more than one options as always:

• Paper prototypes: this I would recommend just for the first phase of ideating since it goes very fast and lets you experiment rapidly with more ideas.
• Digital wireframes and mockups: for this, you would need as many tools and approaches that you can use. Yes, it’s somehow sad that there is still not a tool that can do everything, but this is why communication in the team is very important and a motivated team that wants to test things before talking about it for eternity.

Tools

Here I leave you a list of the actual tools that I use and for what:

• Photoshop: for visuals.
• Figma: for creating 2D graphic assets and UI.
• Adobe Aero: for testing visibility, size, animations and some usability.
• After Effects + Lottiflies: For microinteractions and general animations.
• Zaubar App: our own app we already have in which we can test also positioning of objects and presentation through several scenes.

Testing one component of the office tour in my living room with Adobe Aero, it feels almost as it was there!

Testing

It is very important to test when you don’t have that much experience and also when you have it to see how your design works with the environment: obstacles, light, people around. 

Also test in on real people, in our own team every week and also with real clients (tour guides) that are working with us in our beta version.

If possible try to test always with as real cases and real people as you can get, since this will throw the best and juiciest information back always.

Me and our co-founder Anne-Sophie and Tour-Guide Frank-in-Cisco for some testing on site.

Learnings

I have been very lucky to have some experiences already that still not a lot of people have, so I have learned some things that maybe you will find useful or interesting:

• Make the UI as simple as possible that a child could use it.
• Test, test, test, and when possible in real cases with real people.
• Make something in AR just when it has some value.
• Use patterns until you feel you can tweak them for your own designs.