PRODUCT: A social music experience for the Meta Portal TV launch.
ROLE: I promoted the creation of the AR Experiences Team, fully staffed with 4 designers, prototypers, PMs, an art team, and engineering. I led the conception, creative direction, and design of this brand-new AR experience to showcase the potential of Portal TV upon launch.
IMPACT: Due to the limitations of Spark AR, we developed Mic Drop using Unity for the first time on Portal. We proved that the processing power was sufficient for the call, smart camera, and an elaborated AR experience to run simultaneously with proper optimization. We launched in time for the Portal TV market release and got excellent reviews from the media and users. Initially, use got hindered by the limitation of working only between Portal TVs, which needed more critical mass.
An emotional journey
When designing with the team, I framed the AR music experience in emotional terms to help us think of what properties would make it more engaging and immersive. I introduced the concept of Alibi and Magic Circle for our immersive experiences:
The Interaction Alibi
The Interaction Alibi
“A rule, object, or change of state that allows a human to interact. This idea is central to designing for participation. An alibi might be a role, a rule, a narrative, a game, a mask, an instruction, or an introduction. An interaction alibi helps you understand what you’re expected to do, feel safe trying something new, and trust that the outcome will be worth your time.” source
It is the context built around an experience that gives permission and comfort for people to immerse and participate in an activity that requires behaviors different than the ones they would have in a regular setting.
The alibi helps create the Magic Circle (on the outside is the world, and on the inside is the game. And when players cross that threshold, the rules change, norms change, and people’s roles and behaviors change).
Here’s a mapping of the moments of the emotional journey and the UX elements that support/influence it:
Attention to detail
To create a feeling of immersion, attention to detail is essential. Low-quality or buggy AR can ruin the magic very fast.
And Mic Drop, despite being a relatively short UX flow, had many details to take care of. From the song catalog selection to the look of the singer’s character. From making you feel you are not in your living room to how to communicate your turn when people are in different locations. And sometimes there is more than one person on each side.
See below for examples of how we solved these challenges.
Well received by press media and Portal TV users
We launched in time for Portal TV market release and got excellent reviews from the media and users. Initially, use got hindered by the limitation of working only between Portal TVs, which needed more critical mass.
It takes a village
At the beginning of the project, I motivated different XFN teams spread out on diverse floors to move to a shared area in the building to improve communication and collaboration.
Before, we relied on chat and scheduled meetings to get in sync. After, we dramatically reduced the number of meetings and the communication ambiguity.
We had my design team, product manager, engineering team, art team, and prototypers integrated and much more productive. This change, deviating from the company’s practices, made it possible for us to achieve higher quality and meet the tight deadline.