Audie

Interactive Audience Response System

My Role: Visual design, animation

Tools Used: Figma, Principle, After Effects

Project Type: solo project

Project Overview: A digital twin that extracts the biometric data tied to specific moments of the film and helps the filmmakers to accurately identify the physical effects of the entire cinematic experience.

Understanding the problem

Over 80% of movies fail to turn a profit. This means for every 10 movies, 7 would lose money, 2 would cover their cost and only 1 would pay for everything. The unpredictability needs to be addressed. Listed below are the key problems observed after my brief research.

Critic Reviews

Critics are out of touch with the audience and rate films in black comedies and documentaries more highly than the regular audience would.

Global Audiences

Different people have unexpected reactions to certain scenes, therefore gain more insights into the target audience’s perception is necessary.

Missing Insights

Hard for the movie makers to identify potential high points of the movie and the low points which need improvement.

Conceptualizing the interactive experience

Audie allows users to have an interactive touch experience. The user can select from the list of movies and view insights about each with respect to micro expressions, heart rate, and brain activity.

Audie gives away the necessary biometric information required to the movie makers for them to get an overall analysis.

The analysis can improve their movies to gain a better understanding of their audience's preferences. Audie also analyzes the index of particular demographics and calculates the popularity of a particular scene/ sequence.

How would that happen though?

Hey there, this is the default text for a new paragraph. Feel free to edit this paragraph by clicking on the yellow edit icon. After you are done just click on the yellow checkmark button on the top right. Have Fun!

Observing brain activity

Some films tend to "sync up" brain regions across all viewers through action or suspense scenes. Tracking vertical and horizontal eye movements with structures and unstructured spots. A small screen or on a large screen may elicit different responses.

Detecting micro expressions

Detecting expressions can provide cues to semantically meaningful occurrences, such as jokes or topic changes. Detection of changes depending on age, laughing rate, or points. An algorithm known as FVAEs breaks a person's face down into 68 different "landmarks" featuring different degrees of expressions. Any jokes that less than half the audience laughs at can be dropped.

Measuring heart activity

Wearable devices can measure heart rate, pulse, skin temperature, electrodermal activity, and motion. It can help us calculate the number of fight-or-flight responses in the entire movie divided scene wise. Similarly, track the number of heart-pounding moments.

Heart-Pounding Moments

A digital watch worn by the audience will track heart rate in real-time and send the collected sensor data to the Audie framework. This was the heart activity can be tracked and monitored.

Sketching & Ideation

Ideated how statistical data should be represented which includes live tracking, data prediction and the comparison of results. Considered how the different sections of biometric data should be represented, and how the design system should tie together across the platform.

Mood & Style

The mood and style I was aiming for were futuristic and dreamy. The cinematic experience is constantly evolving and the futuristic style fits perfectly with my brief.

Video Snippets

Conclusion and Takeaways

The more you know and understand the background and needs of your audience, the better you can prepare your content. Audience power could shape the future of movie-making. Keeping the narrative in mind, I designed for a large interface that would facilitate the moviemakers to interact with it and view insights in their think tanks or conference rooms ideally.

Open to work, get in touch! senjalp30@gmail.com