NASA SUITS UX Challenge

Industry

Space

Design Category

Interface UX Design

Timeline

Sep 2023 - May 2024

Team

20 Designers + Engineers

Main Project Image
Main Project Image
Main Project Image
Main Project Image

Background

Since humanity’s first steps on Mars, we have been uncovering the planet’s secrets and pushing the boundaries of exploration. However, with each new discovery comes immense challenges, as astronauts navigate the harsh and unpredictable Martian environment. In 2023-2024, I participated in the NASA SUITS competition to design an AR experience that enhances astronaut safety and efficiency during extraterrestrial missions—an innovation that could one day support future explorers on Mars.

Since humanity’s first steps on Mars, we have been uncovering the planet’s secrets and pushing the boundaries of exploration. However, with each new discovery comes immense challenges, as astronauts navigate the harsh and unpredictable Martian environment. In 2023-2024, I participated in the NASA SUITS competition to design an AR experience that enhances astronaut safety and efficiency during extraterrestrial missions—an innovation that could one day support future explorers on Mars.

Problem

How might we create a seamless experience for completing critical mission tasks despite harsh environmental and physical constraints?

During their every quest, the astronauts need to complete these 4 following tasks under the high-stakes condition on Mars:

Mission Preperation

Astronauts will go through a series of checklists to prepare for their mission

Mission Preperation

Astronauts will go through a series of checklists to prepare for their mission

Mission Preperation

Astronauts will go through a series of checklists to prepare for their mission

Mission Preperation

Astronauts will go through a series of checklists to prepare for their mission

Travel to Point A and Return Home

Astronauts will navigate to points of interests and return back to spacecraft.

Travel to Point A and Return Home

Astronauts will navigate to points of interests and return back to spacecraft.

Travel to Point A and Return Home

Astronauts will navigate to points of interests and return back to spacecraft.

Travel to Point A and Return Home

Astronauts will navigate to points of interests and return back to spacecraft.

Rover remote control

Drive the Perserverance Rover on Mars.

Rover remote control

Drive the Perserverance Rover on Mars.

Rover remote control

Drive the Perserverance Rover on Mars.

Rover remote control

Drive the Perserverance Rover on Mars.

Document geological samples

At geological sites, astronauts will scan rocks, capture images, and document Martian samples.

Document geological samples

At geological sites, astronauts will scan rocks, capture images, and document Martian samples.

Document geological samples

At geological sites, astronauts will scan rocks, capture images, and document Martian samples.

Document geological samples

At geological sites, astronauts will scan rocks, capture images, and document Martian samples.

Solution

Creating an AR experience that reduces cognitive load to support Martian mission tasks, along with a web interface that assists astronaut operations with efficiency and safety.

The solution for the project is to leverage Augmented Reality provided by Microsoft HoloLens to offer alerts, provide task instructions, and alleviate burdensome tasks for astronauts as they complete missions.

The solution for the project is to leverage Augmented Reality provided by Microsoft HoloLens to offer alerts, provide task instructions, and alleviate burdensome tasks for astronauts as they complete missions.

01

AR Guided Mission Completion

Procedural System

01

AR Guided Mission Completion

Procedural System

01

AR Guided Mission Completion

Procedural System

02

AR Guided Mission Completion

Procedural System

02

Local Mission Control Console

Dual-monitor web interface

02

Local Mission Control Console

Dual-monitor web interface

02

Local Mission Control Console

Dual-monitor web interface

02

Local Mission Control Console

Dual-monitor web interface

DISCOVER AND DEFINE

Understand our users' painpoints

We conducted interviews with three key subgroups: astronauts, field geologists, and augmented reality specialists. From our findings, we identified common themes and highlighted four main pain points. These insights will guide our approach to design moving forward

James H. Newman

Former NASA Astronaut

James H. Newman

Former NASA Astronaut

James H. Newman

Former NASA Astronaut

James H. Newman

Former NASA Astronaut

Steve Swanson

Retired NASA Astronaut

Steve Swanson

Retired NASA Astronaut

Steve Swanson

Retired NASA Astronaut

Steve Swanson

Retired NASA Astronaut

Jim Head

Geological Sciences

Jim Head

Geological Sciences

Jim Head

Geological Sciences

Jim Head

Geological Sciences

James Russell

Planetary Sciences

James Russell

Planetary Sciences

James Russell

Planetary Sciences

James Russell

Planetary Sciences

Jonathan Levy

Cartographer

Jonathan Levy

Cartographer

Jonathan Levy

Cartographer

Jonathan Levy

Cartographer

Alejandro Romero

VR/UX specialist

Alejandro Romero

VR/UX specialist

Alejandro Romero

VR/UX specialist

Alejandro Romero

VR/UX specialist

Isabel Torron

UX Designer

Isabel Torron

UX Designer

Isabel Torron

UX Designer

Isabel Torron

UX Designer

Peter H. Schultz

Geological Sciences

Peter H. Schultz

Geological Sciences

Peter H. Schultz

Geological Sciences

Peter H. Schultz

Geological Sciences

Technology and parameters research with user interviews

Takeaways from previous product usability testing and field tests

Research key insights

Cognitive Overload

Stronauts easily feel overwhelmed with the high volume of complex tasks, information, and decisions they must manage in extreme conditions.

Cognitive Overload

Stronauts easily feel overwhelmed with the high volume of complex tasks, information, and decisions they must manage in extreme conditions.

Cognitive Overload

Stronauts easily feel overwhelmed with the high volume of complex tasks, information, and decisions they must manage in extreme conditions.

Cognitive Overload

Stronauts easily feel overwhelmed with the high volume of complex tasks, information, and decisions they must manage in extreme conditions.

Restricted Locomotion

The bulky space suit and the low-gravity environment on Mars hinder astronauts' mobility and task performance.

Restricted Locomotion

The bulky space suit and the low-gravity environment on Mars hinder astronauts' mobility and task performance.

Restricted Locomotion

The bulky space suit and the low-gravity environment on Mars hinder astronauts' mobility and task performance.

Restricted Locomotion

The bulky space suit and the low-gravity environment on Mars hinder astronauts' mobility and task performance.

Limited Field of View

Current headsets have small viewports, which makes precise tasks like texting difficult for astronauts.

Limited Field of View

Current headsets have small viewports, which makes precise tasks like texting difficult for astronauts.

Limited Field of View

Current headsets have small viewports, which makes precise tasks like texting difficult for astronauts.

Limited Field of View

Current headsets have small viewports, which makes precise tasks like texting difficult for astronauts.

Core Design Tenants

From our extensive secondary and primary research, we have identified common themes and pinpointed the following design tenants that will guide our designs.

Centralizing Critical Information

Enables astronauts to quickly access information, stay focused on tasks, and respond efficiently to hazards or mission updates.

Centralizing Critical Information

Enables astronauts to quickly access information, stay focused on tasks, and respond efficiently to hazards or mission updates.

Centralizing Critical Information

Enables astronauts to quickly access information, stay focused on tasks, and respond efficiently to hazards or mission updates.

Centralizing Critical Information

Enables astronauts to quickly access information, stay focused on tasks, and respond efficiently to hazards or mission updates.

Interface Visibility

The interface must use high-contrast colors and clear visual hierarchy to stand out against the suit's reflective surfaces and Mars’ pigment.

Interface Visibility

The interface must use high-contrast colors and clear visual hierarchy to stand out against the suit's reflective surfaces and Mars’ pigment.

Interface Visibility

The interface must use high-contrast colors and clear visual hierarchy to stand out against the suit's reflective surfaces and Mars’ pigment.

Interface Visibility

The interface must use high-contrast colors and clear visual hierarchy to stand out against the suit's reflective surfaces and Mars’ pigment.

Less is more

The focus is on presenting essential information in a simplified format allows astronauts to quickly absorb critical data at a glance.

Less is more

The focus is on presenting essential information in a simplified format allows astronauts to quickly absorb critical data at a glance.

Less is more

The focus is on presenting essential information in a simplified format allows astronauts to quickly absorb critical data at a glance.

Less is more

The focus is on presenting essential information in a simplified format allows astronauts to quickly absorb critical data at a glance.

MY ROLE

LMCC Web Interface Designer

Due to the extensive scope of tasks, the design team decided to divide responsibilities to ensure efficiency and focus. I was assigned the task of designing for the Local Mission Control console web interface. Some key areas I was in charge of include:

Information Architecture

Led the design of the file management system in the LMCC interface, centralizing critical information and reducing task completion time by 40% through improved information architecture and intuitive navigation.

Information Architecture

Led the design of the file management system in the LMCC interface, centralizing critical information and reducing task completion time by 40% through improved information architecture and intuitive navigation.

Information Architecture

Led the design of the file management system in the LMCC interface, centralizing critical information and reducing task completion time by 40% through improved information architecture and intuitive navigation.

Information Architecture

Led the design of the file management system in the LMCC interface, centralizing critical information and reducing task completion time by 40% through improved information architecture and intuitive navigation.

Interface Aesthetics & Design System

Aided in the creation of a cohesive and appealing design system informed by research, integrating data-driven decisions on color, typography, 3D assets, and other visual elements.

Interface Aesthetics & Design System

Aided in the creation of a cohesive and appealing design system informed by research, integrating data-driven decisions on color, typography, 3D assets, and other visual elements.

Interface Aesthetics & Design System

Aided in the creation of a cohesive and appealing design system informed by research, integrating data-driven decisions on color, typography, 3D assets, and other visual elements.

Interface Aesthetics & Design System

Aided in the creation of a cohesive and appealing design system informed by research, integrating data-driven decisions on color, typography, 3D assets, and other visual elements.

Development Integration and Adaptibility

Collaborated closely with development teams to ensure seamless integration of the design system into Unity Engine and web development softwares, ensuring adaptability and smooth functionality across various platforms.

Development Integration and Adaptibility

Collaborated closely with development teams to ensure seamless integration of the design system into Unity Engine and web development softwares, ensuring adaptability and smooth functionality across various platforms.

Development Integration and Adaptibility

Collaborated closely with development teams to ensure seamless integration of the design system into Unity Engine and web development softwares, ensuring adaptability and smooth functionality across various platforms.

Development Integration and Adaptibility

Collaborated closely with development teams to ensure seamless integration of the design system into Unity Engine and web development softwares, ensuring adaptability and smooth functionality across various platforms.

LMCC DESIGN

User Flow Chart

The user flow for the Local Mission Control Console (LMCC) encompasses all the key components required to efficiently manage and monitor the mission. Each section of the interface is designed to support a specific aspect of mission control, ensuring smooth operations and quick decision-making.

Storyboarding sketches and ideas

After identifying key pain points and user flows, the teams held a rapid brainstorming session. During this session, we developed concept sketches to address each pain point.

White paper write up

After identifying key pain points and user flows, the teams held a rapid brainstorming session. During this session, we developed concept sketches to address each pain point.

Rapid low-fidelity design sprints and iterations within tight timelines

Given the time constraints, we conducted design sprints to create low-fi mockups and gather quick feedback from professionals and colleagues who were around us. This approach enabled us to identify features for iteration rapidly without getting too deep into design details and bubbled-up debates. Key insigths from the usability tests and iterative designs resulted in the following changes:

ITERATE AND TEST

Iterative User Testing

After mocking up our first clickable prototype, we tested them with RISD faculty and students by having them walk through our system. We asked them to "think out loud" during the process, which gave us valuable insights, though we did have to step in and skip a few tasks when participants struggled to understand the simulation. This experience really highlighted the importance of a proper briefing — we learned that it's crucial to provide clear instructions so users don’t go into the experience unprepared

Some key questions we asked:

Some key questions we asked:

CONFLICT

Bridging the gap between design and development teams

Due to the iterative nature of the project, the design team updated multiple prototypes, each evolving based on user feedback and testing. However, as the iterations progressed, the prototypes began to become increasingly disorganized, with changes often made in isolation without alignment between teams. This led to inconsistencies when transitioning from design into development, making it more challenging for the development team to understand and implement the prototypes.

CONFLICT RESOLUTION

Aligning key features for development

To ensure smooth collaboration between design and development teams, we implemented a version-controlled documentation system. This system included clear labeling of design decisions, direction changes, dates, and team members' names, ensuring that all modifications and updates were well-documented and easily traceable.

DESIGN SYSTEM

Building on top of 2023’s design system, we revised and specified it into multiple subcategories to enhance detail orientation and accessibility, addressing the increased volume of tasks. Notably, the LMCC team developed our own interface and icon system that adapted to the dual monitor interface while ensuring a unified design language with the AR displays.

FINAL DESIGN

Below is an embedded interactive prototype of the LMCC that you are welcome to navigate through.

IMPACT

National Finalist

We were honored to be invited as finalists to NASA headquarters, Johnson Space Center in Houston, TX to conduct usability testing and present our work to NASA evaluators and scientists.

National Finalist

We were honored to be invited as finalists to NASA headquarters, Johnson Space Center in Houston, TX to conduct usability testing and present our work to NASA evaluators and scientists.

National Finalist

We were honored to be invited as finalists to NASA headquarters, Johnson Space Center in Houston, TX to conduct usability testing and present our work to NASA evaluators and scientists.

National Finalist

We were honored to be invited as finalists to NASA headquarters, Johnson Space Center in Houston, TX to conduct usability testing and present our work to NASA evaluators and scientists.

Launched Project

We successfully developed a tool that allowed our end users to navigate and collect geological samples with efficiency, accuracy, and safety.

Launched Project

We successfully developed a tool that allowed our end users to navigate and collect geological samples with efficiency, accuracy, and safety.

Launched Project

We successfully developed a tool that allowed our end users to navigate and collect geological samples with efficiency, accuracy, and safety.

Launched Project

We successfully developed a tool that allowed our end users to navigate and collect geological samples with efficiency, accuracy, and safety.

RETROSPECTIVE

My key learnings

Reflection 1

Cross-Team Collaboration

Effective teamwork requires understanding diverse perspectives and clear communication to prevent misunderstandings and ensure smooth collaboration.

Reflection 1

Cross-Team Collaboration

Effective teamwork requires understanding diverse perspectives and clear communication to prevent misunderstandings and ensure smooth collaboration.

Reflection 1

Cross-Team Collaboration

Effective teamwork requires understanding diverse perspectives and clear communication to prevent misunderstandings and ensure smooth collaboration.

Reflection 1

Cross-Team Collaboration

Effective teamwork requires understanding diverse perspectives and clear communication to prevent misunderstandings and ensure smooth collaboration.

Reflection 2

Empirical Evidence and Research

An iterative mindset fosters diverse ideas, but using empirical evidence and objective testing is crucial for effective decision-making and team consensus.

Reflection 2

Empirical Evidence and Research

An iterative mindset fosters diverse ideas, but using empirical evidence and objective testing is crucial for effective decision-making and team consensus.

Reflection 2

Empirical Evidence and Research

An iterative mindset fosters diverse ideas, but using empirical evidence and objective testing is crucial for effective decision-making and team consensus.

Reflection 2

Empirical Evidence and Research

An iterative mindset fosters diverse ideas, but using empirical evidence and objective testing is crucial for effective decision-making and team consensus.

Reflection 3

Multiple Tight Deadlines

Design sprints became a powerful way to bring our team together, allowing us to rapidly iterate, align our ideas, and make decisive progress without getting stuck in endless debate

Reflection 3

Multiple Tight Deadlines

Design sprints became a powerful way to bring our team together, allowing us to rapidly iterate, align our ideas, and make decisive progress without getting stuck in endless debate

Reflection 3

Multiple Tight Deadlines

Design sprints became a powerful way to bring our team together, allowing us to rapidly iterate, align our ideas, and make decisive progress without getting stuck in endless debate

Reflection 3

Multiple Tight Deadlines

Design sprints became a powerful way to bring our team together, allowing us to rapidly iterate, align our ideas, and make decisive progress without getting stuck in endless debate