ProblemSolutionResearchDefineDesignReflection

“Impact Student Data Dashboard”

A data visualization platform for middle-high school teachers to understand their students’ progress in 21st-century competencies, identify where their classes and individual students need the most assistance, and get practical recommendations for interventions.

My Role
As a UX designer, I contributed to the overall design process, including brainstorming viable ideas, drawing storyboards, user flows, wireframes, UI design, and iterations from Low-fi, Mid-fi, to High-fi prototyping.

Additionally, I conducted user research, facilitated user interviews and usability testings, and contributed to synthesizing research findings to define product scoping.
Team
Marc Levesque (Product Manager)
Yinru Sun (UX Designer)
Xinlu Gou (UX Researcher)
Cuiting Li (Developer)
Timeline
Jan. - Aug. 2022
(Capstone Project)

Design Process

Problem Discovery

Middle-high school teachers need a simple and efficient way to understand their students' competencies' situations, especially from the growth perspective, and make interventions to help every student succeed.

Solution

Easy Onboarding

Provides a simple tutorial to help first-time users
understand the dashboard's main functions

Class Competency
Growth Track

Show four main competencies line charts with the intervention tracking and analyzed recommendations

Interactive Competency
Distribution Chart

Show how each student is doing in class bypresenting their specific score, percentile ranking, growth rate

Individual Profile

Check individual students' situations and
hover to see detailed content.  
Communicate with other teachers by posting notes

Student Personalized Report

Streamline communication with students by exporting the
personalized report with the competency line chart,
situation summaries, and recommendations

Literature Review

The literature review set a strong foundation for us to understand the importance of focusing on students’ competencies in greater depth

The Center for Curriculum Redesign (CCR) had established 12 cross-cutting 21st-century competencies and wanted to build a dashboard that would help teachers go in depth to evaluate students' 21st competencies growth.

Competitive Analysis

The competitors had NO GROWTH aspect

Semi-Structured Interview

Teacher Interviewees attach much importance to students' growth

We conducted 4 semi-structured interviews with middle-high school teachers with years of teaching experience in various disciplines. We validated our findings and explored more about their values, their teaching struggles, and their challenges when using the other learning management systems.

Persona

John

32, Boston

Math Teacher in a school focused on
21st century competency

“Growth vs achievement, growth wins out!”

Jimmy has been in a 21st-century competency-based school for 2 years. He is required to use the dashboard to understand his students' math competencies' growth and performance.

How Might We

Help teachers to understand students' competencies growth and provide a multi-tiered system of support from the class to the individual

Based on these reframed design opportunities, we drew 14 storyboards in 5 categories and defined 21 initial feature sets.

Feature Prioritization

Co-design with 6 teachers and prioritize dashboard features based on impact and effort

We conducted individual interviews with 6 teachers to collect their feedback about the storyboards and invite them to participate in the co-design activity to prioritize the features. The co-design results were organized and analyzed using the matrix. We first decided to focus on features with high impact and low effort. Then, we realized that the features with high effort and high impact are also worth designing because the learning science professors had very positive attitudes towards them.

User Flow

Organize features and map key user paths into an efficient and clear dashboard structure

Teachers can jump to the individual profile by clicking the student's name when browsing the student's situation in the class overview. They can also view the profile interface directly if they want to view a specific student's status.

Wireframes

50+ wireframes for a more suitable data visualization method

We first defined the data and context based on the user flow. Then, we conceptualized the possible data visualizations and interactions, tested with the target users, and got feedback from the data visualization professors to create more intuitive charts and navigation that support teachers.

Design System

Simple but memorable style with the WCAG 2.0 AA Level Standards in accessibility

The deep blue shades dominating the color palette provide a sense of cleanness, elegance, and technology. The colors of buttons and clickable icons work harmonically with the charts. The semibold heading styles and regular body styles present clear visual comparisons to ensure readability. The TT commons typeface plays well into the neutral feel of the dashboard.

Iterations

3 major improvements iterated from 2-round usability testing interviews with 10 teachers over 8 weeks

We conducted 2 rounds of usability testing with 10 teachers and 2 UX designers, using the think-aloud method to evaluate the key interactions in our design. In the testing, we provided testers with 5 task scenarios, observed their behaviors, and told whether they could draw informed conclusions from the data. We iterated the design based on the analysis of their feedback.

The Final Product

Class Overview

Individual Overview

Demo Video

Impact

Significant improvement in the usability from Mid-fi to High-fi

Improvements to the dashboard are accumulated through iterations of user feedback. The System Usability Scale (SUS) surveys were utilized to scientifically evaluate the usability of our product. We saw great results coming through the dashboard and impacting the client.

74

out of 100 in the Mid-Fi SUS: Good Score based on the
SUS criteria

84

out of 100 in the High-Fi SUS: Excellent Score based on the
SUS criteria

100%

task completion rate of all 5 scenario-based tasks on
High-Fi prototype

Project Takeaways

User-centered design to build the dashboard the users will actually use

  1. Always test with the target users. One of the essential things when designing a dashboard is to present the correct data in the right way instead of making the fanciest graphs. The most useful charts were the simple and normal ones that could solve the problems the teachers were facing.
  2. Question first, not data. We found the product’s direction by starting with the questions the dashboard needed to answer. A list of actionable questions, such as: "how do teachers tell whether students need help?", "what challenges do teachers face in their competency teaching?", "how do teachers make interventions on students?" point us to the solution.
  3. Provide scaffolding to the dashboard users. Be aware of the learning cost when the novice uses a new dashboard. It is necessary to provide support and scaffolding from intuitive design. We explored many ways to help users with this problem, such as tutorials, visualization toolkits, hovering explanations, and presentative color codings.