Project
Increasing User-friendliness of Institutional Dashboards for Equity Gap Insights
Description
This project improves decision-making by increasing the user-friendliness or access to equity gap data in our institutional dashboards.
Dashboards & Scorecards
4-Year Institution
PWI
Nevada
Jennifer Lowman
Director of Student Persistence Research
Di Wu
Graduate Research Assistant & Doctoral Student
Evidence

The DEI Strategic Plan for the Division of Student Services (i.e. Student Affairs) required each office to assess equity gaps in services and outcomes. However, access to equity gap information and insights has made progress difficult. Faculty who need equity gap data to set or track goals for their work with students expressed feeling overwhelmed by the dashboards. In essence, faculty can do equity gap analysis with the current dashboards, but there are many “clicks” necessary. Even though dashboard functionality is simple (e.g. filters), faculty feel overwhelmed by the process and the time it takes to generate insights. Our goals are to 1) Improve usability of equity gap data in dashboard environment and 2) generate an overall “within-group’ score for student race or ethnic groups that communicates quality of change in retention and graduation outcomes over-time. The within-group score estimates change for each group independently; it does not compare groups. This is in line with anti-racist data practices for a predominantly white institution (PWI) - white student outcomes are NOT the point of comparison.

Goal

Our goals are to:

  1. Improve usability of equity gap data in dashboard environment
  2. Generate an overall ‘within-group’ score for student race or ethnic groups (in line with anti-racist data practices for a PWI) that communicates quality of change in retention and graduation outcomes over time.
Lessons Learned

Through consultation with faculty and some observation of their use of the Power BI dashboards, we found that:

  1. Most of the data needed to do equity gap analysis is available, but
    a) Dashboards do not display interactions between student characteristics, which means faculty must keep track of many outputs and then compile the outputs to generate equity gap insights;
    b) Faculty lose track of the number of filters required or that they have applied, which leads to mistakes in their output;
    c) The number of “clicks” required to generate equity gap insights is overwhelming for faculty and leads to disengagement;
  2. Even with all the data available in Power BI and the process fairly simple, faculty feel they do not have enough time to use the Power BI dashboards.