Tangible Stats: An Embodied and Multimodal Platform for Teaching Data and Statistics to Blind and Low Vision Students

Danyang Fan, Gene Kim, Olivia Tomassetti, Shloke Patel, Sile O Modhrain, Victor R Lee, Sean Follmer

A panel of four images illustrates a statistical learning platform featuring stacked tokens representing data distributions on a board, accompanied by a monitor displaying the data representation. Image A: A hand places a token onto the board. Image B: A finger presses on a stack of 5 tokens. A dialogue box on the monitor reads Group 10 has 5 values. Image C: Hands place tokens to the left side of the board, causing the mean to shift leftward and the board to tilt left. As a hand slides a knob to the new mean, the board balances. Image D: Progression shows hands feeling vibrations at various regions of the data distribution constructed from tokens. The vibrations are mirrored across the distribution's median.

A statistical learning platform featuring a tilting interface where students can explore data physicalizations using tangible tokens. The platform enables students to: A) construct and manipulate data representations by stacking tokens, B) hear data and statistical parameters by pressing on specifc regions of the representation, C) engage with the concept of mean by feeling the representation tilting of-balance when an emulated fulcrum deviates from the statistical mean (top), and practice sliding the fulcrum to the mean to restore balance (bottom), and D) explore the concepts of median and percentile by feeling symmetric values mirrored across the median through vibrations.

Abstract

Interactive data learning tools provide explorable ways for students to build intuitions about data, data representations, and statistical parameters. However, these tools rely on visual consumption and are not accessible to blind and low vision (BLV) students. In this work, we investigate opportunities to leverage active exploration, enriched with multimodal feedback and embodied interaction, to foster an understanding of the relationships among individual data values, data representations, and statistical measures. We explore these opportunities in the form of an accessible learning platform that allows students to hear and feel how statistical measures are changing in real time as they construct and manipulate physicalized data representations. We introduced the platform to four teachers of students with visual impairments (TVIs) through a two-hour-long focus group. TVIs embraced the platform’s exploratory nature and universality and recommended the consideration of additional auditory and texture-based interactions to enhance engagement.


A labeled diagram highlighting features of the statistical learning platform. The platform comprises white rectangular tokens arranged on a tilting board to form a histogram. A computer monitor behind the platform displays the corresponding data visualization. The diagram highlights five key features: 1) Construct Data Physicalizations:  A hand is depicted adding tokens to the physicalization, illustrating learners' capability to construct and manipulate data representations interactively. 2) Cue into Important Regions through Vibrations: Another hand is shown placed over stacks of tokens with vibration icons, indicating the platform's capacity to deliver vibrotactile feedback to users. 3) Find the mean through touch: A hand is observed adjusting a white slider to the center-of-balance of the board, symbolizing how the platform utilizes this mechanism to help students develop an understanding of statistical mean intuitively. 4) Query Data and Statistical Values: A finger presses on a stack of tokens, demonstrating students' ability to query information about specific segments of the physicalization. 5) Customize Feedback:  The monitor also displays a series of toggles that educators can use to customize and scaffold the feedback provided to learners during their interaction with the platform.
Text labels on the diagram describe these features and are listed as bullet points below the figure.

Papers

Danyang Fan, Gene S-H Kim, Olivia Tomassetti, Shloke N Patel, Sile O’Modhrain, Victor R Lee, Sean Follmer. Tangible Stats: An Embodied and Multimodal Platform for Teaching Data and Statistics to Blind and Low Vision Students. In Proceedings of the Extended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems (CHI EA’24). https://dl.acm.org/doi/10.1145/3613905.3650793