Accessibility & A New Sensory Way to Do Science
Peppers.Ghöst is built on a simple belief: science should be perceivable, not just visible. If the universe is recorded as data, then it can be experienced through multiple senses—especially hearing and touch. This page explains why accessibility matters, how sonification can become a learnable “visualization-by-sound,” and how Braille + Desmos accessibility can integrate with our software to expand who gets to participate (and contribute) in the scientific community.
Why this matters
Many scientific fields still assume the primary way to understand data is by looking at graphs, images, and plots. That limits participation—and it also leaves a powerful kind of perception underused: pattern recognition through hearing.
Research and lived experience show that many blind and low-vision individuals develop strong auditory skills and spatial hearing strategies. That doesn’t mean “superpowers,” and it’s not true for everyone—but it does mean the blind community can bring valuable feedback on what is detectable, learnable, and meaningful in sound-based data interpretation.
Access isn’t an add-on. It changes who can study, teach, and contribute to science.
Hearing can reveal change, rhythm, drift, and repetition quickly—especially in time-based data.
Blind & low-vision users help define what “readable sound” actually means.
Build a sound-language that becomes learnable—so listeners can form mental models of scientific structure through repeated exposure.
1) Opening science to more minds
When scientific understanding depends on visuals alone, we exclude people who would otherwise thrive in research, education, and exploration. Accessibility is not just fairness—it is talent expansion. It invites more perspectives into how we ask questions, interpret results, and communicate discoveries.
If a dataset can be visualized, it can also be sonified and made tactile—creating multiple ways to understand the same truth.
2) Why auditory perception is invaluable feedback
Many blind and low-vision individuals rely on sound and touch for navigation and information, and studies of sensory plasticity show that early visual deprivation can be associated with stronger performance on some auditory tasks (while other auditory tasks can show trade-offs). That combination—skill plus real-world listening strategies—makes blind and low-vision feedback exceptionally valuable for building a sound-language that stays readable, stable, and meaningful.
- Change over time (drift, wobble, repetition)
- Layering (foreground/background, density)
- Transitions (thresholds, events, phase shifts)
- Spatial cues (movement, “where” in a soundscape)
- Sound clarity vs. clutter
- Learnability (what users remember)
- Intuitive mappings (what “makes sense”)
- Trust (does it feel faithful to the data?)
We don’t assume everyone hears “better.” We assume that designing for blind and low-vision users creates a higher standard of clarity that benefits everyone.
3) Evidence from NASA sonification efforts
NASA has invested in data sonification specifically to make space science accessible to blind and low-vision audiences—while also reaching wider publics. Their work shows that sonification can communicate structure, support learning, and build trust in the underlying data.
- Chandra’s “A Universe of Sound” initiative
- NASA “Data Sonifications” hub (images → sound)
- Hubble + Webb sonification releases
- Documentary and interactive sonification projects
- Access for blind & low-vision communities
- New ways to explore the same datasets
- Public learning and engagement
- Feedback loops that improve the work
Sonification is treated as a legitimate representation of data—built through careful mapping decisions so the sound reflects real structure.
4) The blind astronomer & listening to data
A major inspiration for accessibility in science is the work of blind astronomers who use sound to examine complex datasets. They demonstrate something powerful: when sound is structured, it can become a serious tool for understanding patterns that might be missed or flattened in purely visual presentation.
- Wanda Díaz-Merced is widely known for advocating and developing approaches to explore astrophysical data through sound, emphasizing equal access.
- Blind and low-vision collaborators such as Christine Malec have been publicly involved in community feedback around astronomy sonification experiences.
If the dataset is real, the representation should be real—sound can be a valid “view” when it preserves relationships.
5) Ear training → “visualization by sound”
A new sensory language becomes powerful when it’s learnable. Over time, ear training can build “mental visualization”: listeners recognize patterns, anticipate changes, and form internal maps of a system’s structure.
Stable reference tones or textures give the listener a home base—like axes on a graph.
Intervals, density changes, and spatial motion teach “distance,” “direction,” and “magnitude.”
Threshold crossings, spikes, and shifts become recognizable “markers” like points of interest on a plot.
Eventually the listener stops decoding and starts perceiving—the structure becomes immediate.
6) A learnable language (synesthesia-like)
We often describe the goal as “synesthesia-like”—not medical synesthesia, but a consistent cross-sensory association: the same type of structure always creates the same type of sound behavior. That stability lets the brain form fast associations: shape → motion → tone → meaning.
Consistent rules + repeatable patterns + clear anchors = a sensory language that becomes intuitive over time.
7) Braille + Desmos accessibility integration
Desmos already supports accessibility features designed for blind and low-vision users, including compatibility with screen readers and refreshable Braille displays. This is important because Desmos becomes a bridge between: (1) mathematical structure and (2) tactile + auditory access.
- Discrete patterns (reliable, readable commands)
- Excellent for mode switching and navigation
- Supports math/science notation (where applicable)
- Enables non-visual “control surfaces”
- Braille patterns select datasets, views, or “chapters”
- Braille inputs choose mapping modes (pitch/timbre/motion)
- Controls focus: anchor points, events, or regions
- Pairs with audio trace / auditory exploration for learning
Touch becomes the menu, hearing becomes the visualization, and the math stays precise underneath.
8) Accessibility design principles we follow
- Clarity over complexity: avoid clutter; preserve readable layers.
- Anchors first: stable references (like axes) make exploration possible.
- Consistency: the same structure always yields the same kind of sonic behavior.
- Multiple modalities: hearing + touch + optional visuals, not one exclusive channel.
- Community feedback: blind/low-vision listeners are co-designers of readability.
We’re not just “adding accessibility.” We’re building a system where accessibility improves the science communication for everyone.
References (public work that supports this direction)
- NASA Chandra “A Universe of Sound” and related sonification initiatives
- NASA “Data Sonifications” (image features mapped to pitch/volume and position)
- Peer-reviewed study surveying blind/low-vision and sighted participants on NASA sonifications (learning + response outcomes)
- Wanda Díaz-Merced: advocacy and research around listening to astrophysical data
- Desmos accessibility documentation (screen readers, refreshable Braille, Audio Trace)