Breath-based biofeedback represents a significant technical and artistic evolution for immersive installations, offering real-time detection of autonomic nervous system states through acoustic analysis of respiratory patterns. For Karen Palmer's Ascended Intelligence project targeting SXSW 2026, this approach enables a pivot from external surveillance (facial recognition) to internal physiological monitoring—creating an installation where participants discover that their breath reveals their emotional state, and that conscious regulation of breath can transform both their physiology and the narrative environment. This report synthesizes the technical methods, theoretical foundations, clinical evidence, and implementation considerations necessary for a rigorous, therapeutically-informed installation.
The core premise is elegantly simple: the voice carries the breath, and the breath carries the nervous system. Unlike facial expressions which can be masked, respiratory patterns embedded in speech audio provide involuntary signals of autonomic state—hyperventilation during fight-or-flight activation, breath-holding during freeze responses, and slow rhythmic breathing during states of calm. By making these invisible patterns visible through responsive visualization, the installation creates a biofeedback loop that can develop interoceptive awareness and restore a sense of agency.
The foundation of breath-based biofeedback lies in signal processing methods capable of distinguishing respiratory sounds from speech, silence, and environmental noise. Breath sounds occupy a characteristic acoustic profile that differs markedly from voiced speech: they are unvoiced (fundamental frequency F0 = 0), exhibit low energy with relatively flat spectral profiles, and typically occur in silence periods between speech utterances (Ruinskiy & Lavner, IEEE Transactions on Audio, Speech, and Language Processing, 2007).
Spectral characteristics provide the primary discrimination pathway. Normal vesicular breath sounds concentrate energy between 60-600 Hz, with an exponential power decrease as frequency increases at approximately 9.8-14.4 dB per octave (Gross et al., American Journal of Respiratory and Critical Care Medicine, 2000). Inspiratory sounds reach maximal frequencies around 446-475 Hz, while expiratory sounds are lower at approximately 284-286 Hz (Sovijärvi et al., Journal of Applied Physiology, 1981). This frequency profile contrasts with voiced speech, which contains harmonic structure, higher energy, and fundamental frequency variations.
OpenSMILE provides a standardized, real-time feature extraction pipeline particularly suited for this application. The eGeMAPSv02 feature set (Extended Geneva Minimalistic Acoustic Parameter Set) extracts 25 low-level descriptors yielding 88 functional parameters, specifically designed for voice research and affective computing (Eyben, Scherer & Schuller, IEEE Transactions on Affective Computing, 2016). Key features for breath detection include:
Frame parameters for OpenSMILE processing use a 20-25 ms window with 10 ms hop for low-latency applications, though accuracy improves with longer frames of 200-300 ms (Zhantleuova et al., Sensors, 2025). For biofeedback requiring responsive visualization, a dual-pass architecture may be optimal: rapid preliminary classification at 20 ms frames for immediate response, with a slower 200+ ms analysis for refined state estimation.
Validation studies demonstrate strong accuracy. Ruinskiy and Lavner's template-matching algorithm using MFCC matrices achieved 98% correct identification and 96% specificity for breath detection in speech and song. More recent deep learning approaches using BiLSTM networks achieve 97.4% accuracy (Interspeech, 2019). Acoustic respiratory rate monitoring has been validated against gold-standard capnography, with devices achieving mean errors of 1.21±1.36 breaths per minute under controlled conditions (Journal of Clinical Medicine, 2024). The technical viability of acoustic breath detection for biofeedback applications is well-established.
Real-time processing introduces latency considerations. For biofeedback to feel responsive, total system latency should remain under 100-150 ms—below the threshold where users perceive delay between their breath and visual response. OpenSMILE is designed for real-time extraction and runs on standard computing hardware including embedded ARM processors, with incremental online processing that avoids the need to buffer complete audio segments.
Stephen Porges' polyvagal theory (PVT) provides the dominant theoretical framework connecting breath patterns to emotional states in clinical biofeedback practice. The theory proposes three hierarchically organized autonomic circuits, each associated with distinct behavioral and respiratory patterns (Porges, Psychophysiology, 1995, 2001):
The ventral vagal complex originates in the nucleus ambiguus and provides myelinated vagal fibers supporting rapid, context-sensitive cardiac regulation. This system underlies the "social engagement" state—characterized by feeling safe, calm, and connected. Respiratory manifestations include deep, slow, rhythmic breathing with high respiratory sinus arrhythmia (RSA), the respiratory modulation of heart rate.
The sympathetic nervous system mediates fight-or-flight mobilization. Breathing becomes shallow, rapid, and irregular—the classic hyperventilation pattern of anxiety. RSA is suppressed as the vagal "brake" is withdrawn to allow heart rate acceleration.
The dorsal vagal complex originates in the dorsal motor nucleus and mediates the evolutionarily ancient freeze/shutdown response. Breathing becomes shallow with possible breath-holding, chest collapse, and energy conservation. This state is associated with dissociation, numbness, and helplessness—responses particularly relevant to trauma.
The concept of neuroception—an unconscious neural process distinguishing safe from threatening environments without conscious perception—explains why these autonomic shifts often occur without awareness (Porges, Frontiers in Integrative Neuroscience, 2022).
A balanced scientific assessment requires acknowledging that polyvagal theory has attracted sustained scholarly criticism questioning its core anatomical and evolutionary premises. These critiques do not necessarily invalidate clinical applications but establish important epistemic boundaries.
Paul Grossman (University of Basel) has published the most comprehensive critique, arguing that PVT commits a "category mistake" by conflating RSA (an approximate index) with vagal tone itself (Grossman, Biological Psychology, 2023). He identifies specific confounds: RSA amplitude is affected by respiratory rate and tidal volume independent of vagal traffic; RSA can be influenced by beta-adrenergic (sympathetic) tone; and RSA and cardiac vagal tone can dissociate under certain conditions. Grossman concludes that "each basic physiological assumption of the polyvagal theory is untenable" and that the underlying hypotheses "have been falsified."
Edwin W. Taylor (University of Birmingham) and comparative physiologists have challenged the evolutionary claims. Monteiro et al. (Science Advances, 2018) demonstrated that myelinated vagal pathways from the nucleus ambiguus to the heart exist in lungfish—organisms at the evolutionary base of air-breathing vertebrates—contradicting Porges' claim that this is a uniquely mammalian innovation. Taylor et al. (Biological Psychology, 2022) conclude that "RSA may be a relic of older cardio-respiratory systems" rather than a mammalian evolutionary advance, finding cardiorespiratory interactions "refute the proposition that centrally controlled cardiorespiratory coupling is restricted to mammals."
Winfried Neuhuber and Hans-Rudolf Berthoud (neuroanatomists) conducted detailed analysis concluding that PVT's "basic phylogenetic and functional-anatomical tenets do not withstand closer scrutiny" (Biological Psychology, 2022). They find no evidence supporting the dorsal vagal complex's role in freeze responses and consider the "ventral vagal complex" terminology misleading.
The scientific controversy creates an apparent paradox: polyvagal theory remains widely used in clinical settings despite serious challenges to its neurobiological foundations. Several positions attempt to reconcile this tension.
Clinical pragmatists argue that the three-state model (safe/fight-flight/freeze) provides an accessible, phenomenologically accurate framework for clients to understand their autonomic experiences, regardless of precise neuroanatomy (Giroux, Ahlers & Miawotoe, Journal of Psychiatry Reform, 2023). The concepts of Hierarchy, Neuroception, and Co-regulation remain practically useful even if evolutionary details require refinement.
Scientific purists counter that clinical utility does not validate incorrect claims and that perpetuating anatomically inaccurate models risks undermining the field's scientific credibility.
For Ascended Intelligence, the practical implication is that the three autonomic states—and their respiratory manifestations—can be presented as useful experiential categories without claiming neurobiological precision. The phenomenon that breathing patterns shift with emotional state, and that conscious breath regulation can influence emotional state, is well-established independent of PVT's contested evolutionary narrative.
Heart rate variability biofeedback provides the most extensively researched model for understanding how respiratory biofeedback produces therapeutic effects. While Ascended Intelligence uses breath directly rather than HRV, the mechanistic insights and clinical evidence base are directly applicable.
Respiratory sinus arrhythmia (RSA)—heart rate increasing during inhalation and decreasing during exhalation—is mediated entirely by the vagus nerve and provides a window into parasympathetic function (Berntson et al., Psychophysiology, 1997). The key physiological insight is that breathing at approximately 0.1 Hz (6 breaths per minute) maximizes this heart rate oscillation through resonance with the cardiovascular baroreflex, the blood pressure control system.
At this resonance frequency, three phenomena align: heart rate and breathing achieve 0° phase relationship (synchronized); heart rate and blood pressure achieve 180° phase relationship (counter-oscillating); and baroreflex stimulation is maximized because breathing-induced heart rate changes compound with baroreflex-induced changes rather than opposing them. The result is HRV amplitude increases of 4-10 times compared to resting baseline (Lehrer, Vaschillo & Vaschillo, Applied Psychophysiology and Biofeedback, 2000).
Individual resonance frequencies vary between approximately 4.5-6.5 breaths per minute in adults, determined primarily by blood volume and vascular tree size. Taller individuals and men have lower resonance frequencies. Notably, resonance frequency appears stable even after months of practice—it is a physiological constant rather than a trainable parameter (Vaschillo et al., Applied Psychophysiology and Biofeedback, 2002, 2006).
Multiple systematic reviews and meta-analyses confirm HRV biofeedback's effectiveness:
Goessl, Curtiss & Hofmann (Psychological Medicine, 2017) analyzed 24 studies (n=484) examining stress and anxiety, finding a large effect size (Hedges' g = 0.83) for between-groups comparisons versus controls.
Lehrer et al. (Applied Psychophysiology and Biofeedback, 2020) reviewed 58 randomized controlled trials, finding small-to-moderate effects favoring HRV biofeedback, with largest effects for anxiety, depression, and anger and smaller (but significant) effects for PTSD and sleep.
Military PTSD applications show particular promise, with a meta-analysis of 5 studies (n=95) finding moderate-to-large effects (g = -0.557) and remarkably low attrition of only 5.8%—substantially below traditional PTSD treatment dropout rates (Military Medicine, 2024).
Pizzoli et al. (Scientific Reports, 2021) meta-analyzed 14 RCTs (n=794) for depression, finding medium effects (g = 0.38).
The primary supported mechanism is baroreflex strengthening. Resonance breathing provides "exercise" to the baroreflex system, producing immediate large increases in baroreflex gain during practice and, with chronic practice, increased resting baroreflex gain indicating neuroplasticity (Lehrer et al., Psychosomatic Medicine, 2003).
The neurovisceral integration model (Thayer & Lane, 2000) proposes that cardiac vagal tone indicates the functional integrity of prefrontal-subcortical inhibitory circuits—higher HRV reflects better prefrontal cortical inhibition of the amygdala. Evidence supports vagal afferent contributions: heartbeat evoked potentials (HEPs) are larger during slow breathing (MacKinnon et al., 2013), and HRV biofeedback increases HEP amplitude compared to EMG relaxation training (Huang et al., 2014).
Interoceptive awareness development provides another pathway: resonance breathing correlates with increased interoceptive accuracy, suggesting that enhanced baroreflex engagement improves conscious perception of cardiac and respiratory signals (Leganes-Fonteneau et al., International Journal of Psychophysiology, 2022).
The history of biofeedback in artistic contexts extends to the 1960s, providing precedents and design principles directly relevant to Ascended Intelligence.
Alvin Lucier's "Music for Solo Performer" (1965) pioneered artistic use of brainwave signals, with alpha rhythms controlling percussion instruments. David Rosenboom systematically explored biofeedback music from the 1970s, creating works like "Portable Gold and Philosophers' Stones" (1972) using EEG, temperature, and galvanic skin response. His 1990 monograph Extended Musical Interface with the Human Nervous System remains the theoretical foundation for the field.
Contemporary practice is exemplified by Rafael Lozano-Hemmer, whose "Pulse" series transforms heartbeat data into light installations. Pulse Room (2006) features hundreds of incandescent bulbs pulsing with visitor heartbeats; Pulse Topology (2021) uses 3,000-10,000 suspended lightbulbs where each new participant's heartbeat replaces the oldest recording, creating what the artist calls a "memento mori."
Lozano-Hemmer articulates a key principle: "At a time when biometry is increasingly used for identification and control, this data constituted a new way of representing both anonymity and community." His work transforms biometric data into aesthetic experience rather than surveillance—a philosophical stance directly aligned with Palmer's trajectory from external observation to internal awareness.
A critical design consideration is that showing someone their anxiety can increase their anxiety. Research confirms this paradox: increasing interoceptive awareness through biofeedback can facilitate emotion regulation, but an increase in physiological awareness can also amplify anxiety (PMC research). The mechanism involves interpretation: anxious individuals show elevated sensitivity to negative feedback and reduced habituation over time. Seeing elevated heart rate or stressed breathing patterns can reinforce and escalate anxious processes.
Design strategies to mitigate this risk include:
Cognitive appraisal mediation: The relationship between interoceptive awareness and emotion regulation is mediated by cognitive interpretation. Framing that normalizes physiological fluctuation and emphasizes capacity for change supports beneficial responses.
Abstraction rather than literal data: Lozano-Hemmer's lights and ripples are beautiful rather than clinical. Non-literal, aesthetic representation creates emotional distance from raw physiological data. Avoid displays that feel like medical monitoring.
Emphasizing transitions over states: Operant conditioning principles indicate that showing direction of change rather than absolute position creates learning and agency rather than static self-judgment. The biofeedback should reward movement toward regulation, not simply display current state.
Temporal buffering: Rolling analysis windows of 2-5 seconds rather than instantaneous feedback prevents overwhelming moment-to-moment fluctuations and creates emotional distance.
Photosensitive epilepsy affects approximately 1 in 4,000 people, with peak sensitivity at 16-20 flashes per second (most dangerous range 3-30 Hz). International guidelines including WCAG 2.0 and UK Ofcom standards require no more than 3 flashes per second and avoidance of saturated red flashing.
Dissociation risks are elevated in immersive environments. VR research demonstrates increased depersonalization and derealization, particularly in individuals with pre-existing dissociative tendencies or trauma histories. Grounding techniques (5-4-3-2-1 sensory awareness, physical movement, cold sensation) should be available, and staff should be trained to recognize dissociative responses.
Installation design should include clear exit strategies, low-stimulation recovery areas, duration limits with recommended breaks, and informed consent that discloses potential effects before participation.
The technical pipeline for Ascended Intelligence proceeds from audio capture through feature extraction, classification, and visualization response. Based on the research synthesis, the following architecture is recommended:
The installation must detect both major dysregulated breathing patterns: rapid breathing (sympathetic fight-or-flight) and absent/shallow breathing (dorsal vagal freeze). These represent opposite ends of the autonomic spectrum but both indicate departure from regulated ventral vagal function.
For hyperventilation detection, acoustic features indicating rapid shallow breathing include elevated zero-crossing rate within speech pauses, shorter inter-breath intervals, and spectral characteristics of quick shallow inhalations.
For breath-holding detection, the key signal is the absence of expected breath sounds. When speech continues without normal respiratory pauses, or when extended silence occurs without breath sounds, this indicates freeze-state breath suppression. The clinically significant signal is what is not present—requiring baseline establishment of normal breathing patterns for comparison.
Individual variation in voice and breathing patterns necessitates personal baseline establishment. During the first 30-60 seconds of interaction, the system should:
This approach expresses anxiety as deviation from individual baseline rather than absolute thresholds, accommodating natural variation in speaking rate, voice pitch, and breathing style. A participant with naturally slower speech should not be classified as "regulated" simply because their rate matches population norms.
Neuroscience research on episodic memory formation suggests a 15-second integration window for experiential coherence. A rolling buffer at this timescale provides:
The visualization should display this rolling window as a temporal trace, allowing participants to observe their state history and recognize patterns.
A critical reframe: if participants discover they can influence the visualization through conscious breathing, this is not "gaming the system" but the therapeutic goal. The mechanism of change in biofeedback is precisely the development of voluntary control over previously automatic processes. When a participant deliberately slows their breathing to shift the visualization, they are:
The installation should therefore be designed such that conscious regulation is achievable and rewarding rather than impossible to influence.
To maintain authenticity and prevent complete conscious override, the narrative can include startle moments—sudden visual or auditory events designed to trigger involuntary physiological responses. These moments serve to:
The contrast between controlled steady-state breathing and startle-induced dysregulation makes the autonomic nervous system visible in a way that pure steady-state cannot.
The synthesis of research across psychophysiology, clinical biofeedback, and biofeedback art suggests that Ascended Intelligence's therapeutic potential operates through several interlocking mechanisms.
Demonstrated contingency is fundamental: the participant discovers that their internal physiological state produces visible external effects. This discovery—that the invisible can be made visible, and that the previously automatic can become voluntary—challenges learned helplessness and passive relationship to internal experience. For trauma survivors in particular, who may experience their bodies as unpredictable or uncontrollable, demonstrated contingency can begin restoring embodied agency.
Interoceptive awareness development is both mechanism and outcome. The installation creates conditions for enhanced perception of internal states by externalizing them. Over the course of interaction, participants may develop refined awareness of their breath patterns, noticing tensions and releases that previously occurred without conscious registration. Research indicates that such interoceptive development correlates with improved emotion regulation capacity.
Agency restoration operates through the experience of successful self-regulation. When breath control influences the environment, participants experience themselves as agents rather than passive subjects. This contrasts with Karen Palmer's earlier surveillance-focused works where participants experienced themselves as observed objects; in Ascended Intelligence, observation turns inward and becomes self-directed.
Transfer of learning beyond the installation remains the ultimate therapeutic question. Does awareness and regulation developed in the installation context generalize to daily life? Clinical HRV biofeedback research suggests that with practice, regulatory capacity does transfer—but typically requires multiple sessions and home practice. A single installation interaction more realistically provides an introductory experience that may catalyze continued self-exploration rather than completing a therapeutic process.
The installation's artistic container is not incidental to therapeutic effect. The aesthetic frame—the fact that this occurs as art rather than clinical treatment—creates permission to explore internal states without the stigma or medical authority of therapy. The sacred or liminal space of the installation enables experiences that might be defended against in ordinary contexts. Palmer's philosophy of "storytelling as rites of passage" directly engages this transformation: the participant enters one state and emerges changed, having encountered something previously invisible about themselves.
Ascended Intelligence represents a conceptually significant evolution in Karen Palmer's artistic practice and in the broader field of biofeedback art. Where RIOT and Consensus Gentium placed participants under the gaze of AI systems detecting external expressions, Ascended Intelligence inverts this relationship: the AI detects internal states, making the invisible visible to the self rather than to external observers.
The technical foundation is robust. Acoustic breath detection achieves 85-98% accuracy using established signal processing methods; OpenSMILE provides validated, real-time feature extraction specifically designed for affective computing; and the eGeMAPSv02 feature set offers interpretable low-level descriptors (HNR, F0, jitter, shimmer, spectral features) that map onto clinically meaningful constructs.
The theoretical foundation requires appropriate epistemic humility. Polyvagal theory provides an accessible model for understanding autonomic states and their respiratory manifestations, but its evolutionary and neuroanatomical claims have been substantially challenged by comparative physiologists and neuroanatomists. The three-state framework (safe/fight-flight/freeze) retains phenomenological validity as an experiential description even where its proposed mechanisms are contested.
The clinical evidence base is encouraging. HRV biofeedback meta-analyses demonstrate medium to large effect sizes for anxiety, depression, and stress, with particularly promising applications for trauma. Mechanisms include baroreflex strengthening, vagal afferent activation of prefrontal regulatory circuits, and interoceptive awareness development.
The design principles from biofeedback art precedents emphasize abstraction over literal data display, temporal buffering to prevent anxiety amplification, emphasis on transitions rather than static states, and the importance of aesthetic transformation that makes physiological data beautiful rather than clinical.
For implementation, the key recommendations center on establishing individual baselines rather than population thresholds, detecting both hyperventilation and breath-holding as distinct dysregulation patterns, treating conscious breath control as therapeutic success rather than system gaming, and incorporating startle moments to reveal involuntary autonomic reactivity.
The deeper significance lies in what the installation offers participants: an encounter with their own nervous system, externalized and made responsive, revealing the breath as a bridge between automatic and voluntary, between body and mind, between what happens to us and what we can choose. In Palmer's words, making participants "conscious of their subconscious behavior" takes on transformative meaning when the behavior in question—breath—can be consciously regulated, creating a loop of awareness, agency, and embodied change.
Abushakra A, Faezipour M. (2013). Acoustic Signal Classification of Breathing Movements to Virtually Aid Breath Regulation. IEEE Journal of Biomedical and Health Informatics, 17(2), 493-500.
Berntson GG, Bigger JT, Eckberg DL, et al. (1997). Heart rate variability: Origins, methods, and interpretive caveats. Psychophysiology, 34(6), 623-648.
Eyben F, Scherer KR, Schuller B, et al. (2016). The Geneva Minimalistic Acoustic Parameter Set (GeMAPS) for Voice Research and Affective Computing. IEEE Transactions on Affective Computing, 7(2), 190-202.
Goessl VC, Curtiss JE, Hofmann SG. (2017). The effect of heart rate variability biofeedback training on stress and anxiety: A meta-analysis. Psychological Medicine, 47(15), 2578-2586.
Grossman P. (2023). Fundamental challenges and likely refutations of the five basic premises of the polyvagal theory. Biological Psychology, 180, 108589.
Grossman P, Taylor EW. (2007). Toward understanding respiratory sinus arrhythmia: Relations to cardiac vagal tone, evolution and biobehavioral functions. Biological Psychology, 74(2), 263-285.
Lehrer PM, Gevirtz R. (2014). Heart rate variability biofeedback: How and why does it work? Frontiers in Psychology, 5, 756.
Lehrer PM, Vaschillo E, Vaschillo B. (2000). Resonant frequency biofeedback training to increase cardiac variability: Rationale and manual for training. Applied Psychophysiology and Biofeedback, 25(3), 177-191.
Lehrer PM, et al. (2020). Heart rate variability biofeedback: A meta-analysis. Applied Psychophysiology and Biofeedback, 45, 109-129.
Monteiro DA, et al. (2018). Cardiorespiratory interactions previously identified as mammalian are present in the primitive lungfish. Science Advances, 4(2), eaaq0800.
Neuhuber WL, Berthoud HR. (2022). Functional anatomy of the vagus system: How does the polyvagal theory comply? Biological Psychology, 174, 108425.
Pizzoli SFM, et al. (2021). HRV biofeedback for depression: A systematic review and meta-analysis. Scientific Reports, 11, 6650.
Porges SW. (1995). Orienting in a defensive world: Mammalian modifications of our evolutionary heritage. A Polyvagal Theory. Psychophysiology, 32(4), 301-318.
Porges SW. (2001). The polyvagal theory: Phylogenetic substrates of a social nervous system. International Journal of Psychophysiology, 42, 123-146.
Ruinskiy D, Lavner Y. (2007). An Effective Algorithm for Automatic Detection and Exact Demarcation of Breath Sounds in Speech and Song Signals. IEEE Transactions on Audio, Speech, and Language Processing, 15(3), 838-850.
Taylor EW, Wang T, Leite CAC. (2022). An overview of the phylogeny of cardiorespiratory control in vertebrates with some reflections on the 'Polyvagal Theory.' Biological Psychology, 172, 108382.
Thayer JF, Lane RD. (2000). A model of neurovisceral integration in emotion regulation and dysregulation. Journal of Affective Disorders, 61, 201-216.
Vaschillo EG, et al. (2006). Heart rate variability biofeedback as a method for assessing baroreflex function: A preliminary study of resonance in the cardiovascular system. Applied Psychophysiology and Biofeedback, 31(2), 129-142.
Zhantleuova AK, Makashev YK, Duzbayev NT. (2025). Optimizing MFCC Parameters for Breathing Phase Detection. Sensors, 25(16), 5002.