Current Wallace Lab Projects
The neural underpinnings of multisensory behavior
Project Lead: Aaron Nidiffer
Multisensory Integration in Clinical Populations
Project Lead: Gabby DiCarlo
Multisensory integration can be described as the merging and transformation of information from the different senses. Autism spectrum disorders (ASD) are complex neurodevelopmental disorders characterized by impairments in communication and social behavior as well as the presence of repetitive and restrictive behaviors. In addition to the classic domains impacted in autism, sensory abnormalities are also highly prevalent in ASD with the new DSM-V now including sensory disturbances as a criterion for diagnosis. Based on the wealth of evidence highlighting disturbances across multiple sensory systems, there has been increased focus on better characterizing how the integration of information across the different sensory modalities is impacted in autism. My project is focused on psychophysical, behavioral and systems based questions to gain a further understanding of the underlying mechanisms of multisensory processing as it relates to neurodevelopmental disorders such as autism with the ultimate goal of developing more effective remediation tools.
Multisensory Training in Anesthesia Practice
Project Lead: Joseph J. Schlesinger, M. D.
In reference to the above figures, the pulse oximeter is a critical monitor in anesthesia practice designed to improve patient safety. Here, we present an approach to improve the ability of anesthesiologists to monitor arterial oxygen saturation via pulse oximetry through an audiovisual training process. Fifteen residents’ abilities to detect auditory changes in pulse oximetry were measured before and after perceptual training. Training resulted in a 9% (95% confidence interval, 4%–14%, P = 0.0004, t166 = 3.60) increase in detection accuracy, and a 72-millisecond (95% confidence interval, 40–103 milliseconds, P < 0.0001, t166 = −4.52) speeding of response times in attentionally demanding and noisy conditions that were designed to simulate an operating room. This study illustrates the benefits of multisensory training and sets the stage for further work to better define the role of perceptual training in clinical anesthesiology.
In acute care settings, the detection and response to clinical signals is critical to safe patient care. The design of audible and visual alarms has proven problematic in this regard; undue sensitivity or priority leads to excessive false alarms (and alarm fatigue) while, with insufficiently salient or sensitive alarms, critical events are missed. Studies suggest that clinical alarm design can be significantly improved by considering auditory and visual signals together as an integrated multisensory signal. I have created a unique experimental model to study the effects of the combined use of auditory and visual alarms on clinician detection and decision-making. I will use this model to study the dynamic responses of critical care clinicians performing multiple stimulus-response trials. The stimulus is an acute change in a visually presented vital sign and its associated audible alarm signal, presented on realistic ICU background sounds. Performance variables are response time and accuracy of a treatment decision. A secondary auditory task modulates attentional workload. I will examine the stimulus-response curves with: 1) Varying auditory signal-to-noise ratios and clinical scenario complexity and 2) Developing novel multisensory alarms to improve response time and accuracy to recognizing clinical deterioration and instituting therapeutic intervention. The results will inform recommendations for ICU alarm design to maximize performance while minimizing alarm fatigue.
Serotonergic Influences on Multisensory Processing
Project Lead: LeAnne Kurela
The integration of information across the senses is vital for our everyday interaction with the world. The superior colliculus (SC) is a critical brain region for these integrative processes. While much is known about how this process develops and how it occurs, less is understood about the neuromodulatory systems involved in the tuning of multisensory integration. I am interested in understanding the role of the serotonin (5-HT) system in the multisensory processing occurring within the SC. I utilize the methods of in vivo electrophysiology and pressure-injection of serotonergic compounds during single-unit recordings to determine the part the 5-HT system plays in shaping multisensory integration.
Auditory and Tactile Sensory Responsiveness and Links to Autism Symptoms
Project Lead: Lauren Bryant
Differences in response to sensory input have long been observed in individuals with autism spectrum disorder (ASD) and are now included among the clinical diagnostic criteria for ASD. Atypical sensory responsiveness manifests itself on a continuum spanning hypo-responsive and hyper-responsive patterns of behavior. It is possible that such altered sensory responsiveness is related to the processing and interpretation of sensory signal strength. However, sensory responsiveness to basic sensory stimulus properties like intensity has seldom been studied in a systematic and thorough manner in a neurotypical population. Not only have few studies examined changes in behavioral response patterns across a wide range of stimulus intensities, even fewer have explicitly designed experiments to look at the neural correlates of stimulus intensity coding, particularly under audio-tactile multisensory conditions. My research aims to fill this gap in knowledge of how typical individuals process basic sensory input in order to provide a stronger foundation from which to examine atypical sensory processing and an empirical basis for sensory-based interventions.
Plasticity of Multisensory Temporal Processing
Project Lead: Matt De Niear
Autism Spectrum Disorder (ASD) is a developmental disorder diagnostically characterized by impairments of social communication and restricted interests and repetitive behaviors. Impaired sensory processing (including multisensory processing) has been identified as an additional element of the diagnostic criteria for ASD in the DSM-V and may represent an important and unappreciated factor contributing to the observed overall impairments in social communication. From a multisensory perspective, communication and social impairments in ASD might arise from an inability to perceive the temporal relationships between stimuli affecting different sensory modalities. For example, audiovisual speech comprehension, a process that relies heavily on the temporal relationships between component auditory and visual modalities, has been suggested to be affected in ASD by the impaired ability to perceptually integrate sensory information. My project seeks to identify the neural correlates that underlie deficits of multisensory temporal acuity in ASD and to determine if a perceptual learning paradigm previously observed to enhance temporal acuity for audiovisual in typically developed adults is capable of enhancing temporal acuity in those with ASD.
Behavioral and Neural Variability in Autism Spectrum Disorder
Project Lead: Sarah Baum, Ph D
Sensory dysfunction is now recognized as a core symptom of Autism Spectrum Disorder (ASD), as well as restricted interests and repetitive behaviors, and deficits in social communication and interaction. In addition to atypical sensory response, performance on a number of sensory and motor tasks is not only worse, but also more inconsistent from trial to trial in individuals with ASD. A growing body of literature suggests that differences in behavioral variability, and its underlying neural correlates, may provide important clues about the encoding of sensory information and its transformation to behavioral output in ASD. Using both behavioral testing and neuroimaging with fMRI, the experiments carried out under the project aim to provide a thorough characterization of both behavioral and neural (i.e. BOLD) variability in ASD and TD children, and the associated effect of variability on speech processing abilities. Our second goal is to investigate the malleability of sensory processing through the use of a perceptual training paradigm with ASD individuals, aimed at decreasing variability and improving speech perception.
Audiovisual Processing in Patients with Cochlear Implants
Project Lead: Iliza Butera
Cochlear implants allow those with profound hearing loss to experience sound, some of them for the first time. However, cochlear implant patients have difficulties with pitch discrimination and sound localization, even using modern implant processors. I’m interested in the mechanisms by which multiple senses are filtered and fused together in the brain, creating what we call spatial and temporal binding. Prior research suggests that perceptual binding may be shaped by experience and can be influenced by subsequent training. My work utilizes lab-based computer games and app-based mobile platforms to understand the development of multisensory integration and cortical plasticity. This research may help shape therapeutic interventions in the clinic as well as future cochlear implant technology.
EEG Investigation of Sensory Processing Networks
Project Lead: David Simon
My research interest is using Electroencephalography (EEG) to explore differences in sensory processing and brain networks in individuals with autism spectrum disorder (ASD). Sensory dysfunction is a recognized primary component of ASD, but there is still a great deal we do not know about how the neural mechanisms of sensory processing are altered in individuals with ASD and how this leads to behavioral impairment. Specifically in the multisensory domain, we know that individuals with ASD have a wider temporal window for integration of unisensory components as well as decreased behavioral facilitation in terms of reaction times. My work centers on using the high temporal resolution of EEG combined with psychophysical approaches to determine how differences in sensory system activity lead to altered perception in individuals with ASD. Additionally, through application of graph theory approaches of network modelling to EEG data I am investigating how disruptions in overall network properties, such as long range connectivity and modularity, are associated with perception in both ASD and typical development.
Spatio-temporal dynamics and oscillatory mechanisms of auditory-visual detection across space
Project Lead: Antonia Thelen, Ph D
The goal of the study is to investigate the existence of preferential multisensory interactions across visual spatial representations and auditory cues. More specifically, the project will aim at revealing the spatio-temporal dynamics of the neuronal populations which underpin multisensory interactions in different spatial positions. To this end we will combine behavioral measures and EEG recordings. The methods at hand will reveal 1) selective perceptual enhancement at the behavioral level, and 2) the temporal dynamics and oscillatory activity implicated, as well as the underlying neuronal substrates.
Spatio-Temporal Binding Windows in Depth
Project Lead: Jean-Paul Noel
Among others, two of the major determinants ruling multisensory integration and the bourgeoning of a cohesive multisensory percept are the spatial and temporal principles of multisensory integration. These, respectively, state that the closer in space or in time two unisensory events are (e.g., an auditory and a visual event), the most likely they will be processed/perceived as a single multisensory event (e.g., an audiovisual event). Our group has largely focused in the recent past on the notion of a temporal binding window – that is, the temporal extent over which participant’s will categorize two disparate unisesory events as a multisensory one. This notion of a window, or a boundary, over which multisensory interaction happen, can also be applied to the spatial dimension, and is most clearly put forward by the delineation of one’s peripersonal space – that is, the space adjacent to and immediately surrouding one’s body. My project aims at bridging the literature focusing on temporal binding windows and that of the representation of peripersonal space. I aim at drawing temporal, spatial, and spatio-temporal binding windows across space (with an emphasis on the depth dimension). Lastly, I also have an interest in exploring how these spatio-temporal perceptual filters are altered (or not) by conscious awareness. My work will be comprised of psychophysical and EEG studies in healthy adults, psychophysical work in ASD (collaboration with Cascio Lab), SZ (collaboration with Park Lab), and epileptic populations (collaboration with Gallagher Lab), as well as of ECOG and single-cell recordings in human (Vanderbilt Neurosurgeory – Dr. Neimat and Dr. Harvey).
The Development of Multisensory Processes. Research in this area seeks to better characterize how multisensory circuits mature during early postnatal life. The approaches used for this work range from single neuron electrophysiology to psychophysics and event related potentials (ERPs) in children.
Experiential Plasticity in Developing and Adult Multisensory Circuits. Works seeks to better understand how early sensory experience shapes developing multisensory circuits, and the surprising degree of plasticity that can be enabled in adult representations.
Spatiotemporal Receptive Field Organization and Multisensory Integration. Ongoing research in the lab seeks to describe the complex receptive fields that characterize multisensory neurons in both cortical and subcortical structures, and to describe how this receptive field architecture influences the multisensory processing capabilities of these neurons.
A Multisensory Framework for Developmental Dyslexia. In prior work we have shown that alterations in multisensory temporal processes may be associated with the prevalent reading disability - developmental dyslexia. Current work seeks to extend this finding and better elucidate the affected brain circuits.
Altered Multisensory Processes in Autism Spectrum Disorder. New research in the lab seeks to better characterize sensory and multisensory processing in children with autism spectrum disorder.