Reading presents a significant challenge for individuals who are born deaf because they cannot hear the language that is encoded by print. The factors that lead to skilled reading for deaf individuals are currently under debate and not well understood. This project uses behavioral, neurophysiological, and neuroimaging measures to identify what factors predict variations in the brain’s response when deaf adults read and recognize written words (e.g., spelling ability, phonological awareness, signing ability, reading speed).
The brain bases of reading in deaf adults
These studies are designed to examine brain functions during reading for deaf people who are bilingual in English and American Sign Language and to understand how the brain systems that support reading are shaped by deafness, e.g., by the changes in visual attention and phonological abilities that result from congenital hearing loss. We use both functional magnetic resonance imaging (fMRI) and electrophysiological measures (EEG/ERP) to investigate neural systems that support reading, fingerspelling, and signing in deaf individuals. We are addressing the following questions:
- What is the neural-behavioral signature for highly skilled deaf readers?
- Does deafness impact the neural response to visually presented words?
- Can we de-couple effects of deafness from effects of low literacy on reading behavior?
- Does fingerspelling engage the Visual Word Form Area?
- How does knowledge of ASL impact word reading?
Eyetracking studies of deaf readers
Eye movements provide very good clues to how people read words and text. Our lab is now equipped with an Eyelink 1000+ (from SR-Research) eyetracking system which will allow us to determine with great precision where the eyes move when comprehending written text or when viewing sign language. Using this technology, we can ask the following questions:
- Do deaf and/or hearing signers activate ASL when they read English text?
- Do young deaf readers have a wider perceptual span (region of effective vision) during reading, relative to young hearing readers?
- Which visual and linguistic processes do skilled deaf readers use during written word processing?
- Do native signers (hearing or deaf) activate English when they process sign language?
Recent work with adult and young deaf readers show that skilled deaf readers’ eye movements when they read simple sentences are very different that those of hearing readers of comparable reading skills. Deaf readers are more efficient when they read sentences compared to hearing readers with equal comprehension levels. For example, skilled deaf readers make fewer fixations in a sentence. This means that each time their eyes land on a word (called a “fixation”), skilled deaf readers are able to grab more information within that fixation. Skilled deaf readers also go back in the text (reread) less often than hearing readers do. This shows that even if deaf readers make fewer fixations than hearing readers do, they also do not need to go back in the text as often as their hearing counterpart to check their comprehension. In other words, they are “efficient” readers. Some of our upcoming projects will investigate why we find these unique and efficient eye movements in deaf readers.
This project is funded by the National Science Foundation Linguistic Programs (BCS 1154313) and Cognitive Neuroscience Program (BCS 1439257), and National Institute of Deafness and Other Communication Disorders (R01 DC014246)
- Glezer, L. S., Weisberg, J., Farnady, C. O., McCullough, S., Midgley, K.J., Holcomb, P.J., & Emmorey, K. (2018). Orthographic and phonological selectivity across the reading system in deaf skilled readers. Neuropsychologia, 117, 500-512.
- Meade, G., Grainger, J., Midgley, K., Emmorey, K., & Holcomb, P. (2018). From sublexical facilitation to lexical competition: ERP effects of masked priming. Brain Research, 1685, 29-41.
- Emmorey, K., Midgley, K.J., Kohen, C., Sevcikova Sehyr, Z., & Holcomb, P.J. (2017). The N170 ERP component differs in laterality, distribution, and association with continuous reading measures for deaf and hearing readers. Neuropsychologia, 106, 298-309.
- Meade, G., Midgley, K., Sevickova Sehyr, Z., Holcomb, P., & Emmorey, K. (2017). Implicit co-activation of American Sign Language in deaf readers: An ERP study. Brain and Language, 170, 5061. Click to request PDF
- Mehravari, A., Emmorey, K., Prat, C., Klarman, L., & Osterhout, L. (2017). Brain-based individual difference measures of reading skill in deaf and hearing adults. Neuropsychologia, 101, 153-168. Click to request PDF
- Emmorey, K., McCullough, S., & Weisberg, J. (2016). The neural underpinnings of reading skill in deaf adults. Brain and Language, 160, 11-20.
- Sevcikova Sehyr, Z., Petrich, J., & Emmorey, K. (2016). Fingerspelled and printed words are recoded into a speech-based code in short-term memory. Journal of Deaf Studies and Deaf Education.
- Emmorey, K., McCullough, S., & Weisberg, J. (2015). Neural correlates of fingerspelling, text, and sign processing in deaf ASL-English bilinguals. Language, Cognition, and Neuroscience, 30(6), 749-767. Click to request PDF
- Emmorey, K., Weisberg, J., McCullough, S., & Petrich, J. A. F. (2013). Mapping the reading circuitry for skilled deaf readers: An fMRI study of semantic and phonological processing. Brain and Language, 126, 169-180.
- Emmorey, K. (2019). The plasticity of the reading circuit. Keynote speaker at the 5th International Conference on Cognitive Hearing Science for Communication, June, Linköping, Sweden.
- Lee, B., Mirault, J., Bélanger, N., & Emmorey, K. (2019). No pronounceability effects during sentence reading by deaf and hearing readers. Poster presented at the meeting of Sign Language Linguistics Society (TISLR13). September, Hamburg, Germany. (pdf)
- Massa, N., Emmorey, K., Midgley, K.J., & Holcomb, P.J. (2019). Tracking the time-course of visual word recognition using different types of word-like stimuli. Poster presented at the Cognitive Neuroscience Society, March, San Francisco. (pdf)
- Zimman, H., Osmond, S., Emmorey, K., Midgley, K.J., & Holcomb, P.J. (2019). Preliminary ERP evidence in different rapid feedforward orthographic and phonological masked-priming effects. Poster presented at the Cognitive Neuroscience Society, March, San Francisco. (pdf)
- Emmorey, K. (2018). The neural biology of reading differs for deaf and hearing adults. Keynote talk given at the Workshop on reading, language, and deafness (WoRLD), October, San Sebastian, Spain.
- Osmond, S., Winsler, K., Meade, G., Holcomb, P.J., Midgley, K.J., & Emmorey, K. (2018). Frequency, orthographic neighborhood, and concreteness effects in deaf readers of English: an ERP study. Poster presented at the Society for the Neurobiology of Language, August, Québec City, Canada. (pdf)
- Holcomb, P., Meade, G., Midgley, K., Grainger, J., & Emmorey, K. (2018). ERP masked repetition priming in deaf and hearing readers. Paper presented at the International Psychonomic Society Meeting, May, Amsterdam, The Netherlands.
- Glezer, L, Midgely, K. J., Emmorey, K., & Holcomb, P.J. (2018). ERPs reveal early feedforward orthographic and phonological selectivity during single word reading. Poster presented at the Cognitive Neuroscience Society Meeting, March, Boston, MA.
- Mickelson, S., Nadalet,L., Mott, M., Midgley, K., Holcomb, P., Emmorey, K., & Ries, S. (2018). Language output monitoring in sign production: an electroencephalography study. Poster presented at the Cognitive Neuroscience Society Meeting, March, Boston, MA.
- Sevcikova Sehyr, Z., Renna, J., Midgley, K., Emmorey, K., & Holcomb, P. (2018). Orthograpic priming by fingerspelled and printed letters. Poster presented at the Cognitive Neuroscience Society Meeting, March, Boston, MA.