Sign language processing is the set of cognitive and neural operations by which a person perceives, recognizes, interprets, formulates, and produces a natural signed language. Its psycholinguistics examines how visible linguistic signals become meaningful utterances: how handshape and motion contribute to lexical recognition, how facial and bodily articulations convey grammatical structure, how spatial references support discourse, and how signing recruits language networks in the brain. Research on signed languages demonstrates that language can be organized and comprehended through vision and action while relying on many of the same abstract linguistic capacities observed in spoken-language processing. Emmorey (2021); Trettenbrein et al. (2021).
The central scientific question is how general mechanisms of language interact with the possibilities and constraints of the visual–manual modality. Recognition requires rapid interpretation of dynamic visual forms. Comprehension draws on lexical knowledge, grammar, context, discourse, and prediction. Production transforms communicative intentions into coordinated movements of the hands, face, head, and body. A natural sign language provides a particularly informative case because multiple articulators can convey distinct linguistic information simultaneously. Fischer (2017); Pfau and Quer (2010).
What Psycholinguists Mean by a Sign Language
Natural languages expressed through vision and movement
American Sign Language (ASL), British Sign Language (BSL), German Sign Language (DGS), Israeli Sign Language (ISL), and many other signed languages are natural linguistic systems sustained by communities. They have conventional lexicons, structured patterns of combination, constraints on acceptable forms, productive grammatical resources, and opportunities for creative expression. Their grammars differ from one another. ASL and BSL, for instance, are distinct languages; geographic proximity or a shared ambient spoken language does not establish a shared sign language. General claims about sign language must be evaluated against the specific languages studied. Fischer (2017).
A sign language is a language that can be acquired through accessible interactions, used for conversation and scholarship, and analyzed at phonological, morphological, lexical, syntactic, semantic, and pragmatic levels. The term phonology in this setting concerns organized sublexical contrasts, not sound itself. The term articulator includes hands, facial regions, the head, and the body. These definitions allow comparison across modalities without assuming that every feature of spoken language has a one-to-one signed equivalent. Emmorey (2021).
Sign language, co-speech gesture, and manually coded speech
Co-speech gestures accompany spoken discourse and often contribute meaning through pointing, depiction, or movement. A natural sign language possesses a conventional linguistic system that supports communication in its own right. Manually coded systems may represent selected elements of a spoken language using hand signs; their linguistic organization depends on the particular system. Fingerspelling, meanwhile, uses a manual alphabet to represent letter sequences within a signed-language repertoire and may become integrated into conventional lexical forms. These categories are analytically distinct even though they interact in actual communication. Emmorey et al. (2008); Emmorey (2021).
The distinction matters experimentally. A study of arbitrary manual movements measures visual action recognition; a study of conventional signs in fluent signers can examine language representations. Studies of non-signers who guess a sign from its visual resemblance to an object address iconicity and inference more directly than established lexical access. Researchers should describe which population, language, stimulus type, and task they investigated before drawing conclusions about linguistic processing.
The Visual–Manual Signal and Linguistic Form
Handshape, location, movement, orientation, and coordination
Signs are built from combinations of systematically organized form properties, commonly including handshape, location, movement, and palm orientation, together with relevant nonmanual articulations. Changing one property can distinguish lexical forms. These dimensions interact over time and are shaped by the phonological conventions of a particular language. A signer must identify relevant information in motion despite variation in speed, viewpoint, body size, signing style, and surrounding context. Emmorey (2021); Meade et al. (2022).
A useful comparison is spoken-word recognition. Speech comprehension maps a temporally variable acoustic stream onto linguistic categories; sign comprehension maps temporally variable visual trajectories and configurations onto linguistic categories. Both require abstraction across irrelevant physical variation, while their perceptual computations differ. Visual location and handshape may be perceived with different temporal constraints from acoustic segments, and multiple visible components can overlap within one sign. This is a comparison of functional problems rather than an assertion that a sign corresponds directly to a spoken word or syllable.
Simultaneity, sequencing, and coarticulation
Signed utterances unfold sequentially, but the face, hands, head, and body can contribute information at overlapping times. One manual configuration may coexist with a facial marking that extends over a phrase; one referential locus in signing space may remain meaningful across several clauses. Coarticulation occurs when neighboring signs influence the movement and positioning of articulators. The perceptual system must distinguish meaningful contrasts from predictable transitions between successive forms. A model that segments every visible frame into an isolated sign risks losing the relations that make the utterance grammatical. Pfau and Quer (2010); Wilbur (2022).
The linguistic status of facial expression
Facial and bodily movements contribute to signed language in several ways. Some express affect and interpersonal stance. Others form conventional linguistic markings related to question type, negation, information structure, prosodic organization, or reported perspective, depending on the language and construction. The duration, alignment, distribution, and recurrence of a movement help determine its linguistic role. Researchers debate whether particular nonmanual patterns are best analyzed as syntactic, prosodic, pragmatic, or combinations of these functions. The distinction should be evaluated empirically instead of assigning all facial activity one grammatical label. Pfau and Quer (2010); Wilbur (2022).
How Signers Recognize Individual Signs
Visual analysis and lexical activation
Lexical recognition begins with dynamic sensory evidence, but successful comprehension requires stored knowledge of conventional sign forms and their meanings. Partially perceived features may activate more than one possible lexical candidate; contextual and form-based information then constrain interpretation. The exact time course and competitive structure of these processes are subjects of experimental modeling. Work with deaf children acquiring ASL demonstrates sensitivity to semantic and phonological relationships among signs, supporting the psychological reality of multiple interacting representational levels. Lieberman and Borovsky (2020).
A signer's mental lexicon must encode more than a picture of each gesture. It supports recognition across variable signers, sign rates, and contexts, links lexical forms with grammatical information, and can interact with knowledge of additional languages. Researchers study these representations through reaction times, recognition errors, semantic judgments, picture–sign matching, and brain responses. A fast response establishes a task effect; inferring a particular representational stage requires experiments that separate plausible alternatives.
Phonological similarity and priming
Signs may resemble one another in handshape, location, or movement without sharing meaning. Such overlap allows experiments on form priming: the recognition of a target sign is compared following a form-related versus unrelated prime. A central methodological difficulty is that visually overlapping stimuli can benefit from ordinary perceptual repetition as well as from linguistic preactivation. Electrophysiological research explicitly tests this distinction, cautioning against treating all form-priming effects as pure evidence of phonological processing. Meade et al. (2022).
Lexical competition also depends on how a task presents signs. Isolated sign clips, continuous narratives, and live face-to-face signing differ in segmentation cues and contextual support. Non-signers provide useful controls for perceptual overlap, but differences in attention and familiarity complicate simple subtraction. The strongest inference combines behavioral contrasts with temporal brain measures and convergent evidence across languages and fluent-signing populations.
Semantic access, ambiguity, and context
Recognizing a conventional form gives access to semantic information that can be refined by discourse. A referential sign may be interpreted against earlier spatial assignments; a depicted action may need context to identify its agent or perspective. Ambiguity can therefore occur at several levels: lexical alternatives, attachment of grammatical material, and identification of discourse referents. Sign-language comprehension offers a way to study how visual evidence interacts with the linguistic expectations already established by a conversation. Fischer (2017).
Eye Movements and Visual Attention During Signing
Why experienced signers look at the face
Sign-language comprehension requires attention to a distributed visual signal. Looking directly at every hand movement would disrupt access to the face and broader signing space. In an early eye-tracking study, both deaf native and hearing beginning ASL signers primarily fixated the face during live narratives, but native signers tended to fixate nearer the eyes while beginners fixated nearer the mouth. The small samples—nine native and ten beginning signers—make the exact proportions context-dependent; the study offers evidence for different attentional strategies, not a universal gaze rule. Emmorey, Thompson, and Colvin (2009).
Peripheral visual processing can supply information about hand motion while gaze remains on facial articulations. Occasional shifts toward the hands may coincide with spatially complex depictions or the signer's own attention cues. The relation among expertise, central fixation, visual field, and perceptual load remains method-sensitive. Video framing, screen size, the visibility of the whole body, and whether the participant watches a person or an avatar affect what the experiment can measure.
Prediction and attentional allocation
Comprehenders can use linguistic and situational information to anticipate upcoming content. In a signed sentence, the spatial arrangement of referents, an emerging manual configuration, or a facial prosodic contour may constrain possible continuations. Predictive processing is a family of models rather than one settled mechanism. Anticipatory eye movements show how expectations shape attention in a given task, whereas evidence of an internal probabilistic code requires additional assumptions and tests. A research design should separate familiarity with the content from inference based on visual linguistic structure.
Video and laboratory ecology
Researchers often prefer carefully controlled videos because the same motion can be shown to many participants. Yet editing or cropping can remove information that fluent interlocutors normally use. Frame rates, color contrast, camera orientation, lighting, facial visibility, and sign onset/offset definitions all influence timing measures. Ecological validity improves when controlled video findings are compared with natural narratives and interactive signing. Importantly, the native signing experience of participants is part of the task design, not merely a demographic footnote.
Grammar and the Construction of Meaning
Morphology and productive form–meaning relations
Signed-language morphology can use movement, repetition, directional modification, spatial placement, and configurations involving multiple articulators to express distinctions that are meaningful in a given language. Some constructions are highly conventional; others allow gradient or depicting variation. Researchers distinguish lexicalized signs from productive modifications by examining distribution, conventionality, semantic composition, and constraints across signers. The presence of an iconic-looking form alone establishes neither its grammatical category nor its cognitive processing route. Fischer (2017); Perniss, Thompson, and Vigliocco (2010).
Syntax: structure beyond a sequence of gestures
Signed languages combine words and phrases into hierarchically structured propositions. Researchers analyze clause structure, constituent order, argument relations, embedding, relative clauses, conditionals, and interrogatives. Crosslinguistic work finds genuine grammatical diversity: a pattern established for ASL cannot automatically be transferred to a language such as Japanese Sign Language or Brazilian Sign Language. Word order interacts with discourse structure and nonmanual marking, and spatial strategies may encode relations not expressed in the same way by spoken languages. Fischer (2017).
A comprehension experiment must distinguish syntactic knowledge from plausibility. A participant may correctly interpret a sentence using event expectations even when a particular grammatical contrast is unfamiliar. Conversely, a temporary misinterpretation may reflect processing cost rather than an inability to represent the structure. Carefully matched sentences, signed by fluent producers and validated by community experts, help identify which linguistic manipulation caused the effect.
Spatial reference and discourse tracking
Signers can use locations within signing space to establish and revisit discourse referents. A later pointing or directional form may then retrieve a previously assigned entity, making spatial reference part of language comprehension. This is a linguistic use of perceived and constructed space, not a claim that every direction maps literally to physical location. The same utterance may coordinate referential loci, physical topography, and enacted perspective. Distinguishing these representational functions is essential when studying memory for discourse or referential ambiguity. Fischer (2017).
Prosody, rhythm, and boundaries
Signed languages organize utterances into prosodic constituents, signaled through timing, holds, movement transitions, and configurations of the face and body. Prosodic boundaries can help a comprehender group linguistic material, signal information structure, and interpret relationships among clauses. Scientific disagreement concerns the exact division of labor among syntax, prosody, and pragmatics and the degree to which spoken-language terminology transfers to visual language. Research on signed prosody supports systematic rhythmic phrasing while identifying unresolved questions about intonation-like structures. Wilbur (2022); Pfau and Quer (2010).
Role shift, depiction, and reported perspectives
A signer may adopt a character's perspective with coordinated changes in body orientation, gaze, facial expression, and manual activity. Researchers examine these phenomena under analyses such as role shift, constructed action, and reported discourse. Some patterns involve conventional linguistic constraints; others interface with performance and depiction. This makes signed narratives valuable evidence for how grammar, perspective-taking, and discourse interpretation are coordinated, while leaving room for competing accounts of particular constructions. Fischer (2017).
Iconicity and the Recognition of Meaning
What iconicity contributes
An iconic sign has some motivated resemblance between its form and an aspect of its meaning. Visual–manual expression affords many possibilities for depicting shape, motion, spatial relation, and embodied activity. Iconicity also occurs in spoken languages through sound symbolism and other motivated mappings; the balance of forms differs across languages and modalities. A sign may be highly iconic to a fluent user but opaque to a person unfamiliar with its cultural or lexical conventions. Iconicity is therefore graded and dependent on the chosen measure. Perniss, Thompson, and Vigliocco (2010).
Does iconicity make a sign easier to learn?
The evidence is conditional. A review of first- and second-sign-language acquisition found facilitation in some contexts and null or detrimental effects in others. Iconic resemblance can help connect a form with its conceptual referent while making it harder to encode the exact phonological configuration. Age, familiarity, type of iconic mapping, semantic transparency, and whether the experiment measures meaning or accurate production help explain seemingly conflicting outcomes. Ortega (2017).
Recent experiments strengthen the need for a more precise taxonomy of iconicity. A 2024 event-related-potential study separated perceptually iconic from motorically iconic signs and reported different lexical-access patterns, rather than one uniform iconicity benefit. This establishes an experimentally productive distinction for specific stimuli and participants; replication across additional signed languages and learning histories is needed before broad generalization. McGarry et al. (2024).
Why iconicity does not replace grammar
An iconic connection can make a form interpretable, but conventional linguistic competence includes stored contrasts, combinatorial structure, and constraints on contextual use. Different languages may select different depictions or lexical conventions for the same event. A non-signer's successful guess of a highly iconic sign is therefore a different outcome from fast sentence comprehension by a fluent signer. Psycholinguistics studies how iconicity contributes to a functioning language system rather than treating resemblance as the entire explanation of signing. Ortega (2017).
Production: From Meaning to Coordinated Signing
Conceptualization and lexical selection
Producing a signed utterance involves selecting a communicative message, deciding how to structure it, retrieving lexical items, and planning their articulatory forms. These operations can be investigated using picture naming, semantic interference, delayed production, and error analysis. The distinction between lexical meaning and a sign's articulatory form is supported by experiences analogous to word-retrieval failures and by systematic sign-production errors. Such parallels constrain theories of lexical access while preserving the obvious differences between manual and vocal execution. Emmorey (2021).
Phonological encoding and motor execution
A fluent signer coordinates the timing of handshape, movement, and location with other articulations. Production errors can preserve some features of the intended sign while altering others. This provides evidence that sign forms are internally structured rather than retrieved only as indivisible motor routines. The same observed error can, however, arise at planning or execution stages, and temporal or kinematic evidence is needed to differentiate them. The neurobiology of sign production connects cortical language-related regions with sensorimotor networks supporting the visual–manual output system. Emmorey (2021).
Monitoring and interactive adjustment
Signers can monitor their own visible movements, use feedback from an interlocutor, repair misunderstandings, and adapt signing rate or lexical choice. Feedback is multimodal: a recipient's gaze and face may indicate whether reference has been established, while the signer's own sensorimotor control guides movement. The extent to which specific monitoring models from spoken-language production generalize to signing is open to direct tests. Interactional findings should be separated from isolated laboratory production measures.
The Neural Systems of Sign Language
A language network that crosses sensory modalities
Evidence from neurological patients, functional imaging, and electrophysiology shows substantial overlap between the cortical networks engaged by signed and spoken languages. An activation-likelihood-estimation meta-analysis of 23 neuroimaging studies including 316 participants reported left-lateralized recruitment within a broader bilateral network during sign-language comprehension, especially involving left inferior frontal regions. Its authors interpreted that convergence as evidence for important supramodal linguistic computations. The synthesis does not imply that neural activity is identical across modalities or that every region has a single linguistic function. Trettenbrein et al. (2021).
Visual and movement-specific recruitment
Signed language necessarily recruits visual-processing and action-related resources in ways that differ from speech perception. At higher levels, processing lexical and sentence meaning relies on systems that operate across sensory routes. Neurobiological reviews report both cross-modal convergence and modality-sensitive specialization, including networks involved in visual motion, faces, fingerspelling, and sign articulation. A complete explanation must connect levels of representation rather than replacing psycholinguistic categories with a map of activated regions. Emmorey (2021).
Deafness, sign experience, and language history
Deafness, experience with a natural signed language, and the age at which accessible linguistic input began are different variables. Hearing native signers and deaf native signers can share linguistic experience while differing in auditory history. Deaf signers who acquired a language later may differ in early language access from deaf children raised in signing environments. Neuroimaging findings that compare groups without attending to these histories can confound sensory experience with language proficiency, schooling, or bilingualism. Research on hearing bimodal bilinguals helps separate some of these factors. Emmorey and McCullough (2009).
What neuroimaging can and cannot establish
An fMRI contrast identifies differences in blood-oxygen-related activity under particular task conditions. It does not directly reveal a symbolic grammar or prove that an activated area exclusively implements a named cognitive function. Meta-analytic convergence increases confidence in recurrent patterns but remains affected by the composition of included studies, task heterogeneity, and reporting practices. Causal inferences about necessity require complementary evidence, including lesions, stimulation, and convergent behavioral dissociations. Trettenbrein et al. (2021).
How Children Acquire Signed Languages
Early accessible input and developmental milestones
Children with consistent access to fluent signing from infancy acquire natural signed languages through social interaction. Reviews find major developmental parallels with spoken-language acquisition, including early sensitivity to language, gradual acquisition of vocabulary and combinatorial structures, and learning from repeated meaningful interactions. The modality also introduces distinctive opportunities for visual iconicity, spatial reference, and visibly coordinated articulators. These observations support an early human capacity for language acquisition that can develop through different sensory channels. Lillo-Martin and Henner (2021).
Age of first-language access
The age of exposure to accessible linguistic input matters especially for first-language development. Many deaf children are born into environments where the surrounding spoken language is not fully accessible, and fluent signed-language input may begin later. Reviews associate earlier access with better linguistic outcomes, while observing substantial variation and limitations in historical cohorts and participant samples. Age of first accessible language, age of first exposure to a particular signed language, age at hearing intervention, and quality of daily interaction should be recorded separately. Lillo-Martin and Henner (2021).
Language deprivation as a developmental concern
When a child lacks dependable access to any usable natural language during important developmental periods, language development may be constrained. This is a concern about access to language, not a property of sign language or of deaf identity. Reviews and developmental commentary describe adverse risks of delayed accessible input and advocate attention to language-rich environments. Findings on cognition must control for family circumstances, education, hearing technology, linguistic histories, and assessment methods. This psycholinguistic discussion does not constitute individual clinical evaluation or guidance about a specific intervention. Hall (2017); Lillo-Martin and Henner (2021).
One study comparing deaf native-signing children from deaf families with a hearing comparison group found broadly age-appropriate parent-rated executive functioning among the native signers. This result helps challenge simple interpretations that equate reduced auditory input with generalized cognitive impairment, but its observational design and specific samples cannot settle every developmental mechanism. Hall et al. (2017).
Learning a second signed language
People learning a signed language later in life must acquire unfamiliar visual categories, lexical forms, and spatial constructions while using learning systems already shaped by other language experiences. Meaning can become accessible before precise production of handshapes or movement contrasts. ERP research published in 2024 examined the development of neural indicators of lexical integration during novel sign vocabulary learning, reporting a differentiated progression of semantic and form-related responses. Laboratory vocabulary acquisition provides a controlled window into mechanisms, though it does not equal conversational fluency. Gimeno-Martínez, Gutierrez-Sigut, and Baus (2024); Ortega (2017).
Sign Language, Bilingualism, and Multiple Language Modalities
Bimodal bilingual processing
Some people know both a signed language and a spoken language. Because the languages use partly different production channels, an individual may sometimes speak and sign simultaneously. Research on ASL–English bilinguals identified code-blending in which spoken words and signs were produced together, providing a distinctive test of how lexical representations and messages are selected across languages. Results from specific hearing bilingual samples should be interpreted in relation to proficiency, conversational context, and the linguistic compatibility of the two utterances. Emmorey et al. (2008).
Languages can interact without becoming identical
Bilingual signing can involve cross-language activation, translation, fingerspelling, borrowing, and context-dependent choices, as in other forms of multilingual use. Distinct input–output modalities alter possibilities for simultaneous expression but do not erase grammatical differences between languages. Studies of code-blending may inform the relationship between conceptual planning and linguistic formulation; they do not establish that every bilingual signer uses both languages in the same way. Emmorey et al. (2008).
Sign languages and literacy
Signed-language competence and reading competence engage related but distinguishable abilities. Written English, for instance, represents an English-language orthographic system and is not simply a transcription of ASL grammar. A signer may acquire literacy in a surrounding spoken/written language through varying educational trajectories. Interpreting reading performance therefore requires attention to exposure, accessible instruction, vocabulary, orthography, and the specific literacy task. A complete account of dyslexia or a reading disability belongs to the relevant independent clinical and literacy research literature rather than being inferred from signing behavior alone.
Language Emergence and the Structure of Human Learning
Evidence from Nicaraguan Sign Language
The emergence of Nicaraguan Sign Language has supplied evidence about how language regularities can arise and develop within a community. A landmark study compared successive cohorts and described increasingly systematic segmentation and sequencing of motion-event information in signing. These patterns offer evidence that social transmission and children's learning reshape linguistic structure over time. They should be interpreted in light of a unique historical setting rather than presented as a universal experimental replication of language emergence. Senghas, Kita, and Özyürek (2004).
What emerging languages show about modality and convention
When people interact repeatedly, communicative forms can become conventionalized, recombined, and reorganized. The visual–manual modality creates salient routes for depiction and spatial organization, while repeated use can establish stable grammatical contrasts beyond immediate depiction. These observations help disentangle iconic affordances from learned conventions. Theoretical debates continue over the relative contributions of general learning, social interaction, linguistic structure, and the historical composition of signing communities. Senghas, Kita, and Özyürek (2004).
Experimental Methods and Evidence Quality
Reaction times, accuracy, and lexical decisions
Timed tasks can measure recognition of signs, matching of signs with pictures, and the effects of semantic or phonological primes. Accuracy and response latency provide related but distinct measurements. Researchers must validate the naturalness of sign stimuli and control visual complexity, iconicity, movement duration, familiarity, and frequency. Response speed should not be interpreted as a clean measure of one lexical stage when perceptual or motor demands differ between conditions. Meade et al. (2022).
Eye tracking and natural comprehension
Eye tracking records gaze position during continuous signing. It can identify patterns of attention to the face, mouth, eyes, and signing space, and can assess the timing of gaze shifts relative to linguistic events. Studies require transparent decisions about areas of interest and gaze-tracking loss, and their claims are limited by the display and interaction conditions. Small-sample designs are particularly valuable for hypothesis generation but demand replication before population-wide claims. Emmorey, Thompson, and Colvin (2009).
EEG, ERP, and time-sensitive inferences
Electroencephalography and event-related potentials offer millisecond-scale information about brain responses to signed stimuli. An N400-related effect may indicate sensitivity to semantic expectations or related processing variables, depending on contrast and task. The existence of a response difference does not directly identify a unique linguistic computation. Studies combining careful visual controls with language-specific manipulations are especially valuable for testing when meaning and form information become available. Meade et al. (2022); Gimeno-Martínez, Gutierrez-Sigut, and Baus (2024).
fMRI, neuropsychology, and convergent designs
Functional imaging maps task-sensitive networks; patient studies examine associations between injury and linguistic performance; neurophysiological and behavioral methods characterize timing and processes. Their combined interpretation is stronger than one method used in isolation. Deafness, age of language access, language proficiency, and task demands should be explicitly modeled. Multisite comparisons and shared stimulus norms can help separate population differences from laboratory conventions. Trettenbrein et al. (2021).
Corpus and computational methods
Video corpora permit analysis of lexical frequency, variation, prosodic timing, coarticulation, and discourse in natural settings. Annotation must account for simultaneous tracks of hand activity and nonmanual markers, and for possible disagreements about segmentation. Automated sign recognition may learn statistical correlations in videos, but robust language understanding requires attention to referential context, variation across signers, depiction, and grammatical structure. A model's recognition accuracy on a benchmark establishes performance under that benchmark's conditions; it does not by itself demonstrate humanlike comprehension, community competence, or subjective experience.
Findings, Disagreements, and Scientific Boundaries
Established findings
The literature establishes that natural signed languages have structured lexicons and grammars, that their acquisition can unfold with early accessible input, and that fluent comprehension recruits language-related cortical networks alongside visual and sensorimotor systems. It also establishes that signed-language processing uses both sequential and simultaneous visible cues and that facial and bodily components can carry linguistic information. These conclusions rest on convergent linguistic descriptions, developmental observations, behavioral experiments, and brain studies. Fischer (2017); Lillo-Martin and Henner (2021); Trettenbrein et al. (2021).
Limited and contested findings
Claims about one universal path of sign recognition, the exact processing advantage of iconicity, the best representation of spatial reference, and a single division between syntax and prosody remain sensitive to language, task, and theoretical assumptions. Neural overlap supports modality-general language capacities but leaves open the precise computational role of many cortical regions. Evidence from native signers, late learners, and hearing bilinguals cannot be treated as interchangeable. Ortega (2017); Wilbur (2022); Emmorey (2021).
Sampling and representativeness
Psycholinguistic research has historically focused on a limited set of relatively well-studied signed languages and accessible recruitment networks. Results may overrepresent highly proficient adult signers, certain educational histories, and specific national contexts. Individual differences include age of acquisition, dialect, fluency, additional languages, access to schooling, visual attention, and familiarity with laboratory videos. Stronger generalization requires crosslinguistic replication, collaboration with Deaf communities, and explicit reporting of language histories.
Boundaries with clinical and communication research
Hearing status is a sensory characteristic; sign-language proficiency is a linguistic ability; a diagnosed language disorder requires its own clinical criteria and appropriate assessment. An error in a laboratory sign-recognition task is not a diagnosis. Aphasia in a signer, developmental language disorder, dyslexia, and other conditions warrant domain-specific clinical investigation with tools suited to the individual's language history and accessible modality. Social communication and interpersonal conflict also constitute independent fields of inquiry, even when signing is the medium used in a conversation.
Practical Implications
Research and education
Teaching and assessment should recognize complete linguistic structure in the visual modality. A learner's mastery of meaning, lexical form, grammatical marking, and discourse may develop at different rates, so one measure of sign imitation cannot stand in for language competence. Experimental findings also underscore the importance of meaningful, accessible input and respectful use of community language norms. Developmental planning belongs in partnership with qualified educators, language specialists, families, and Deaf stakeholders. Lillo-Martin and Henner (2021).
Interpreting and accessible media
Real-world comprehension depends on seeing a signer's relevant articulators, timing, face, and signing space. A presentation format that obscures facial expression or cuts off hands may remove meaningful information even when a transcript remains available. Interpreting involves linguistic and discourse decisions extending beyond isolated lexical substitution. Design choices for video accessibility should be evaluated with fluent users of the particular signed language, since a universal visual template cannot capture every conversational or grammatical context.
Artificial systems and the Artificial Era
Automatic sign-language technologies increasingly analyze video and generate visible outputs. Their evaluation should separate sign detection, isolated lexical classification, continuous recognition, translation into another language, syntactic interpretation, and interactive communication. These tasks require different evidence. Training corpora may omit nonmanual markers, underrepresent regional variation, or depend on annotations that flatten simultaneous information. Good benchmark performance is one technical result; evaluation of linguistic adequacy and social accessibility requires fluent signers and realistic discourse tasks. Questions about machine understanding and subjective experience constitute independent philosophical and scientific questions beyond a recognition score.
Frequently Asked Questions
Is sign language processed as language in the brain?
Yes. Behavioral, lesion, and neuroimaging evidence links natural signed-language comprehension to established language-related systems, including left frontotemporal areas, with additional engagement of visual and action-related regions. The balance varies by task and population. Trettenbrein et al. (2021); Emmorey (2021).
Does every country have a single sign language?
No. Signed languages develop in language communities and show linguistic and regional diversity. They are not direct manual versions of the ambient national spoken language. Crosslinguistic generalization requires identifying the actual language and construction studied. Fischer (2017).
Do signers look mainly at hands or faces?
Experienced signers commonly maintain gaze near the face while using a broader visual field to perceive manual activity, although strategies depend on the task and stimulus. An early eye-tracking experiment found primary face fixation in both native and beginning signers, with meaningful differences in where on the face they looked. Emmorey, Thompson, and Colvin (2009).
Are sign languages entirely iconic?
No. Iconicity is one important form–meaning relation among conventional linguistic representations. Its contribution varies across signs and across tasks, and learning an accurate sign form can be difficult even when its meaning is visually transparent. Ortega (2017).
Can children acquire sign language as a first language?
Yes. Children with early access to fluent signing acquire natural signed languages through language-learning processes that show broad parallels with early spoken-language acquisition. Early, accessible input is particularly important when spoken input is perceptually inaccessible. Lillo-Martin and Henner (2021).
Is fingerspelling the same as a sign language?
Fingerspelling is a manual representation of letters that can be integrated into signed-language vocabulary and discourse. A natural signed language also has lexical signs, grammar, nonmanual structure, and broader communicative conventions. Emmorey (2021).
What does sign language reveal about human cognition?
It shows that sophisticated linguistic representations and computations can operate through a visual–manual channel, helping researchers distinguish general language mechanisms from perceptual and motor constraints specific to speech. The strongest inferences come from comparisons that respect differences among languages, participants, and experimental tasks. Trettenbrein et al. (2021).
Related Articles
Cluster Language, Thought and Psycholinguistics — The comprehensive research chapter connecting language comprehension, production, acquisition, thought, and multimodal processing.
Psycholinguistics: How Language Is Processed in the Mind — Foundational models of lexical access, sentence interpretation, and language production.
Language Processing in the Brain: Cognitive Networks and Neural Systems — Neural networks and methods that clarify both shared and modality-sensitive components of language.
Psycholinguistic Research Methods: How Scientists Study Language Processing — Experimental designs, temporal measures, and limitations of inference.
First Language Acquisition: How Children Learn to Understand and Speak — A related, independently owned account of foundational language learning.
Conversation Turn-Taking: How Speakers Coordinate Dialogue — Coordination of timing, attention, and communicative exchange.
References
Emmorey, K. (2021). New perspectives on the neurobiology of sign languages. Frontiers in Communication, 6, 748430. https://doi.org/10.3389/fcomm.2021.748430
Emmorey, K., Borinstein, H. B., Thompson, R., and Gollan, T. H. (2008). Bimodal bilingualism. Bilingualism: Language and Cognition, 11(1), 43–61. https://doi.org/10.1017/S1366728907003203
Emmorey, K., and McCullough, S. (2009). The bimodal bilingual brain: Effects of sign language experience. Brain and Language, 109(2–3), 124–132. https://doi.org/10.1016/j.bandl.2008.03.005
Emmorey, K., Thompson, R., and Colvin, R. (2009). Eye gaze during comprehension of American Sign Language by native and beginning signers. Journal of Deaf Studies and Deaf Education, 14(2), 237–243. https://doi.org/10.1093/deafed/enn037
Fischer, S. D. (2017). Crosslinguistic variation in sign language syntax. Annual Review of Linguistics, 3, 125–147. https://doi.org/10.1146/annurev-linguistics-011516-034150
Gimeno-Martínez, M., Gutierrez-Sigut, E., and Baus, C. (2024). Neural changes in sign language vocabulary learning: Tracking lexical integration with ERP measures. Brain and Language, 259, 105495. https://doi.org/10.1016/j.bandl.2024.105495
Hall, M. L., Eigsti, I.-M., Bortfeld, H., and Lillo-Martin, D. (2017). Auditory deprivation does not impair executive function, but language deprivation might: Evidence from a parent-report measure in deaf native signing children. Journal of Deaf Studies and Deaf Education, 22(1), 9–21. https://doi.org/10.1093/deafed/enw054
Hall, W. C. (2017). What you don't know can hurt you: The risk of language deprivation by impairing sign language development in deaf children. Maternal and Child Health Journal, 21, 961–965. https://doi.org/10.1007/s10995-017-2287-y
Lieberman, A. M., and Borovsky, A. (2020). Lexical recognition in deaf children learning American Sign Language: Activation of semantic and phonological features of signs. Language Learning, 70(4), 935–973. https://doi.org/10.1111/lang.12409
Lillo-Martin, D., and Henner, J. (2021). Acquisition of sign languages. Annual Review of Linguistics, 7, 395–419. https://doi.org/10.1146/annurev-linguistics-043020-092357
McGarry, M. E., et al. (2024). An ERP investigation of perceptual vs motoric iconicity in sign production. Neuropsychologia, 203, 108966. https://doi.org/10.1016/j.neuropsychologia.2024.108966
Meade, G., Lee, B., Massa, N., Holcomb, P. J., Midgley, K. J., and Emmorey, K. (2022). Are form priming effects phonological or perceptual? Electrophysiological evidence from American Sign Language. Cognition, 220, 104979. https://doi.org/10.1016/j.cognition.2021.104979
Ortega, G. (2017). Iconicity and sign lexical acquisition: A review. Frontiers in Psychology, 8, 1280. https://doi.org/10.3389/fpsyg.2017.01280
Perniss, P., Thompson, R. L., and Vigliocco, G. (2010). Iconicity as a general property of language: Evidence from spoken and signed languages. Frontiers in Psychology, 1, 227. https://doi.org/10.3389/fpsyg.2010.00227
Pfau, R., and Quer, J. (2010). Nonmanuals: Their grammatical and prosodic roles. In D. Brentari (Ed.), Sign Languages (pp. 381–402). Cambridge University Press. https://doi.org/10.1017/CBO9780511712203.018
Senghas, A., Kita, S., and Özyürek, A. (2004). Children creating core properties of language: Evidence from an emerging sign language in Nicaragua. Science, 305(5691), 1779–1782. https://doi.org/10.1126/science.1100199
Trettenbrein, P. C., Papitto, G., Friederici, A. D., and Zaccarella, E. (2021). Functional neuroanatomy of language without speech: An ALE meta-analysis of sign language. Human Brain Mapping, 42(3), 699–712. https://doi.org/10.1002/hbm.25254
Wilbur, R. B. (2022). Prosody in sign languages. Hrvatska revija za rehabilitacijska istraživanja, 58(Special Issue), 143–174. https://doi.org/10.31299/hrri.58.si.8