Psychology

Hand gestures reveal universal building blocks of visual communication

How the science connects

Nonverbal communic…GestureIconicity

AI Insight

This study examined how 38 Mandarin-speaking hearing non-signers combined different iconic gesturing strategies when asked to represent 246 concrete and abstract concepts without speech. The researchers found that concrete concepts more frequently elicited combinations of gestures than abstract ones, with sequential combinations being most common, followed by simultaneous and mixed structures. The study identified systematic patterns in how different iconic strategies were organized together, such as drawing and embodying gestures tending to precede acting gestures, and specific pairings occurring across both hands in simultaneous combinations.


The findings reveal that humans systematically organize visual-manual communication even without formal sign language training, suggesting universal cognitive principles for externalizing conceptual information. This has implications for understanding language emergence, developing gestural communication systems for populations with communication disorders, and informing human-computer interaction design.


Understand the Science

Nonverbal communication Concept coming soon Gesture Concept coming soon Iconicity Concept coming soon

Iconicity, understood as perceived resemblance between aspects of form and meaning, provides a central basis for representing conceptual information in the manual-visual modality. Previous research on silent gesture has shown systematic associations between semantic categories and particular iconic strategies, with several strategies sometimes used together to represent a concept. How these strategies are organized when they are used together, however, remains less well understood. Using an individually administered task adapted from an established silent gesture paradigm, we elicited silent gestures from 38 Mandarin-speaking hearing non-signers to represent 246 concepts spanning concrete and abstract conceptual categories. We examined how concreteness and conceptual category were related to the occurrence of combinations and how meaningful manual units were organized sequentially, simultaneously, or in mixed structures. Our results show that most manual productions contained a single meaningful unit. Concrete concepts were more likely than abstract concepts to elicit combinations overall and simultaneous-only combinations, while conceptual category was associated with all three organizational formats. Sequential combinations were the most frequent, with drawing and embodying tending to precede acting, while pointing and schema mapping tended to precede symbolic mapping. Simultaneous combinations were characterized by recurrent pairings across the hands, especially acting with embodying and representing with locating, and broader iconicity-type pairings varied across conceptual categories. Mixed combinations were rare but clustered in concepts that invited both temporal staging and bimanual integration. Our findings extend patterned iconicity beyond the selection of individual form-meaning mappings to the relations among multiple iconic depictions. They show that the manual-visual modality provides temporal and spatial resources through which conceptual relations can be externalized and systematically organized even in the absence of an established sign language system.

Source: Combinatorial structure of iconic strategies in the manual-visual modality: evidence from silent gestures by hearing non-signers