Title |
Differential Gaze Patterns on Eyes and Mouth During Audiovisual Speech Segmentation
|
---|---|
Published in |
Frontiers in Psychology, February 2016
|
DOI | 10.3389/fpsyg.2016.00052 |
Pubmed ID | |
Authors |
Laina G. Lusk, Aaron D. Mitchel |
Abstract |
Speech is inextricably multisensory: both auditory and visual components provide critical information for all aspects of speech processing, including speech segmentation, the visual components of which have been the target of a growing number of studies. In particular, a recent study (Mitchel and Weiss, 2014) established that adults can utilize facial cues (i.e., visual prosody) to identify word boundaries in fluent speech. The current study expanded upon these results, using an eye tracker to identify highly attended facial features of the audiovisual display used in Mitchel and Weiss (2014). Subjects spent the most time watching the eyes and mouth. A significant trend in gaze durations was found with the longest gaze duration on the mouth, followed by the eyes and then the nose. In addition, eye-gaze patterns changed across familiarization as subjects learned the word boundaries, showing decreased attention to the mouth in later blocks while attention on other facial features remained consistent. These findings highlight the importance of the visual component of speech processing and suggest that the mouth may play a critical role in visual speech segmentation. |
X Demographics
Geographical breakdown
Country | Count | As % |
---|---|---|
Netherlands | 2 | 18% |
Switzerland | 2 | 18% |
United States | 2 | 18% |
Guinea | 1 | 9% |
United Kingdom | 1 | 9% |
Spain | 1 | 9% |
Unknown | 2 | 18% |
Demographic breakdown
Type | Count | As % |
---|---|---|
Members of the public | 5 | 45% |
Scientists | 4 | 36% |
Science communicators (journalists, bloggers, editors) | 1 | 9% |
Practitioners (doctors, other healthcare professionals) | 1 | 9% |
Mendeley readers
Geographical breakdown
Country | Count | As % |
---|---|---|
United States | 2 | 3% |
Spain | 1 | 1% |
Unknown | 72 | 96% |
Demographic breakdown
Readers by professional status | Count | As % |
---|---|---|
Student > Ph. D. Student | 18 | 24% |
Researcher | 14 | 19% |
Student > Doctoral Student | 11 | 15% |
Student > Bachelor | 9 | 12% |
Student > Master | 6 | 8% |
Other | 8 | 11% |
Unknown | 9 | 12% |
Readers by discipline | Count | As % |
---|---|---|
Psychology | 36 | 48% |
Linguistics | 6 | 8% |
Neuroscience | 6 | 8% |
Medicine and Dentistry | 3 | 4% |
Agricultural and Biological Sciences | 3 | 4% |
Other | 8 | 11% |
Unknown | 13 | 17% |