Department of Psychology

Department of

Psychology

Department of

Psychology

site header
The Speech Perception and Production Lab Banner

Queen's University Department of Psychology
Humphrey Hall, 62 Arch St., Kingston, ON K7L 3N6
T: 613-533-6000 • ext 77595 F: 613-533-2499
E: kevin.munhall@queensu.ca

 

Research Team

Research Team Photo 2013-2014

L to R: Heather Lockett, Justin Deonarine, Paul Plante, Jessica Wilfong, Nida Latif, Emily Dawber, Kevin Munhall, Agnès Alsius, Takashi Mitsuya, Celina Nahanni, Mike O’Grady.

Kevin Munhall

Kevin Munhall, PhD

Principle Investigator

Research Interests: Conversation is one of our most common and highly skilled activities. When we talk with other people, we perceive and produce a remarkable amount of social, emotional and linguistic information. This information is conveyed visually through the movements of our face and body and acoustically through our voice. In my laboratory, we study the perceptual and cognitive activities that make conversation possible.  We use a variety of experimental techniques such as eye tracking, motion capture, animation and psychophysics to explore the multisensory processes and brain structures that are involved in face-to-face communication.

Selected Publications

MacDonald E.N., Johnson E.K., Forsythe J., Plante P., & Munhall K.G. (2012). Children's Development of Self-Regulation in Speech Production. Current Biology, 22,  113-117.

Buchan, J.N. & Munhall, K.G. (2012). The Effect of a Concurrent Cognitive Load Task and Temporal Offsets on the Integration of Auditory and Visual Speech Information, Seeing and Perceiving, 25, 87-106.

Mitsuya, T., MacDonald, E.N., Purcell, D.W. & Munhall, K.G. (2011). A cross-language study of compensation in response to real-time formant perturbation. Journal of Acoustical Society of America, 130, 2978-2986.

Mansour, J. K., Lindsay, R. C. L, Brewer, N., & Munhall, K. G. (2009). Characterizing visual behaviour on a lineup task. Applied Cognitive Psychology. 23:7, 1012-1026.

Munhall, K.G., ten Hove, M., Brammer, M., Paré, M. (2009). Audiovisual integration of speech in a bistable illusion.  Current Biology, 19, 1-5.

Agnes Alsius

Agnes Alsius, Post-Doctoral Fellow

Speech Perception and Production Laboratory
Department of Psychology
Queen's University

Area of research: Audiovisual speech perception; Speechreading; Crossmodal integration; Sensory feedback and motor control of speech production

Education

Ph.D. Cognitive science and language program, Psychology, University of Barcelona, 2009
B.A. Psychology, University of Barcelona, 2003

Publications

Alsius, A., Wayne, R., Paré, M., & Munhall, K. (submitted). High visual resolution matters in audiovisual speech perception, but only for some.

Wilson, A., Alsius, A., Paré, M., & Munhall, K (accepted for publication). Spatial frequency requirements and gaze strategy in visual-only and audiovisual speech perception. Journal of Speech, Language and Hearing Research.
 
Jaekl, P., Pesquita, A., Alsius, A., Munhall, K., & Soto-Faraco, S. (2015). The contribution of dynamic visual cues to audiovisual speech perception. Neuropsychologia, 75, 402-410.

Alsius, A., Möttönen, R., Sams, M.E., Soto-Faraco, S., & Tiippana, K. (2014). Effect of attentional load on audiovisual speech perception: evidence from ERPs. Frontiers in Psychology, 5, 727.

Barrós-Lorcertales, A., Ventura-Campos, N., Visser, M., Alsius, A., Pallier, C., Ávila, C. & Soto-Faraco, S. (2013). The neural correlates of audiovisual speech processing in second language. Brain and Language, 126(3), 253-262.

Alsius, A. & Munhall, K. (2013). Detection of audiovisual speech correspondences without visual awareness. Psychological Science, 24, 423-431. (PDF, 1.32 MB)

Sánchez-García, C., Alsius, A., Enns, J. & Soto-Faraco, S. (2011). Cross-modal prediction in speech perception. PLoS ONE, (10):e25198.

Alsius, A. & Soto-Faraco, S. (2011) Searching for audiovisual correspondence in speech. Experimental Brain Research, 213(2-3), 175-183.
 
Navarra, J.*, Alsius, A.*, Soto-Faraco, S. & Spence, C. (2010). Perception of audiovisual speech synchrony for native and non-native language. Brain Research, 1323, 84-93. * These authors contributed equally to the paper as first authors.

Navarra, J., Alsius, A., Soto-Faraco, S & Spence, C. (2010). Assessing the role of attention in the audiovisual integration of speech. Information Fusion, 11, 4-11.
 
Soto-Faraco, S. & Alsius, A. (2009). Observation: Deconstructing the McGurk-MacDonald illusion. Journal of Experimental Psychology: Human Perception and Performance, 35(2), 580-587.
 
Koppen, C., Alsius, A & Spence, C (2008). Semantic congruency and the Colavita visual dominance effect. Experimental Brain Research, 184(4), 533-46.(PDF, 489 KB)

Alsius, A., Navarra, J., & Soto-Faraco, S (2007). Attention to touch weakens audiovisual speech integration. Experimental Brain Research, 183(3), 399-404.

Soto-Faraco, S. & Alsius, A. (2006). Conscious access to the unisensory components of a crossmodal illusion. Neuroreport, 18 (4), 347-350.(PDF, 127 KB)

Alsius, A., Navarra, J., Campbell, R. & Soto-Faraco, S (2005). Audiovisual integration of speech falters under high attention demands.  Current Biology, 9(15), 839-843.  (PDF, 211 KB)
 
Soto-Faraco, S., Sinnett, SC., Alsius, A., & Kingstone, A. (2005). Spatial orienting of tactile attention induced by gaze direction. Psychonomic Bulletin & Review, 12(6), 1024-1031. (PDF, 374 KB)

Soto-Faraco, S., Navarra, J., Sinnett, S., Alsius, A. (2004).  La re-unificación de los sentidos.  Reseña del libro: The Handbook of Multisensory Proceses. Cognitiva, 16, 257-259.
 
Soto-Faraco, S., Navarra, J., & Alsius, A. (2004). Assessing automaticity in audiovisual speech integration: Evidence from the speeded classification task. Cognition, 92, 13-23. (PDF, 183 KB)

Book Chapters

Navarra, J., Sinnett, S., Alsius, A., Azanon, E., & Soto-Faraco, S. (in press). Percepcion Multisensorial.  In En L. Fuentes & R. Rueda (Eds.) Mente y cerebro: De la Psicologia Experimental a la Neurociencia cognitiva.

Alsius, A.,MacDonald, E. & Munhall, K. (2013). Multi-modal speech perception. In K. Ochsner & S. Kosslyn (Eds.). The Oxford Handbook of Cognitive Neuroscience. Oxford University Press.

Soto-Faraco, S., Navarra, J., Alsius, A., & Campbell, R. (2005). Efectos de la atención en la integración audiovisual del habla. In Universidad de Valencia: Fundación Universidad-Empresa de Valencia (ADEIT) (Eds.) Atención y Procesamiento.

Nida Latif

Nida Latif, M.Sc.

PhD Candidate co-supervised by Monica Castelhano

Education

M.Sc. Psychology in Brain, Behaviour and Cognitive Sciences, Queen's University, 2012
B.Sc. (Hon) Psychology, McMaster University, 2010

Area of research: Visual perception; Gaze behaviour & Eye movement control;
Nonverbal communication; Social perception & Thin-Slice judgment

Selected Publications

Latif, N., Barbosa, A.V., Vatikiotis-Bateson, E., Castelhano, M.S. and Munhall, K.G. (2014). Movement coordination during conversation. PloS one, 9(8), e105036. (PDF, 8.03 MB)
 
Latif, N., Gehmacher, A., Castelhano, M.S. & Munhall, K.G. (2014). The art of gaze guidance. Journal of Experimental Psychology: Human Perception & Performance, Vol 40(1), 33-39. (PDF, 1.03 MB)

Latif, N. (2012). Movement correlation as a nonverbal cue in the perception of affiliation in thin slices of behaviour (Master's Thesis). Queen's University, Kingston, Ontario.

Latif, N., Plante, P.M.J., Gehmacher, A., Munhall, K.G. & Castelhano, M.S. The influence of artistic compositional techniques on eye movement control and interpretation. Proceedings for Vision Sciences Society Annual Meeting, Journal of Vision, 12(9), p408.

Mashal Haque

Mashal Haque, M.Sc. Candidate

Education: B.Sc. (Hon) Psychology, Queen’s University

 

Jessica Wilfong,

currently resides in Adolescent Dynamics Lab

Charlie


Former Lab Members:

Dr. Celina Nahanni
Medical student at University of Toronto, Ontario

Kathrine Martin
Graduate student in Speech Pathology at the University of Western Ontario

Dr. Takashi Mitsuya
Postdoctoral Fellow at University of Western Ontario

Emily Dawber
Graduate student in Audiology at University of Western Ontario

Dr. Ewen MacDonald
Associate Professor of Department of Electrical Engineering at Technical University of Denmark

Dr. Julie Buchan   
Speech Scientist at Nuance Communications, Montreal, Quebec

Dr. Jamal Mansour
Lecturer in Psychology and Sociology at Queen Margaret University, Edinburgh

Ian Everdell, MSc.
Consultant User Experience & Market Research, Bracebridge, Ontario

Dr. Andrea Downie
Psychologist, Children's Hospital of Western Ontario, London, Ontario

Dr. Jeffery A. Jones
Professor, Psychology Department, Wilfrid Laurier University

Dr. Jorge Lucero
Professor, Departamento de Matemática, Universidade de Brasilia

Dr. Karen Nicholson
Assistant Professor, Psychology Department, Mount Allison University
Memorialized by Mount Allison University “Dr. Karen Nicholson Psychology Prize

Dr. Michel Pitermann
INRIA Researcher, Laboratoire Parole et Langue, Université de Provence, Aix-en-Provence, France

Dr. Douglas M. Shiller
Assistant Professor, School of Speech-Language Pathology and Audiology at l'Université de Montréal
Researcher at the CHU Sainte-Justine Research Centre

Dr. David Purcell
Associate Professor, National Centre for Audiology, University of Western Ontario

Dr. Hilmi Dajani
Associate Professor, School of Information Technology and Engineering, University of Ottawa