E LECTRO - PHYSIOLOGIE DE LA PRODUCTION DE MOTS :

Une histoire à rebours F.-Xavier Alario Laboratoire de Psychologie Cognitive Aix–Marseille Université & CNRS France

1 / 38

L ANGUAGE PRODUCTION A VARIETY OF MOTIVATIONS AND CONTEXTS

2 / 38

L ANGUAGE PRODUCTION A VARIETY OF MOTIVATIONS AND CONTEXTS

H. Cartier-Bresson & E. Erwitt (Magnum photos)

Bock, K. (1996). Language production: Methods and methodologies. Psychonomic Bulletin & Review, 3 (4), 395-421.

3 / 38

P SYCHOLINGUISTIC PROCESSES OF INTEREST

A

B

C

Mapping a message (stimulus) onto a word

⇒Selecting verbal responses

⇒Monitoring verbal responses

4 / 38

P SYCHOLINGUISTIC MODELS , LANGUAGE PRODUCTION

F IGURE : single words

Levelt et al (2001, PNAS)

F IGURE : monitoring system

Hartsuiker & Kolk (2001, Cog.Psy.)

5 / 38

P SYCHOLINGUISTIC PROCESSES OF INTEREST

A

B

C

Mapping a message (stimulus) onto a word

⇒Selecting verbal responses

⇒Monitoring verbal responses

6 / 38

M ONITORING OF LANGUAGE PRODUCTION

V ISIBLE IN Corrections, interruptions, hesitations,. . . T WO MECHANISMS I NTERNAL pre-articulatory control (phonology?)

F IGURE : Monitoring system

E XTERNAL via auditory and perceptual systems A. Postma (2000, Cognition)

Hartsuiker & Kolk (2001, Cog Psy )

Hartsuiker, R. J., Bastiaanse, R., Postma, A., and Wijnen, F. (Eds.) Phonological Encoding and Monitoring in Normal and Pathological Speech (2005). Hove and New-York: Psychology Press. 7 / 38

M ONITORING OF ACTION PRODUCTION

C ONFLICT MONITORING e.g. alternative activated responses, Associated with anterior cingulate cortex Botvinik, Braver, Barch, Carter, & Cohen (2000, Psych. Rev.)

E LECTRO - PHYSIOLOGICAL INDEX “Error” negativity in non-linguistic tasks Falkenstein et al. (1991), Gehring et al. (1993), Dehaene et al. (1994), Vidal et al. (2000, 2003)

L ANGUAGE Also observed during linguistic processing: gender decision, error elictation paradigm

F IGURE : “Error” negativity Vidal, Hasbroucq, Grapperon, & Bonnet (2000, Biol Psych)

e.g. Masaki et al. (2001, NeuroReport), Sebastián-Gallés et al. (2006, J Cog Neurosci, Möller et al. (2007, Cerebral Cortex), Ganushchak et al. (2008, J Cog Neurosci)

8 / 38

E XPERIMENTAL PARADIGMS USED

Upon presentation of a picture, participants E XP 1 Perform a grammatical gender decision task (manual) E XP 2 Name the object out-loud (oral)

9 / 38

M ANUAL RESPONSES “Error ” NEGATIVITY DURING GRAMMATICAL GENDER RETRIEVAL

Riès, Janssen, Dufau, Alario, & Burle (2011, J Cog Neurosci)

10 / 38

S POKEN RESPONSES “Error ” NEGATIVITY DURING WORD PRODUCTION

Riès, Janssen, Dufau, Alario, & Burle (2011, J Cog Neurosci)

11 / 38

I NTERIM SUMMARY Monitoring

I

Similar signature for verbal and non-verbal response monitoring

I

Medial post-response activity could reflect internal loop

I

Generic monitoring process accross representations

I

Later lateral activity could be tied to external loop

I

Linguistic (i.e., non “generic”) component of monitoring process

12 / 38

P SYCHOLINGUISTIC PROCESSES OF INTEREST

A

B

C

Mapping a message (stimulus) onto a word

⇒Selecting a verbal response

⇒Monitoring verbal responses

13 / 38

P SYCHOLINGUISTIC MODELS , LANGUAGE PRODUCTION

F IGURE : single words

Levelt et al (2001, PNAS)

F IGURE : monitoring system

Hartsuiker & Kolk (2001, Cog.Psy.)

14 / 38

P RELIMINARY fMRI EVIDENCE

Alario, Chainay, Lehéricy, & Cohen (2006, Brain Res) 15 / 38

E XPERIMENTAL PARADIGM

16 / 38

ACTIVITIES TIED TO VERBAL RESPONSE SELECTION (?)

17 / 38

ACTIVITIES not TIED TO RESPONSE SELECTION

Riès, Janssen, Burle & Alario (2013, Plos One) 18 / 38

I NTERIM SUMMARY Selection

I

Identified activities “mid-way” between stimulus and response

I

Timing and ‘localization” (MNE) consistent with response selection

I

Response selection activity starts accumulating between ∼400 ms and ∼200 ms before vocal response

I

Specific cognitive process(es) and interactions to be clarified

19 / 38

P SYCHOLINGUISTIC PROCESSES OF INTEREST

A

B

C

⇒Mapping a message (stimulus) onto a word

⇒Selecting a verbal response

⇒Monitoring verbal responses

20 / 38

“A RBITRARINESS ” OF THE SIGN

J ULIET ’Tis but thy name that is my enemy; Thou art thyself, though not a Montague. What’s Montague? it is nor hand, nor foot, Nor arm, nor face, nor any other part Belonging to a man. O, be some other name! What’s in a name? that which we call a rose By any other name would smell as sweet; So Romeo would, were he not Romeo call’d,

Ferdinand de Saussure Cours de Linguistique Générale (1916)

21 / 38

R ETRIEVAL OF ARBITRARY INFORMATION ( OR LINKS )

H IPPOCAMPUS INVOLVED IN I

Acquisition and retrieval of episodic memories

I

Associative long term memory retrieval

I

(Working memory)

Wakana S et al. Radiology 2004;230:77-87

22 / 38

A N INVESTIGATION WITH EPILEPTIC PATIENTS

Figure courtesy of Agnès Trébuchon & Catherine Liégeois-Chauvel Institut de Neurosciences des Systèmes, Hôpital La Timone, Marseille

23 / 38

ROLE OF HIPPOCAMPAL ACTIVITY IN WORD RETRIEVAL

Hamamé, Alario, Llorens, Liégeois-Chauvel, & Trébuchon (2014, Brain & Language)

24 / 38

H IPPOCAMPAL H IGH F REQUENCY ACTIVITY (HHFA)

25 / 38

H IPPOCAMPAL ACTIVITY

26 / 38

H IPPOCAMPAL ACTIVITY

27 / 38

P SYCHOLINGUISTIC MODELS , LANGUAGE PRODUCTION

F IGURE : single words

Levelt et al (2001, PNAS)

28 / 38

H IPPOCAMPUS AND T IP OF THE TONGUE

F IGURE : Perirhinal cortex vs. hippocampus Hamamé, Alario, Llorens, Liégeois-Chauvel, & Trébuchon (2014, Brain & Language) 29 / 38

I NTERIM SUMMARY Mapping a message onto a word

I

Sustained activity in hippocampus between stimulus and response

I

Functional relationship with behavior (latencies & tip-of-the-tongue)

I

Hippocampus participates in visual naming, beyond perceptual and semantic processes

I

Consider including the structure in the model, relationship between lexical access & memory processes

30 / 38

C ONCLUSIONS

1. Word production processes can be described “in reverse” 2. Reliable timing of activities could be tied to response selection 3. Sustained activity in hippocampus (“memory structure”) linked to word retrieval

31 / 38

ACKNOWLEDGEMENTS F UNDING

A RTICLES CITED & C O - AUTHORS I I I I I I I I

Llorens, A., Trébuchon-Da Fonseca, A., Riès, S., Liégeois-Chauvel,C., & Alario, F.-X. (2014). How familiarization and repetition modulate the picture naming network. Brain and Language, 133, 47-58. Hamamé, C., Alario, F.-X., Llorens, A., Liégeois-Chauvel, C., & Trébuchon, A. (2014). Visual object naming depends on hippocampal activity: evidence from intracranial EEG. Brain & Language, 135, 104-114 Riès, S., Janssen, N., Burle, B., & Alario, F.-X., (2013). Response-locked brain dynamics of word production. Plos One 8 (3) : e58197. DOI 10.1371/journal.pone.0058197. Llorens, A., Trébuchon, A., Liégeois-Chauvel, C., & Alario, F.-X. (2011). Intra-cranial recordings of brain activity during language production. Frontiers in Psychology, 2, 53. Riès, S., Janssen, N., Dufau, S., Alario, F.-X., & Burle, B. (2011). General purpose monitoring during speech production. Journal of Cognitive Neuroscience, 23, 1419-1436. De Vos, M., Riès, S., Vanderperren, K., Vanrumste, B., Alario, F.-X., Van Huffel, S. & Burle, B. (2011). Removal of muscle artifacts from EEG recordings of spoken language production. Neuroinformatics, 8, 135-150. Trebuchon-Da Fonseca, A., Guedj, E., Alario, F.-X., Laguitton, V., Mundler, O., Chauvel, P., & Liegeois-Chauvel, C. (2009). Brain regions underlying word finding difficulties in temporal lobe epilepsy. Brain, 132, 2772-2784. Alario, F.-X., Chainay, H., Lehericy, S., & Cohen, L. (2006). The role of the supplementary motor area in word production. Cognitive Brain Research, 1076, 129-143.

THANK YOU FOR YOUR ATTENTION ! 32 / 38

S UPPLEMENTARY SLIDES

33 / 38

L EFT LATERAL ACTIVITY DURING ORAL WORD PRODUCTION

Riès, Janssen, Dufau, Alario, & Burle (2011, J Cog Neurosci)

34 / 38

H IPPOCAMPUS AND FACE RECOGNITION

F IGURE : Male/female classification of unknown faces

35 / 38

W ORD RETRIEVAL IN A PROTOTYPICAL MTL RESECTED PATIENT: HM F OOTNOTE 1 IN H AMAMÉ ET AL (2014) Language function in patient HM is a long-lived debate. Neuropsychological testing showed mostly normal scores in both comprehension and production, with the notable exception of verbal fluency, an impairment attributed to extra-surgical factors (e.g. education level; Corkin, 1984). Interestingly, clinical examination and more demanding language production tests (DeRenzi & Ferrari, 1978) showed slight (yet significant) naming difficulties. Additionally, more detailed examination of H.M.’s language production revealed a higher frequency of different types of errors, particularly omission errors (Mackay, James, Hadley, & Fogler, 2011). Other aspects of language such as the retrieval and production of verbal material (Mackay, Burke, & Stewart, 1998) together with grammatical and figurative features of speech were also found to be impaired (Mackay, Stewart, & Burke, 1998; MacKay, James, & Hadley, 2007; MacKay, James, Taylor, & Marian, 2007). However, since H.M. resection comprised an important part of the medial and anterior temporal lobe (i.e. not only the hippocampus), the link that can be established between hippocampal function and language on the basis of this patient’s performance remains unclear. 36 / 38

E LECTRO - MYOGRAPHIC ARTEFACTS

37 / 38

C ANONICAL CORRELATION ANALYSIS

De Voos, Riès, Vanderperren, Vanrumste, Alario, Van Huffel & Burle (2010, Neuroinformatics, 8, 135-50)

38 / 38