认知心理学-张亚旭：7语言

1,认知心理学Cognitive Psychology语言Language,张亚旭,2,为什么研究语言认知.,3,Rich Information in Words,MintGrapheme & phonemem, in, tWord length effecteat treatRegularity effectmint mint pint paintgrapheme-phoneme correspondence, GPC,字素表征音素的字母或字母组合,4,Rich Information in Words,TreatBody or sub-syllabic unitseatConsistency effecttreat, sweat, greatclean treat,5,Rich Information in Words,TreatmentMorphemetreat, mentLexical decisionspellcungflurbpairthrimnade真假假真假假sized raked (frequency effect),6,Morphology 形态学,Morphemes can be added to derive one word from another派生sad - sadnesssad - sadlyor to change the inflection of a word (e.g., number or tense)屈折变化walk - he walkswalk Yesterday he walked,7,Rich Information in Words,怡Semantic & phonetic radicalsRegularity effect抬 怡 (哪些额外变量需要控制?)Consistency effect煌 护士 vs. 面包 - 护士词汇判断（lexical decision）,15,汉字阅读中的亚词汇加工,青(semantic)/猜(complex)/波(control) - 紫,Zhou & Marslen-Wilson, 1999, JEP: LMC,16,动词论元结构Verb Argument Structure,indicates the type of syntactic constituents with which a verb co-occurs, the grammatical roles and thematic roles/题元角色 (e.g., Agent/施事, Recipient/受事, and Theme/主题) of those constituentsSusan gave the boy a banana.Peter repaired a car yesterday.John departed last week.,17,Rich Information in Sentences,Syntactic informationSyntactic category (noun, verb, etc.)Morphosyntactic informationFunctional wordsWord order.Semantic informationWord meaning,18,Rich Information beyond Sentences,她是去年生的孩子AB: 她是去年生的孩子老张下午没去开会，他去做手术了AB: 老张下午没去开会，他去做手术了Pragmatic information,19,Pragmatics is a subfield of linguistics which studies the ways in which context contributes to meaningPragmatics encompasses speech act theory, conversational implicature, talk in interaction and other approaches to language behavior in philosophy, sociology, and linguistics.It studies how the transmission of meaning depends not only on the linguistic knowledge (e.g. grammar, lexicon, etc.) of the speaker and listener, but also on the context of the utterance, knowledge about the status of those involved, the inferred intent of the speaker, and so on.In this respect, pragmatics explains how language users are able to overcome apparent ambiguity, since meaning relies on the manner, place, time etc. of an utterance.The ability to understand another speakers intended meaning is called pragmatic competence. Pragmatic awareness is regarded as one of the most challenging aspects of language learning, and, though it can be taught, often comes only through experience,20,Rich Information beyond Sentences,A: 我不想和你过了B: 他是谁,字词/ 句子/ 篇章,听觉视觉语言理解听阅读语言产生说写,22,孤立状态下的视觉词汇识别直接通达假设,语义,语音,词形,灯/rose,23,孤立状态下的视觉词汇识别间接通达假设,语义,语音,词形,灯/rose,24,Direct-access hypothesisdeep dyslexiadap, ish, larDual-route hypothesis,25,Semantic Activation in Reading Chinese,Zhou, X., & Marslen-Wilson, W. (1999). Phonology, orthography, and lexical semantic activation in reading Chinese. Journal of Memory and Language, 41, 579-606Zhou, X., & Marslen-Wilson, W. (2000). The relative time course of semantic and phonological activation in reading Chinese. Journal of Experimental Psychology: Learning, Memory, and Cognition, 26, 12451265,26,Lexical Ambiguity Resolution and Word Recognition in Sentence Context,在去医院看望女朋友之前，小宋先去店里买了杜鹃郑老伯埋怨屋里一点声音也没有，老伴准备第二天去市场买杜鹃中心问题语境作用的时间点When/how/whether,27,Multiple access modelSelective access modelReordered access modelIntegration model公式 公示 攻势 工事 公事 宫室Zhang, Y., Wu, N., & Yip, M. (2006). Lexical ambiguity resolution in Chinese sentence reading. In P. Li, L H. Tan, E. Bates, & O.J.L. Tzeng (Eds.), Handbook of East Asian Psycholinguistics (Vol. 1: Chinese, pp. 268-278). Cambridge, UK: Cambridge University Press,29,Modularity of Cognition,Modular theoryFodor, 1983; Forster, 1979The autonomy of the lexical processorInteractive theoryMarslen-Wilson McClelland & Elman, 1986The output of higher subsystems can influence computation of lower subsystems,Fodor, J. A. (1983). The modularity of mind: an essay on faculty psychology. Cambridge, Mass.: MIT Press,30,Syntactic parsing and sentence comprehension,31,The defendant examined.,32,Garden-Path Sentences,The defendant examined by the lawyer turned out to be unreliable.The defendant that was examined by the lawyer turned out to be unreliable.The evidence examined by the lawyer turned out to be unreliable.The evidence that was examined by the lawyer turned out to be unreliable.,33,Minimal Attachment Principle最小附加原则,The defendant examined.Syntax-first modelGarden-path model,S SNP VPNP VP NP RR,S: sentenceNP: noun phraseVP: verb phraseRR: reduced relative,34,Minimal Attachment Principle最小附加原则,The evidence examined.Syntax-first modelGarden-path model,S SNP VPNP VP NP RR,S: sentenceNP: noun phrase名词短语VP: verb phrase动词短语RR: reduced relative关系,35,PP Attachment Ambiguity介词短语附加歧义,VPThe man painted the doors with new brushes before the festival. NPThe man painted the doors with large cracks before the festival.,VP VPverb NP PPverb NP NP PP,36,Put the apple on the towel in the box.,Tanenhaus, M. K. et al. (1995). Integration of visual and linguistic information in spoken language comprehension. Science, 268, 1632-1634,38,Late Closure Principle,After Mary and John hugged the woman left.,39,Modularity of Syntactic Processing,Serial, syntax-first modelsFrazier Friederici, 2002Constraint-based modelsMacDonald et al., 1994, Psychological ReviewConcurrent modelBoland, 1997,40,Three-Phase Neurocognitive ModelAngela D. Friederici, 2002,Phase 1 (100-300 ms after the onset of the critical word)The initial syntactic structure is built on the basis of the syntactic category information of a wordPhase 2 (300-500 ms)Lexical-semantic and morphosyntactic processes occur with the goal of thematic role assignment (题元角色指派)Phase 3 (500-1000 ms)The different types of information are integrated,Friederici, A. D. (2002). Towards a neural basis of auditory sentence processing. Trend in Cognitive Sciences, 6, 7884.,“With some 450 citations to date (ISI Web of Science), the 2002 article alone has been cited once every week on average since it went to press.” (Steinhauer & Drury, 2012, B & L),41,Concurrent ModelJulie E. Boland, 1997,Although syntactic constraints, when available, prevent adoption of a plausible, but syntactically ill-formed, interpretationsemantic analysis is permitted to get ahead of syntactic analysis, assigning thematic roles and developing a provisional interpretation before a syntactic commitment has been made,The evidence examined,Boland, J. E. (1997). The relationship between syntactic and semantic processes in sentence comprehension. Language and Cognitive Processes, 12, 423484.,42,Ferreira Clifton et al., 2003, JML,The defendant examined by the lawyer turned out to be unreliable.The defendant that was examined by the lawyer turned out to be unreliable.The evidence examined by the lawyer turned out to be unreliable.The evidence that was examined by the lawyer turned out to be unreliable.,43,咬死猎人的狗咬死猎人的鸡咬死狐狸的狗卖掉猎人的狗VPN1deN2,44,怠慢客人的孩子 偏正嘱咐患者的家属 动宾撞倒肖明的车子 偏正或动宾,45,Limited Syntactic Parallelism in Chinese Ambiguity Resolution,粉刷|公寓|的|房间|之后，|小王|还|打扫|了|客厅|。 粉刷|脏乱|的|房间|之后，|小王|还|打扫|了|客厅|。训练|士兵|的|将军|之后，|总司令|發表|了|簡短|演說|。 训练|年轻|的|将军|之后，|總司令|發表|了|簡短|演說|。,Hsieh, Y., Boland, J. E., Zhang, Y., & Yan, M. (2009). Limited syntactic parallelism in Chinese ambiguity resolution. Language and Cognitive Processes, 24(7/8): 1227-1264.,46,Exp. 2 First-fixation durations,粉刷 公寓 的 房间 之后， 小王 还打扫了客厅训练 士兵 的 将军 之后，总司令 发表了简短的演说,47,Exp. 2 Gaze durations,48,Exp. 2 Regression-path durations,49,Exp. 2 Probability of first-pass regressions,50,Exp. 2 Total times,51,你们这里有没有30的卡卖100的？The mouse was eaten by the cheese.Sentence interpretation may not always be determined by the syntax (e.g. Bever 1970; Townsend and Bever 2001; Ferreira 2003; Kolk et al. 2003; Kim and Osterhout 2005; van Herten et al. 2005, 2006; Ferreira and Patson 2007),52,A central question in the study of sentence comprehension,whether syntactic processes are temporally and/or functionally prior to semantic processessuch that semantic interpretation of a sentence must be established on top of the syntactic structure of that sentence,53,Syntax first, both temporally and functionally?,Yesserial, syntax-first models (e.g., Frazier Friederici, 2002)Noconstraint-based modelsconcurrent modelunification model (Hagoort, 2003, 2005)non-syntactocentric, dynamic model (Kuperberg, 2007),54,“During normal on-line processing, semantic integration of words does not take place for words which are not syntactically licensed (have wrong word category)”(Friederici & Weissenbor, 2007, Brain Research, p. 54)Functional primacy of syntactic (word category) over semantic processes,Friederici, A. D., & Weissenborn, Y. (2007). Mapping sentence form onto meaning: The syntax-semantic interface. Brain Research, 1146, 5058.,55,ERP Approach,56,ERP Effects of Semantic Processes,57,58,Hagoort, P. Hald, L., Bastiaansen, M., & Petersson, K-M. (2004). Integration of word meaning and world knowledge in language comprehension. Science, 304, 438-441,As agreed upon, Jane was to wake her sister and her brother at five oclock in the morning. But the sister had already washed herself, and the brother had even got dressed. Jane told the brother that he was exceptionally quick/slow.,61,Kutas, M., & Federmeier, K. D. (2011). Thirty years and counting: Finding meaning in the N400 component of the event-related brain potential (ERP). Annual Review of Psychology, 62, 621-647Kutas, M., & Hillyard, S. A. (1980). Reading senseless sentence: brain potentials reflect semantic incongruity. Science, 207, 203-205,62,ERP Effects of Syntactic Processes,Syntactic category violations(E)LAN + P600,63,Hahne & Friederici, 2002Das Eis wurde im gegessen.应该去掉im(The ice cream was in-the eaten.)语法错误,64,Hahne & Friederici, 2002Das Eis wurde im gegessen.(The ice cream was in-the eaten.),65,Distinct Brain Responses to Syntactic and Semantic Processes,66,(L)AN to Syntactic Category Violations,Hagoort, Wassenaar, & Brown, 2003CorrectDe houthakker ontweek de ijdele schroef op dinsdag.(The lumberjack dodged the vain propeller on Tuesday.)Syntactic Category ViolationDe houthakker ontweek de ijdele schroeft op dinsdag.(The lumberjack dodged the vain propelled on Tuesday.),67,68,ELAN or LAN?,Modality: Auditory or visualPresentation rateVisual contrastSyntactic category uniqueness point (prefix or suffix),69,Morphosyntactic Violations,agreement violations of person, number, gender, or tenseLAN+P600（有的实验发现）e.g., Osterhout Nevins et al., 2007,70,Newman et al., 2007, NeuroImage,Violations of regular past tense inflection evoke a LAN左侧前部负活动*Yesterday I frown at Billy.规则变化But violations of irregular past tense inflection do not没有LAN* Yesterday I speak to him frankly.不规则变化LAN reflects rule-governed compositional processes at the syntactic level, rather than the syntactic tense violation itselfLAN表示规则变化动词的,71,LAN can also be evoked by over-regularizations of irregular verbs (Morris & Holcomb, 2005)bringed,72,LAN has also been explained as reflecting domain-general, rule-governed processing of symbols, including non-linguistic sequencing (Hoen & Dominey, 2000, NeuroReport),73,Kim & Osterhout, 2005,*The meal was devouring饭正在吞咽红色词引发P600, no N400N400反映语义，P600反映语法,Kim, A., & Osterhout, L. (2005). The independence of combinatory semantic processing : Evidence from event-related potentials. Journal of Memory and Language, 52, 205-225.,75,When Semantics Meets Failed Syntax,跨语言差异,76,Functional Primacy in German: a brief review,Das Brot wurde gegessen.Correct(The bread was eaten)Der Vulkan wurde gegessen.Semantic(The volcano was eaten) 语义异常N400Das Eis wurde im gegessen.Syntactic(The ice cream was in-the eaten) 句法错误E LAN P600Das Trschlo wurde im gegessen.Double(The door lock was in-the eaten) 双重错误无N400,Hahne & Friederici, 2002, Cognitive Brain Research,77,N400 responses to semantic violationsThe volcano was eaten.,Hahne & Friederici, 2002, Cognitive Brain Research,78,(E)LAN-P600 to syntactic violationsThe ice-cream was in-the eaten.,Hahne & Friederici, 2002, Cognitive Brain Research,79,(E)LAN-P600, but no N400 for double violationsThe door lock was in-the eaten.,Hahne & Friederici, 2002, Cognitive Brain Research,80,This finding of no N400 suggests thatthe failed local phrase structure construction blocks lexical-semantic integrationsupporting the functional primacy of syntactic category over semantic processes,Hahne & Friederici, 2002, Cognitive Brain Research,81,No N400 effects were found for double violations, regardless of,ModalityAuditory (Friederici et al., 2004; Hahne in English: Thierry et al., 2008)Syntactic category uniqueness pointPrefix (e.g., Hahne & Friederici, 2002, Experiment 1)suffix (Friederici et al., 2004),82,Das Buch wurde trotz verpflanzt von (The book was despite replanted by .)Friederici et al., 2004, NeuroReportSuffix,83,Le fauteuil qui est dans la dort(The chair which is in the is sleeping)Isel et al., 2007French,84,Friederici & Weissenborn, 2007, Brain Research, p. 54,“During normal on-line processing, semantic integration of words does not take place for words which are not syntactically licensed (have wrong word category)”,85,Het vrouwtje veegde de vloer met een oude bedelde gemaakt van twijgen(The woman swept the floor with an old begged made of twigs)van den Brink & Hagoort, 2004Dutch,86,Thierry et al. (2008, NeuroImage) observed an N400 effect for the combined violationShakespearean functional shiftHowever, their participants were asked to judge sentences for meaningfulness,88,Are there cross-linguistic differences in syntactic primacy?,Possibly yes, and could hinge upon morphology形态学In German and some other Indo-European languages, the syntactic category of a word can be marked withgrammatical morphology (e.g., inflectional or derivational affixes)orthographic conventions (such as capitalizing all German nouns),89,In contrast, Chinese is a non-Indo-European language with very limited inflections (e.g., plural inflection of human nouns; perfective and progressive markers)There is no grammatical morphology that either marks syntactic category or marks syntactic features such as person, number (except plural inflection of human nouns), gender, case, and tenseGrammatical relations in Chinese are not generally cued morphologically; rather they are cued by word order, function words (e.g., ba PREP), and lexical/semantic content,90,These linguistic properties of Chinese have lead to the conjecture that sentence comprehension in Chinese relies more on semantic analyses compared to Indo-European languages (e.g., Xu, 1997; see Li, 1998; Ye et al., 2006),设计师制作新衣，把布料裁了。 Correct 伐木工开采森林，把松树裁了。语义Semantic Violation设计师制作新衣，把裁了。句法 Syntactic Violation伐木工开采森林，把裁了。双重 Combined Violation,Ye, Luo, Friederici, & Zhou, 2006, Brain Research,清洁工/把/大厦的/窗户/全部/擦/了/一遍。Correct 清洁工/把/大厦的/窗户/全部/赢/了/一遍。Semantic Violation清洁工/把/大厦的/窗户/全部/糖/了/一遍。Combined Violation语法错误，可能不会引发语义矛盾的N400,Yu & Zhang, 2008, NeuroReport,女孩/把/新到的/长裙/立刻/购买/了/下来。Correct 女孩/把/新到的/长裙/立刻/欺诈/了/下来。Semantic女孩/把/新到的/长裙/立刻/钞票/了/下来。Weak女孩/把/新到的/长裙/立刻/铁锹/了/下来。Strong,Zhang, Y., Yu, J., & Boland, J. E. (2010). Semantics doesnt need a processing license from syntax in reading Chinese. Journal of Experimental Psychology: Learning, Memory, and Cognition, 36, 765-781.,94,Violation Reference Points,Das Trschlo wurde im gegessen.(The door lock was in-the eaten),95,Task,Verification sentence judgment in Weak-Strong experimentOverall acceptability judgment or other tasks in German and French studies,女孩/买/了/裙子/和/手套。Correct女孩/买/了/很/裙子/和/手套。Syntactic句法女孩/吃/了/裙子/和/手套。Semantic语义女孩/吃/了/很/裙子/和/手套。Combined,Zhang, Y., Yu, J., & Boland, J. E. (2010). Semantics doesnt need a processing license from syntax in reading Chinese. Journal of Experimental Psychology: Learning, Memory, and Cognition, 36, 765-781.,97,很男人很淑女很德国无极之后，有人说，陈凯歌不再霸王别姬。,98,Discussion & Conclusion,Semantic integration proceeds even when syntactic category processing fails during Chinese sentence reading, resulting in N400 effects for combined violations, even under conditions in which semantic integration is n