多模态语篇分析.ppt

MultimodalDiscourseAnalysis,ForeignLinguisticsandAppliedLinguisticsZhengLu,Whatismultimodality?,Amode,accordingtoKressandVanLeeuwen,isasemioticsystemwithrulesandregularitiesattachedtoit.Multiplemodes,namelysemioticmodes,canincludegestures,posture,proxemics(空间关系学),visualimages,documentlayout(设计布局),musicandarchitecturaldesign,etc.Meaningsarecreatedintextsandinteractionsinacomplexinterplayofsemiosisacrossmultiplemodesbutarenotlimitedtowrittenorspokenlanguage.,Multimodaldiscourseanalysisisafairlynewandrapidlydevelopingperspectiveondiscourse.Anotherinterestingperspectiveonmultimodaldiscourseanalysisisthatitnotmerelyattemptstointegrateallthepossiblesemioticmodesofexpressionsbutalsocanintegratevariousotherapproachestodiscourseanalysis.,BACKGROUNDMultimodaldiscourseanalysishasbecomepopularinthewesternworldsincethe1990s.MultimodaldiscourseanalysisreliesheavilyonHallidayssystemic-functionaltheoryoflanguage.Languageisakindofsocialsemiotic,meanwhile,ithasmanyfunctions,suchasideationalfunction,(概念功能)interpersonalfunction(人际功能)andtextualfunction(语篇功能).Languageisinseparablefromsocialactivitiesofman.,Before1990s,researchersalltooktextualdata,namely,statictextstobetheprimaryresourceforsocialinteractions,suchasKressandvanLeeuwensgrammarofimages视觉设计的语法andOToolesinvestigationofpaintings,sculptureandarchitecture.Thereisawidespreadbeliefnowthattextualdataisnotnecessarilythemostimportantmodeusedfortheinterpretationsofsocialmeaning.,Inordertostudythecomplexityofhumaninteraction,wehavetoworkontheanalysisofmoredynamicinteractions,andanalyzeallmodesthattheparticipantsareutilizing.Everyinteractionismultimodal.Althoughitsrelativelyshorthistory,multimodaldiscourseanalysishasalsohadanimportantinfluenceonotherapproachesandfields,mostnotablyintheareaofliteracyandthegrowinginterestindigitalliteraciesandthefieldofhuman-computerinteraction.,Digitalliteracyistheabilitytolocate,organize,understandandanalyzeinformationusingdigitaltechnology.Schoolsarecontinuallyupdatingtheircurriculumfordigitalliteracy.Thisoftenincludescomputersintheclassroom,theuseofeducationalsoftwaretoteachcurriculum,andcoursematerialsbeingavailabletostudentsonline.,随着多媒体技术的产生与发展,如何将自然话语同多种模态结合起来进行分析解读是现代语言学,尤其是话语分析研究领域的重要课题。我国多模态话语分析研究主要涉及理论探讨、视觉应用、口语语料库建设、教学应用等领域。国内多模态话语的研究还处在起始阶段，尚未见到专著出版，只有为数不多的论文，其中包括胡壮麟的“社会符号学中的多模态化”，李战子“用系统功能语言学理论对多模态话语理论的研究”,另外朱永生和张德禄等也进行了相应的研究。,Theselfisnotsomethingthatexistsfirstandthenentersintorelationshipwithothers,butitis,sotospeak,aneddy(漩涡)inthesocialcurrentandsostillapartofthatcurrent.,AmericanwomenanthropologistMead1974:182,SomethoughtsonpersonalidentityconstructionAmultimodalperspective,SigridNorris,AssociateProfessorAucklandUniversityofTechnologyDirector:MultimodalResearchCentresigrid.norrisaut.ac.nzDegrees:Ph.D.LinguisticsGeorgetownUniversity,2002M.S.LinguisticsGeorgetownUniversity,1997B.A.RussianLanguageandLiteratureGeorgeWashingtonUniversity,1989,SigridNorris,OUTLINE,IntroductionSomebackgroundTheoreticargumentStructureConclusion,.thesocialactor,speakingonthephonewithheremployee(multimodalanalysis).newthoughtsaboutconsciousness(thepointof“I”and“me”identityelements),Introduction,Identityiswhoandwhatyouare.Identityconstructionisawidelycoveredtopicinstudiesofdiscourse.Inthischapter,theauthorsfocusisamethodologicalonethatallowstheinvestigationofidentityconstructionfromaslightlynewperspective,amultimodalapproach.,MywritingisfirstofallanextensionofScollonsmediateddiscourseanalysis(中介话语分析).Second,thisframeworkisstronglyinfluencedbytheworkofKressandvanLeeuweninmultimodality.Besidesthesetwomergingdirections,theframeworkofmultimodalinteractionanalysisdrawsoninteractionalsociolinguisticsofGoffmanGumperz,discourseanalysisasinHamiltonorSchiffrinandahistoricalapproachofWodak.,SomeBackground,Therefollowsabriefeclecticoverviewonpersonalidentityconstruction:SchiffrinorHamilton-microdiscursiveconstructions,suchaspronounuseandshowhowindividualsestablishthemselvesasbelongingtoonegrouporanother.Wodak-combiningtextanalysiswithnarrativeandinterviewanalysisonnationalidentityconstructionandplacingitintoahistoricalperspective.,HallandBucholztryingtoencompasssocialpsychologicalandsocialculturalforcesonanalyzingapersonsuseoflanguage.Whatalloftheseapproachestoidentityhaveincommonistheirconcentrationonlanguage(spokenorwritten).Itisthispointthatcreatestheopportunityforthischapteronmultimodalpersonalidentityconstruction.,Theoreticargument,Prioritizingoflanguagemaylimitourunderstandingofinteractionanditalsomaylimitourunderstandingofpersonalidentityconstruction.Iuntilizeandbuildonthemicroanalyticalapproach,forexample,usetoanalyzespokenlanguagebuttakemultipleembodiedmodessuchasposture,gestureandheadmovementintoconsideration.,Further,Iinvestigatedisembodiedmodessuchaslayout(布局设计)andobjects.Identityisnotformedincohesivewholesbutassituationallygroundedandco-constructedidentityelements.WhenspeakingofidentityelementsIamthinkingofananalogy(类比)withchemicalelementssuchasoxygen,hydrogen,orgold.(Pleaseturntopage134.),gold,Genderidentity,oxygen,hydrogen,Occupationalidentity,Name:Tanyaallinline3;whateverinline4;email,and,fax,everythinginline5;alwaysinline6),andwemayinterpretthesegesturesasawayforTanyatoforceherselftogiveclearinstructions,Sixoutoftheeighttimes(lines3to6),Tanyasimultaneouslyperformsbeatswithherhead,Headmovementsstartwithwhatever(inline3),gothroughherpointofinstructionemailandfaxeverything(line4)andendwithalways(line6).Thus,whilethehandbeatsgovernthecoherenceandspeedofherutterances,theheadbeatsbrackettheactualpointthatsheistryingtogetacross.,HIGHMODALDENSITY,ObjecthandlingSpokenlanguagePostureGazeGestureHeadmovement,EMPLOYERIDENTITY,Whenwerevisitthispicture,weseethatLucyislisteningtoTanyascallandchimes(插话)inattheappropriatetime,givingTanyathesentenceandthenfollowupwithaphonecall,whichTanyarepeatswithoutlosingherrhythmbysayingandthenAlwaysfollowupwithaphonecall.,Wealsonoticethatlayout(布局设计)playsarole,withdesks,chairsandcomputersarrangedastheyare,makingiteasilypossibleforLucytooverheartheconversationandtochime（插话）inwhenshedeemsitnecessary.Accordingly,Tanyaisinteractingwithtwodifferentpeoplesimultaneously.Whilesheisinteractingwithheremployeeintheforegroundofherattention,Tanyathenco-constructsherco-owneridentitytogetherwithLucyinthemid-groundofherattentionawareness.,Becausethesheepandthefenceappearclosertous,wesaytheyreintheforegroundoftheimage.Thefoothillsappearfaraway,sotheyreinthebackground.Midground,asyouprobablyguessed,ishowwedescribepartsoftheimagethatappeartobedeeperthantheforegroundbutnotsodeepasthebackground.,“M”isforthemillionthingsshegaveme,“O”meansonlythatshesgrowingold,“T”ifforthetearssheshedtosaveme,“H”isforherheartofpurestgold,“E”isforhereyes,withlove-lightshinning,“R”meansright,andrightshellalwaysbe.Putthemalltogether.Theyspell“Mother”,awordthatmeanstheworldtome.,M-O-T-H-E-RByHowardJohnson,M代表她给予我百万样东西，O意味着她渐渐老去，T是她为育我成人而洒落的颗颗泪滴，H寓意她那金子般至纯至真的心灵，E是她那双闪耀着慈爱之光的眼睛，R使我坚信她永远正确无误的言行。把这些字母拼在一起就是“母亲”，一个于我犹如整个世界一样的词语。,Anexample,ThefollowingexcerptsthatIwilllookatindetailcomefromanextensiveethnographicstudyoftwoco-ownersofaweb-designbusinessthatIconductedoveraperiodoffourmonths.Duringthistime,Ispentmostofthedayswiththetwowomen(whomIwillcallTanyaandLucy)duringworkhoursandalsospenttimewiththemattheirhomes.Ihavemetmanyoftheirfriends,caretakersoftheirchildren,husbandandex-husband,andtheirparen