a quick guide to interpreting concept maps - LJMU 2nd Year Student 解释概念图-我们大学第二年的学生一个快速指南.docx

how to make sense of the leximancer analysis: a quick guide to interpreting concept maps this quick guide has been developed to support the research processes of those who are new to the semantic analysis software leximancer and would like to make a prompt start with interpreting the data. the guidance is mainly focused on making sense of the concept maps and gives some tips on what to look for when exploring the data. although a couple of how to do bits of advice are also included, generally we assume that the researcher would know how to reach the output (actual concept map) stage. this guide is based on the latest leximancer 4 version, so the interface could be slightly different from the early versions of the software, but the general principles of the analysis and core functions of the software remain the same. 1. what is leximancer? this is a semantic analysis software that has been developed at the university of queensland, brisbane in 2001 (/). 2. why/when would you want to use the software?leximancer is a useful instrument for researchers/analysts who need to explore a large text-based data set where manual analysis and coding would be too time consuming, e.g. qualitative survey data, multiple interview/focus group transcripts, lengthy reports or web-based textual information. 3. how does it work? the process is called unsupervised semantic mapping of natural language. the method can also be thought of as a form of text mining. leximancer employs two stages of information extraction: semantic and relational, using a different algorithm for each stage. it computes the frequency with which each word is used and then calculates the distance between each of the terms (co-occurrence). the algorithms used are statistical, but they employ non linear dynamics and machine learning. the results of computations are displayed as a concept map that can be explored on individual concept levels and also by looking at the family of associations between different concepts (themes). 4. what are the benefits of using the software? leximancer provides a fairly unbiased method of reviewing complex textual data sets and a clear process of justifying decisions about text selection. it makes the researcher aware of the global context and helps to discover hidden structures in text that fall outside of his/her preconceived framework.the automated analysis demonstrates a stability of measurement over time and what is most important - it allows a more rapid and frequent exploration of text with reduced cost. tailored (researcher driven) analysis also could be done if the researcher would like to explore specific topics/concepts. one of the attractive features of the software is its ability to identify sentiments by showing probability of a concept being mentioned in a favourable or unfavourable context. leximancer could be used on its own or as a complementary tool for other methods of analysis. 5. anything to be aware of/any limitations?there are some limitations to purely automated analysis. some concepts emerge strongly where they are represented by a narrow vocabulary. others will be identified from a broader pool of terms and have a greater likelihood of being diluted as concepts in the map. this can be mitigated by the manipulations with a thesaurus (e.g. adding concepts that havent make a relevance threshold to the concept map, creating combined/compound concepts etc) and should be acknowledged as a researcher-driven analysis.leximancer findings might benefit from being combined with outcomes from other type of analysis such as traditional thematic analysis or content analysis for gaining a more comprehensive picture. some more insights into the software and how it works could be found on /sites/default/files/files/what%20is%20leximancer.pptthe most exciting part is actually using the tool!first of all.first of all you need to run a preliminary analysis of your unspoiled data set, with no editing or configuration, to get a feel of the data.if you are using the software for the first time, for a step by step guidance of how to make a start look at the powerpoint presentation created by julia cretchley and mike neal /sites/default/files/files/first%20leximancer%20analysis.ppt6. how to make sense of your first concept map concept level exploration 1. take some time to visually explore the concept map generated (you might want to set the theme size scrolling bar on 0% (see fig. 1), so that you can focus on the concepts first.fig 1.2. when you have located the most relevant concept (largest circle), you will instantly know what is of the most importance to either your respondents/research participants or to the text creators. pay attention to the concepts positioned closely to the most relevant concept - those with direct links/connections would indicate that these two words are often used together and worthy of detailed exploration.things to note: watch out for language your research participants use. students often use different terms to describe the same concept - it might give you an indication of a specific connotation or a context in which they choose to use a particular word. for example while describing academic staff, students use different words such as staff, lecturers, tutors, teachers etc. what is interesting is that these concepts/themes are not always located close to each other and associated with a different contextual and often emotional background. 3. explore other concepts (those that constitute nodes in the concept map). their relevance is reflected by size (more relevant ones have bigger size). note where they are positioned on the map and which concepts they are surrounded by. this could give you an idea of other significant themes and how they are connected.4. look for concepts that are less important/could be excluded from your analysis, (these, for example, could be frequently mentioned words such as certain, have etc). some concepts could be merged (e.g. placement and placements) or made compound (e.g. work + experience). you could later make these changes to make your concept map more readable 5. explore the concept ranking table located to the right from the concept map (fig 2). the relevance of the concepts will be indicated in the table numerically (number of instances/actual quotes and relevance %). fig 2. 6. by clicking on a concept on the map you can see how this concept is related to others. it will be shown via graphical links and also as a table indicating the likelihood of other concepts being mentioned together with the concept in question (fig 3). fig 3. 7. when you familiarised yourself with the layout of the map and have a broad understanding of the concepts that are coming out from the data and how they are connected, its time to explore the direct quotes/instances that formed these concepts. go to the concept ranking table (located to the right from concept map) and under the count heading click on a number that corresponds to the concept you would like to explore (fig 4). you will have instant access to all the quotes that contributed to the creation of the concept. the quotes will give you an indication of the meaning(s) behind the concept and essentially how semantically clean is the concept. for example word feedback would most likely have a singular meaning (fig 5), while work might have multiple meanings, since students, for example, could talk about their course work, part-time work, work related learning, work as verb e.g. work it out etc. in case of multiple meanings you might want to explore only specific links/connections with other concepts that are of interest for your research or make some adjustments on the next, advanced stage of the data processing. fig 4. things to note: not all possible quotes where the concept (word) was mentioned in the text will be included in the list. only those that passed the relevance threshold will be listed. fig 5.8. if you are interested in quotes/instances where two specific concepts were mentioned together, click on a particular concept (under wordlike) in the concept ranking table, and when a list of related concepts appeared with the icon, click on the icon attached to the concept that you would like to explore together with the first concept. (fig 6) fig 6. exploration of themes themes are concept clusters that represent the most semantically connected groups of concepts. theme name is the most prominent concept in the cluster.1. set your theme size scroll bar to 100% - to see the concept(s) with the highest level of connectivity these will be the most important themes that are coming out from your text (fig 6). there might be one theme, two or, sometimes, more they all are worth paying close attention. you could explore relevance of the themes and, as in the case of concepts, have access to all quotes that are illustrative of the theme.things to note: if youve got more than one theme at 100% resolution, look for the concepts that are positioned in the intersected area(s) they might give you some insights of what topics belong to both themes. fig. 7.2. when reducing percentage on the scroll bar, more themes (concept clusters) will appear on the map (fig.8). look carefully at the dynamics of transformation - e.g. how smaller themes merge into bigger ones, what themes disappear and what remain. 3. remember or better save the themes generated by the automatic analysis. it is possible that when you made some custom configuration changes, the thematic picture will also change. fig.8 next stepthe next step is making necessary adjustments for a more focused/customized analysis, for example, removing concepts that are not central for your research, merging or adding the concepts, activating sentiment analysis, adding tagging etc. when all the changes you think might be useful for your research are done, the analysis should be run once more, following the same stages that were indicated/described above.7. sentiment analysisactivating the sentiment lens can be a bit tricky, so below is a quick step by step guide how to do it. 1. to enable sentiment analysis, in the project control panel select generate thesaurus and then activate show settings. 2. click on concept seeds and then on edit (fig 9).3. choose user defined concepts from the top menu and then click on sentiment lens button that is activated/highlighted. favourable (favterms) and unfavourable (unfavterms) terms will appear under the concept list (fig 10). 4. save the settings by pressing ok and then run your analysis from scratch so that sentiment analysis is incorporated. fig. 9fig.10why use the sentiment analysis?sentiment analysis gives you an instant indication of probability of a concept being mentioned in a favourable and unfavourable context. just click on a concept in the concept ranking table and see the results. the difference could be relatively small (as in fig 11 just 1% or under) or quite noticeable. the latter case will be an evidence of a particular strong disposition of your research participants. by clicking on favourable/unfavourable you will have access to all quotes that were selected as indicative of the particular sentiment for this concept. things to note: dont be surprised if, for example, the percentage of unfavourable likelihood is higher, but number of quotes selected by the software will be the same than in case of favourable quotes. this is not a direct/proportional relationship, as it is determined by various statistical procedures and indicative of more complex relationships between the concept and strength of the sentiments expressed. things to note: pay attention to the location of favourably and unfavourably rated concepts on the map. sometimes the same sentiment concepts cluster together, this would be an indication of a strong shared concerns/issues. it is also useful to explore themes in relation to dominant sentiment background of the concept that form the theme.fig 11. final remarksyou could use some advanced functions useful for the analysis - for example tagging files and groups of files to allow for comparison, creating dashboard reports, explore word cloud, look at your concept map from the social network perspective etc. instructions how to do it can be found in the help section of the software. some advance features are also explained in /dl/training/2011-12-v4194059105-ab-45-j/leximancerin-depth.pptthe main and most time consuming work will be about delving into the actual quotes and