朗讯科技培训效果评估分析报告英文版

1、朗讯科技培训效果评估分析报告英 文版 1 Measure Training Results nSome Concepts nSome experiences nSome lessons Frank Cao Lucent Technologies 朗讯科技培训效果评估分析报告英 文版 2 Training Process nNeeds Analysis nDesign nDelivery nEvaluation 朗讯科技培训效果评估分析报告英 文版 3 Four Evaluation Levels nReaction How do participants feel about the prog

2、ram? nLearning To what extent did the participants increase knowledge, improve skills, and/or change attitude? nBehavior To what extent did their job behavior change? nResults What final results occurred? (Quantity, quality, safety, sales, costs, profits, ROI) 朗讯科技培训效果评估分析报告英 文版 4 Level One: Reactio

3、n What is evaluated? nContent nTrainer nMethodology nMaterial nFacilities nLogistics nRegistration 朗讯科技培训效果评估分析报告英 文版 5 Example Questions nProbability you will use ideas from this session in your work nContent relevance to my job nPractical examples and experience nSpeakers knowledge of subject area

4、 nSpeakers presentation/facilitation skills nSpeakers ability to respond to questions nGroup participation 朗讯科技培训效果评估分析报告英 文版 6 Level One: Reaction What is evaluated? nOverall 朗讯科技培训效果评估分析报告英 文版 7 Example Questions nWhat did you like most about the program? nWhat did you like least about the program

5、? nIn what ways could this program be improved? nWould you recommend this course to others who are interested in the subject? nWhich of the following features were important in your decision to attend? Rank in order of importance) 朗讯科技培训效果评估分析报告英 文版 8 Level One: Reaction How to evaluate? nQuestionna

6、ires nInterview nFocus Group nPhone survey 朗讯科技培训效果评估分析报告英 文版 9 Level One: Reaction Questionnaire: scales nExcellentWellFairPoor nExcellentVery GoodGoodFairPoor nStrongly Agree Disagree 7 6 5 4 32 1 nHigh Low 109 87 6 5 4 32 1 朗讯科技培训效果评估分析报告英 文版 10 Level One: Reaction Advantages nEasy to execute nPa

7、rticipants are free nSome relationship to on job performance Issues nPurely subjective Halo effect (smile sheet) Horn effect Central tendency nTime pressure 朗讯科技培训效果评估分析报告英 文版 11 Level One: Reaction Tip 1: highlight purpose, solicit cooperation nTo determine the degree that the seminar met your need

8、s, we would like you to give us your honest opinion nTo make our future sessions as meaningful as possible, we would appreciate your candid evaluation of this program. nYour comments will be used to improve future offerings of this seminar. 朗讯科技培训效果评估分析报告英 文版 12 Level One: Reaction Tip 2: Encourage

9、comments Comments are more accurate than scores Tip 3: Set up baseline scores Historical data Benchmarking data Pilot group data (Formative evaluation) Tip 4: Combine questionnaires, interviews, focus groups Tip 5: instant feedback for multi subject courses 朗讯科技培训效果评估分析报告英 文版 13 Level Two: Learning

10、How to evaluate? nTest nDemonstration nPresentation nDiscussion nRole Play 朗讯科技培训效果评估分析报告英 文版 14 Level Two: Learning Advantages nPressure to participants nPressure to trainer nFirst step to change behavior Issues nTension nReliability nCreditability nDifficulty nDifferentiation nNot the best indicat

11、or for on job change 朗讯科技培训效果评估分析报告英 文版 15 Level Two: Learning Tip 1: Fully utilize test nTest is good to evaluate knowledge based training Functional skills New Employee Orientation Supervisor ABC nBe serious about test result of formal training nInstant self scoring and symbolic incentive for info

12、rmal training nReliability, Creditability, Difficulty and Differentiation nSet up baseline nFinal score vs. gain 朗讯科技培训效果评估分析报告英 文版 16 Experimental Group Control Group Pretest Posttest Gain 朗讯科技培训效果评估分析报告英 文版 17 Level Two: Learning Tip 2: Set up rules in advance for demonstration and presentation To

13、pic Time Criteria to evaluate Evaluators are key success factor Tip 3: People dont speak might be best learner Tip 4: People good at role play might not be good learner 朗讯科技培训效果评估分析报告英 文版 18 Example:Management Skills nParticipants selected 3 topics from 11 nTopic requirement nTime and assessors nPra

14、ctice nRight before the stage.Participants knew the topic nAssessors interacted with and provided feedback to participants 朗讯科技培训效果评估分析报告英 文版 19 Example: Leadership Style Describe a situation when you used what you learned about leadership styles to improve the effectiveness of a relationship. Be su

15、re to cover: qWhat motivated you to examine the style difference qWhat did you find and how qWhat did you do to flex your style qWhat were the results 朗讯科技培训效果评估分析报告英 文版 20 Example: Performance Appraisal 朗讯科技培训效果评估分析报告英 文版 21 Level Three: Behavior How to evaluate? nObservation nPerformance Appraisal

16、 Information nSupervisor feedback (oral or written) nCustomer feedback (oral or written) nEmployee feedback (oral or written) 朗讯科技培训效果评估分析报告英 文版 22 Level Three: Behavior Advantages nDirect purpose of training nRecognized by supervisor and management team Issues nTime consuming nExpertise scarcity nC

17、ooperation from supervisor/customer nMultiple “cause- effect” 朗讯科技培训效果评估分析报告英 文版 23 Level Three: Behavior Tip 1: Select program carefully nBehavior based Company behavior Professional skills Managerial skills Customer service (smile, response) nTrainers cooperation Trainers expertise in evaluation D

18、ocuments ready before training 朗讯科技培训效果评估分析报告英 文版 24 Level Three: Behavior Tip 2: Evaluation time in accordance with skills practice Tip 3: Supervisors cooperation is key success factor Commitment when register Mutual benefit Brief the key points 朗讯科技培训效果评估分析报告英 文版 25 Level Three: Behavior Tip 4: “T

19、ake advantage” of vendor Key behavior identification Questionnaires design Time Result analysis 朗讯科技培训效果评估分析报告英 文版 26 Example: Time Management 朗讯科技培训效果评估分析报告英 文版 27 TOT: Transfer of Training nOnly % of classroom learning was transferred to work! nThe transfer must be PLANNED! 朗讯科技培训效果评估分析报告英 文版 28 T

20、OT: Transfer of Training nA. Before taking, could you? nB. Can you currently? nC. How often are you applyingon your job TOT occurred if A is N B is Y C is =1 Y N Y N 0 1 2 3 4 5 朗讯科技培训效果评估分析报告英 文版 29 TOT: Transfer of Training nA: “Y” /All -Prior Knowledge Rate nB: “N” /All -Incomprehension Rate nC:

21、“0” /All -Disconnect Rate nTOT Rate Acceptable Rate 0-66% 0-33% 0-33% LowMidHigh 0-33%34-66%67-100% 朗讯科技培训效果评估分析报告英 文版 30 Level Four:Results How to evaluate? nQuantity nQuality nSafety nSales nCosts nProfits nROI 朗讯科技培训效果评估分析报告英 文版 31 Level Four:Results Advantages nUltimate purpose Issues nTime consuming nExpertise s