版权说明:本文档由用户提供并上传,收益归属内容提供方,若内容存在侵权,请进行举报或认领
文档简介
13.0SpeakerVariabilities:AdaptionandRecognition说话人差异:适应与识别
数字语音处理概论IntroductiontoDigitalSpeechProcessingReferences:1.9.6ofHuang 2.“MaximumAPosterioriEstimationforMultivariateGaussianMixtureObservationsofMarkovChains”,IEEETrans.onSpeechandAudioProcessing,April1994 3.“MaximumLikelihoodLinearRegressionforSpeakerAdaptationofContinuousDensityHiddenMarkovModels”,ComputerSpeechandLanguage,Vol.9,1995 4.Jolliffe,“PrincipalComponentAnalysis”,Springer-Verlag,1986 5.“RapidSpeakerAdaptationinEigenvoiceSpace”,IEEETrans.onSpeechandAudioProcessing,Nov2000 6.“ClusterAdaptiveTrainingofHiddenMarkovModels”,IEEETrans.onSpeechandAudioProcessing,July2000 7.“ACompactModelforSpeaker-adaptiveTraining”,InternationalConferenceonSpokenLanguageProcessing,1996 8.“ATutorialonText-independentSpeakerVerification”,EURASIPJournalonAppliedSignalProcessing20049.“AnOverviewofText-independentSpeakerRecognition:fromFeaturestoSupervectors”,SpeechCommunication,Jan2010SpeakerDependent/Independent/AdaptationSpeakerDependent(SD)
trainedwithandusedfor1speakeronly,requiringhugequantityoftrainingdata,bestaccuracypracticallyinfeasibleMulti-speakertrainedfora(small)groupofspeakersSpeakerIndependent(SI)trainedfromlargenumberofspeakers,eachspeakerwithlimitedquantityofdatagoodforallspeakers,butwithrelativelyloweraccuracySpeakerAdaptation(SA)startedwithspeakerindependentmodels,adaptedtoaspecificuserwithlimitedquantityofdata(adaptationdata)technicallyachievableandpracticallyfeasibleSupervised/UnsupervisedAdaptationsupervised:text(transcription)oftheadaptationdataisknownunsupervised:text(transcription)oftheadaptationdataisunknown,basedonrecognitionresultswithspeaker-independentmodels,maybeperformediterativelyBatch/Incremental/On-lineAdaptationbatch:basedonawholesetofadaptationdataincremental/on-line:adaptedstep-by-stepwithiterativere-estimationofmodels e.g.firstadaptedbasedonfirst3utterances,thenadaptedbasedonnext3utterancesorfirst6utterances,...SASASDSD/i//a/SpeakerDependent/Independent/AdaptationMAP(MaximumAPosteriori)AdaptationGivenSpeaker-independentModelsetΛ={λi=(Ai,Bi,πi),i=1,2,...M}andAsetofAdaptationDataO=(o1,o2,...ot,...oT)forASpecificSpeakerWithSomeAssumptionsonthePriorKnowledgeProb[Λ]andsomeDerivation(EMTheory)exampleadaptationformulaaweightedsumshiftingμjktowardsthosedirectionsofot(inj-thstateandk-thGaussian)
largerτjkimplieslessshiftOnlyThoseModelswithAdaptationDatawillbeModified,UnseenModelsremainUnchanged—MAPPrinciplegoodwithlargerquantityofadaptationdatapoorperformancewithlimitedquantityofadaptationdataargmaxΛτjk:aparameterhavingtodothepriorknowledgeaboutμjkmayhavetodowithnumberofsamplesusedtotrainμjkMAPAdaptation
AccuracyAdaptationDataSDSIBlock-diagonalMLLRMLLRMAPMAPAdaptationMaximumLikelihoodLinearRegression(MLLR)DividetheGaussians(orModels)intoClassesC1,C2,...CL,andDefineTransformation-basedAdaptationforeachClasslinearregressionwithparametersA,bestimatedbymaximumlikelihoodcriterionAllGaussiansinthesameclassup-datedwiththesameAi,bi:parametersharing,adaptationdatasharingunseenGaussians(ormodels)canbeadaptedaswellAicanbefullmatrices,orreducedtodiagonalorblock-diagonaltohavelessparameterstobeestimatedfasteradaptationwithmuchlessadaptationdataneeded,butsaturatedatloweraccuracywithmoreadaptationdataduetothelessprecisemodelingClusteringtheGaussians(orModels)intoLClassestoomanyclassesrequiresmoreadaptationdata,toolessclassesbecomeslessaccuratebasicprinciple:Gaussian(ormodels)withsimilarpropertiesand“justenough”dataformaclassdata-driven(e.g.byGaussiandistances)primarily,knowledgedrivenhelpfulTree-structuredClassesthenodeincludingminimumnumberofGaussians(ormodels)butwithadequateadaptationdataisaclassdynamicallyadjustingtheclassesasmoreadaptationdataareobserved(A2,b2)(A1,b1)(A3,b3)MLLRMLLRDiagonalBlock-diagonalFull
MLLRPrincipalComponentAnalysis(PCA)ProblemDefinition:
forazeromeanrandomvectorxwithdimensionalityN,x∈RN,E(x)=0,iterativelyfindasetofk(k
N)orthonormalbasisvectors{e1,e2,…,ek}sothat
(1)var(e1Tx)=max(xhasmaximumvariancewhenprojectedone1)
(2)var(eiTx)=max,subjecttoei
ei-1……e1,2
i
k
(xhasnextmaximumvariancewhenprojectedone2,etc.)Solution:{e1,e2,…,ek}aretheeigenvectorsofthecovariancematrix
forxcorrespondingtothelargestkeigenvaluesnewrandomvectory
Rk:theprojectionofxontothesubspacespannedbyA=[e1
e2……
ek],y=ATxasubspacewithdimensionalityk≤Nsuchthatwhenprojectedontothissubspace,yis“closest”toxintermsofits“randomness”foragivenkvar(eiT
x)istheeigenvalueassociatedwithei
Proofvar(e1T
x)=e1TE(x
xT)e1=e1TΣe1=max,subjectto|e1|2=1usingLagrangemultiplier J(e1)=e1TE(xxT)e1-λ(|e1|2-1),
⇒E(xxT)e1=λ1e1,var(e1T
x)=λ1=maxsimilarfor
e2withanextraconstrainte2Te1=0,etc.=0
J(e1)
e1
eigenvectoreigenvaluePCA
PCA
BasicProblem3(P.35of4.0)
PCA
eigenvectoreigenvalue
eigenvectoreigenvalue
N-dimk-dimPCA
N=3k=2PCAEigenvoiceASupervectorx
constructedbyconcatenatingallrelevantparametersforthespeakerspecificmodelofatrainingspeaker
concatenatingthemeanvectorsofGaussiansinthespeaker-dependentphonemodelsconcatenatingthecolumnsofA,binMLLRapproachxhasdimensionalityN(N=5,000×3×8×40=4,800,000forexample)SDmodelmeanparameters(m)transformationparameters(A,b)AtotalofL(L=1,000forexample)trainingspeakersgivesLsupervectorsx1,x2,...xLx1,x2,
x3.....xLaresamplesoftherandomvectorxeachtrainingspeakerisapoint(orvector)inthespaceofdimensionalityNPrincipalComponentAnalysis(PCA)x'=x-E(x),Σ=E(x'x'T), {e1,e2,.....ek}:eigenvectorswithmaximumeigenvaluesλ1>λ2...>
λk
kischosensuchthatλj,j>kissmallenough(k=50forexample)EigenvoicePrincipalComponentAnalysis(PCA)x'=x-E(x),Σ=E(x'x'T),
{e1,e2,.....ek}:eigenvectorswithmaximumeigenvaluesλ1>λ2...>
λk
kischosensuchthatλj,j>kissmallenough(k=50forexample)EigenvoiceSpace:spannedby{e1,e2,.....ek}eachpoint(orvector)inthisspacerepresentsawholesetoftri-phonemodelparameters{e1,e2,.....ek}representsthemostimportantcharacteristicsofspeakersextractedfromhugequantityoftrainingdatabylargenumberoftrainingspeakerseachnewspeakerasapoint(orvector) inthisspace,aiestimatedbymaximumlikelihood principle(EMalgorithm)FeaturesandLimitationsonlyasmallnumberofparametersa1...akisneededtospecifythecharacteristicsofanewspeakerrapidadaptationrequiringonlyverylimitedquantityoftrainingdataperformancesaturatedatloweraccuracy(becausetoofewfreeparameters)highcomputation/memory/trainingdatarequirementsTrainingSpeaker1TrainingSpeaker2NewSpeakerNewSpeakerSpeakerAdaptiveTraining(SAT)andClusterAdaptiveTraining(CAT)SpeakerAdaptiveTraining(SAT)
tryingtodecomposethephoneticvariationandspeakervariationremovingthespeakervariationamongtrainingspeakersasmuchaspossibleobtaininga“compact”speaker-independentmodelforfurtheradaptationy=Ax+binMLLRcanbeusedinremovingthespeakervariationClusteringAdaptiveTraining(CAT)dividingtrainingspeakersintoRclustersbyspeakerclusteringtechniquesobtainingmeanmodelsforallclusters(mayincludeamean-biasforthe“compact”modelinSAT)modelsforanewspeakerisinterpolatedfromthemeanvectorsSpeakerAdaptiveTraining(SAT) TrainingSpeakersSpeaker1Speaker2SpeakerL“Compact”Speaker-independentmodelMAPMLLRA1,b1A2,b2AL,bLClusterAdaptiveTraining(CAT)
clustermean1
clustermean2
clustermeanRLTrainingSpeakersa1a2aRmean-bias1Σ
meanforanewspeaker,mi:clustermeani,mb:mean-bias
SDSI/a//i/SAT
SpeakerRecognition/VerificationTorecognizethespeakersratherthanthecontentofthespeech
phoneticvariation/speakervariationspeakeridentification:toidentifythespeakerfromagroupofspeakersspeakerverification:toverifyifthespeakerisasclaimedGaussianMixtureModel(GMM)
λi={(wj,μj,Σj,),j=1,2,...M}forspeakeri forO=o1o2...ot...oT,maximumlikelihoodprincipleFeatureParametersthosecarryingspeakercharacteristicspreferredMFCCMLLRcoefficientsAi,bi,eigenvoicecoefficientsai,CATcoefficientsaiSpeakerVerificat
温馨提示
- 1. 本站所有资源如无特殊说明,都需要本地电脑安装OFFICE2007和PDF阅读器。图纸软件为CAD,CAXA,PROE,UG,SolidWorks等.压缩文件请下载最新的WinRAR软件解压。
- 2. 本站的文档不包含任何第三方提供的附件图纸等,如果需要附件,请联系上传者。文件的所有权益归上传用户所有。
- 3. 本站RAR压缩包中若带图纸,网页内容里面会有图纸预览,若没有图纸预览就没有图纸。
- 4. 未经权益所有人同意不得将文件中的内容挪作商业或盈利用途。
- 5. 人人文库网仅提供信息存储空间,仅对用户上传内容的表现方式做保护处理,对用户上传分享的文档内容本身不做任何修改或编辑,并不能对任何下载内容负责。
- 6. 下载文件中如有侵权或不适当内容,请与我们联系,我们立即纠正。
- 7. 本站不保证下载资源的准确性、安全性和完整性, 同时也不承担用户因使用这些下载资源对自己和他人造成任何形式的伤害或损失。
最新文档
- 2026年掘金工考试题库及答案
- 2026年临时用电考试题库及答案
- 上岗证考试题库及答案
- 2026年宏观经济学试题库及参考答案
- 2026年注册工程师职业考试模拟试卷(含答案)
- 2026年银行培训测试模拟试卷(含答案)
- 2026年中式面点师技能考核评估模拟试卷(含答案)
- 2026年中小学生道德与法治知识竞赛模拟试卷(含答案)
- 文档管理系统测试原理题库带答案
- 2026年学习通考试模拟试卷(含答案)
- 2026年水利安全员b证考试题库及答案解析
- 2026年消防安全专题培训(含近期火灾事故案例)
- 国聘社会招聘笔试测评题库
- 纳米多孔材料复合膜:化工分离领域的制备技术与应用探索
- 中医护理技术操作
- 2025版压力性损伤指南解读与临床实践
- 高三化学复习重点教学设计方案
- 2026年保安员证考试题库及答案1套
- 养老机构安全事故处理与报告制度
- 配网工程管理介绍
- 新版中华民族共同体概论课件第八讲共奉中国与中华民族内聚发展(辽宋夏金时期)-2025年版
评论
0/150
提交评论