版权说明：本文档由用户提供并上传，收益归属内容提供方，若内容存在侵权，请进行举报或认领
文档简介
ITU-TSTUDYGROUP12
STATUSREPORTQ4/12
RapporteurQ4/12
JanReimes(HEADacousticsGmbH)
CollaborationonIntelligentTransportSystemsCommunicationStandards(CITS)
15March2024
IntroductiontoQ4/12
"
Objectivemethodsforspeechandaudioevaluationinvehicles
"
WP1inSG12:"Terminalsandmultimediasubjectiveassessment"
2.1
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
"
Objectivemethodsforspeechandaudioevaluationinvehicles
"
WP1inSG12:"Terminalsandmultimediasubjectiveassessment"
•Maintopicsinscope(alwaysspeech-/audio-related):
•Safetyaspects:driverdistraction&emergencysystems
•QoEofspeechcommunicationterminals
2.2
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
"
Objectivemethodsforspeechandaudioevaluationinvehicles
"WP1inSG12:"Terminalsandmultimediasubjectiveassessment"
•Maintopicsinscope(alwaysspeech-/audio-related):
•Safetyaspects:driverdistraction&emergencysystems
•QoEofspeechcommunicationterminals
•Our"coreRecommendations":
•Hands-freetelephonyP.1100/1110/1110(NB/WB/SWBcodecs)
•Emergencycall(eCall)systemsP.1140
•In-carcommunication(ICC)P.1150
•SpeechdialoguesystemsP.ASR(newworkitem!)
2.3
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
"
Objectivemethodsforspeechandaudioevaluationinvehicles
"WP1inSG12:"Terminalsandmultimediasubjectiveassessment"
•Maintopicsinscope(alwaysspeech-/audio-related):
•Safetyaspects:driverdistraction&emergencysystems
•QoEofspeechcommunicationterminals
•Our"coreRecommendations":
•Hands-freetelephonyP.1100/1110/1110(NB/WB/SWBcodecs)
•Emergencycall(eCall)systemsP.1140
Activework!
•In-carcommunication(ICC)P.1150
•SpeechdialoguesystemsP.ASR(newworkitem!)
2.4
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
HowourRecommendationsaredrafted:
3.1
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
IntroductiontoQ4/12
HowourRecommendationsaredrafted:
•Testmethodologiesandperformancerequirementsofvehicle-relatedspeechcommunicationsystemsinonedocument.
3.2
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
IntroductiontoQ4/12
HowourRecommendationsaredrafted:
•Testmethodologiesandperformancerequirementsofvehicle-relatedspeechcommunicationsystemsinonedocument.
•Intendedtobeusedforqualification(orevencertification)purposes.
3.3
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
HowourRecommendationsaredrafted:
•Testmethodologiesandperformancerequirementsofvehicle-relatedspeechcommunicationsystemsinonedocument.
•Intendedtobeusedforqualification(orevencertification)purposes.
•Realisticevaluationofwholesystems:
3.4
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
HowourRecommendationsaredrafted:
•Testmethodologiesandperformancerequirementsofvehicle-relatedspeechcommunicationsystemsinonedocument.
•Intendedtobeusedforqualification(orevencertification)purposes.
•Realisticevaluationofwholesystems:
•Norequirementsonindividualcomponents
•Norequirementsonspecificimplementations
•Noaccesstointernalsisrequiredtoperformtesting("blackbox")
•Onlyusestandardizedelectricalandacousticalinterfaces
realistictestingfromtheuser'sperspective.
3.5
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
Testingprinciples-ExamplesetupforP.1100/1110/1120
4.1
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
Testingprinciples-ExamplesetupforP.1100/1110/1120
AntennaIHF
Loudspeakers(1.··M)
HFT
Bluetoothormobilenetwork
ones(1.··N)
Microph
4.2
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
Testingprinciples-ExamplesetupforP.1100/1110/1120
•Acoustictestequipment:Head-and-torsosimulator(HATS)fortalking/listening
AntennaIHF
Bluetoothormobilenetwork
HFT
Loudspeakers(1.··M)
ones(1.··N)
Microph
4.3
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
Testingprinciples-ExamplesetupforP.1100/1110/1120
•Acoustictestequipment:Head-and-torsosimulator(HATS)fortalking/listening
•Electricalinterface:Bluetooth,3G/4G/5Gradiotester,etc.
AntennaIHF
Loudspeakers(1.··M)
HFT
Bluetoothormobilenetwork
ones(1.··N)
Microph
4.4
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
Testingprinciples-ExamplesetupforP.1100/1110/1120
•Acoustictestequipment:Head-and-torsosimulator(HATS)fortalking/listening
•Electricalinterface:Bluetooth,3G/4G/5Gradiotester,etc.
Receivepath
AntennaIHF
TestEquipment
Receivepath
HFT
Bluetoothormobilenetwork
Listen
er
A
4.5
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
Testingprinciples-ExamplesetupforP.1100/1110/1120
•Acoustictestequipment:Head-and-torsosimulator(HATS)fortalking/listening
•Electricalinterface:Bluetooth,3G/4G/5Gradiotester,etc.
sendpath
AntennaIHF
Bluetoothormobilenetwork
TestEquipment
HFT
Talke
r
sendpath
4.6
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
Testingprinciples-ExamplesetupforP.1100/1110/1120
•Acoustictestequipment:Head-and-torsosimulator(HATS)fortalking/listening
•Electricalinterface:Bluetooth,3G/4G/5Gradiotester,etc.
sendpath
AntennaIHF
TestEquipment
sendpath
HFT
Bluetoothormobilenetwork
Talk
r
Driv tHAmicr
ngnoiseTS&inpuphone(s)
t
a
4.7
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
Testingprinciples–ExamplesetupforP.1100/1110/1120
•Acoustictestequipment:Head-and-torsosimulator(HATS)fortalking/listening
•Electricalinterface:Bluetooth,3G/4G/5Gradiotester,etc.
sendpath
AntennalHFΔ
(Bluetoothormobilenetwork)
QoEfactors:
•Delay
•FrequencyResponse
•Echo
•DoubleTalk
•Speechqualityundernoise
•…
HFT
TestEquipment
sendpath
Talk
r
Driv tHAmicr
ngnoiseTS&inpuphone(s)
t
a
4.8
©HEADacousticsGmbHCITS–StatusreportofQ4(ITU-TSG12)
Testingprinciples–ExamplesetupforP.1140(eCall)
•Similartestsetupforemergencycall(eCall)regardinginterfaces,…
AntennaIHF
Loudspeakers(1.··M)
ecalIHFT
Bluetoothormobilenetwork
ones(1.··N)
Microph
5.1
©HEADacousticsGmbHCITS–StatusreportofQ4(ITU-TSG12)
Testingprinciples–ExamplesetupforP.1140(eCall)
•Similartestsetupforemergencycall(eCall)regardinginterfaces,…
sendpath
AntennaHF
(Bluetoothormobilenetwork)
ecalIHFT
Receivepath
TestEquipment
sendpath
A
Receivepath
r
Talke
5.2
©HEADacousticsGmbHCITS–StatusreportofQ4(ITU-TSG12)
Testingprinciples–ExamplesetupforP.1140(eCall)
•Similartestsetupforemergencycall(eCall)regardinginterfaces,…
•…butclearlywithdifferentfocus!
sendpath
HF
B
b
rk
th
uet
enetw
Antenna
r
QoEfactors==Safetyfactors!
•Intelligibility
•Audiblebackground
•Conversationaspects:
•Delay
•Echo
•DoubleTalk•…
ecalIHFT
TestEquipment
Receivepath
sendpath
A
Receivepath
r
Talke
5.3
©HEADacousticsGmbHCITS–StatusreportofQ4(ITU-TSG12)
Testingprinciples–ExamplesetupforP.1150(ICC)
6.1
©HEADacousticsGmbHCITS–StatusreportofQ4(ITU-TSG12)
Testingprinciples–ExamplesetupforP.1150(ICC)
Talke
r
Dr
se
Liste
Directpath
ker&
attal
ngn
put
ph
Dr
ner
at
te
er
V
V
e
e
s
r
6.2
©HEADacousticsGmbHCITS–StatusreportofQ4(ITU-TSG12)
Testingprinciples-ExamplesetupforP.1150(ICC)
•Driver'svoiceiscapturedandreinforcedforpassengersviaICCsystem
•Decreaseddriverdistraction/talkingeffort
utputs:Loudspeakers1.MInputs:Mic.1…N
Ccsystem
Reinforcementsound
Talke
r
noise
Driving
atlistener
Directpath
Drivingnoise
attalker&inputmicrophone(s)
Listener
6.3
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
Testingprinciples-ExamplesetupforP.1150(ICC)
•Driver'svoiceiscapturedandreinforcedforpassengersviaICCsystem
•Decreaseddriverdistraction/talkingeffort
•TestingofICCsystemrealizedonlywithtwoHATSatdifferentpositions
utputs:Loudspeakers1.MInputs:Mic.1…N
Ccsystem
Reinforcementsound
Talke
r
noise
Driving
atlistener
Directpath
Drivingnoise
attalker&inputmicrophone(s)
Listener
6.4
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
NewworkitemP.ASR
7.1
©HEADacousticsGmbHCITS–StatusreportofQ4(ITU-TSG12)
NewworkitemP.ASR
•TitleofnewRecommendation:
"Specificationoftestmethods,guidelinesandperformancemetricsforautomaticspeechrecognition(ASR)"(titleissubjecttochange/WIP)
7.2
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
NewworkitemP.ASR
•TitleofnewRecommendation:
"Specificationoftestmethods,guidelinesandperformancemetricsforautomaticspeechrecognition(ASR)"(titleissubjecttochange/WIP)
•Differentdegreesofcomplexityinperformancemeasure:
•WER
•WakeWordDetection
•Commands
•NLP/semantics
7.3
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
•TitleofnewRecommendation:
"Specificationoftestmethods,guidelinesandperformancemetricsforautomaticspeechrecognition(ASR)"(titleissubjecttochange/WIP)
•Differentdegreesofcomplexityinperformancemeasure:
•WER
•WakeWordDetection
•Commands
•NLP/semantics
•Speechcommandscannotbegeneric-recreateonaregularbasis?
7.4
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
•TitleofnewRecommendation:
"Specificationoftestmethods,guidelinesandperformancemetricsforautomaticspeechrecognition(ASR)"(titleissubjecttochange/WIP)
•Differentdegreesofcomplexityinperformancemeasure:
•WER
•WakeWordDetection
•Commands
•NLP/semantics
•Speechcommandscannotbegeneric-recreateonaregularbasis?
•ConsiderationofdifferentASRsystems/classes
7.5
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
8.1
©HEADacousticsGmbHCITS–StatusreportofQ4(ITU-TSG12)
•Testingshouldbegenericallypossible(nocustominternalinterfaces),…
8.2
©HEADacousticsGmbHCITS–StatusreportofQ4(ITU-TSG12)
NewworkitemP.ASR
•Testingshouldbegenericallypossible(nocustominternalinterfaces),…
•…butthatwillnotworkasexpected.
8.3
©HEADacousticsGmbHCITS–StatusreportofQ4(ITU-TSG12)
NewworkitemP.ASR
•Testingshouldbegenericallypossible(nocustominternalinterfaces),…
•…butthatwillnotworkasexpected.
•Existingacousticinterfacecanused
be
8.4
©HEADacousticsGmbHCITS–StatusreportofQ4(ITU-TSG12)
•Testingshouldbegenericallypossible(nocustominternalinterfaces),…
•…butthatwillnotworkasexpected.
•Existingacousticinterfacecanbeused
•Nostandardizedinterfacefor…
•Recognizedwords/commands
•Actiontriggered
•etc.
8.5
©HEADacousticsGmbHCITS–StatusreportofQ4(ITU-TSG12)
•Testingshouldbegenericallypossible(nocustominternalinterfaces),…
•…butthatwillnotworkasexpected.
•Existingacousticinterfacecanbeused
•Nostandardizedinterfacefor…
•Recognizedwords/commands
•Actiontriggered
•etc.
•…usepen&paper?
8.6
©HEADacousticsGmbHCITS–StatusreportofQ4(ITU-TSG12)
•SpecificationofDiagnosticInterfaces(DI)arecrucialfortesting!
9.1
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
•SpecificationofDiagnosticInterfaces(DI)arecrucialfortesting!
•Currentproposal:Usethesameassuggestedin
Rec.ITU-TH.552"Implementationofvehicularmultimediasystems"
9.2
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
•SpecificationofDiagnosticInterfaces(DI)arecrucialfortesting!
•Currentproposal:Usethesameassuggestedin
Rec.ITU-TH.552"Implementationofvehicularmultimediasystems"
9.3
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
•SpecificationofDiagnosticInterfaces(DI)arecrucialfortesting!
•Currentproposal:Usethesameassuggestedin
Rec.ITU-TH.552"Implementationofvehicularmultimediasystems"
•DI-S4&DI-S5arehighlyrelevantforperformancetestinginP.ASR!
9.4
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
•
•
•
Specification
CurrentRec.ITU
DI-S4&
forperformance
9.5
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
•SpecificationofDiagnosticInterfaces(DI)arecrucialfortesting!
•Currentproposal:Usethesameassuggestedin
Rec.ITU-TH.552"Implementationofvehicularmultimediasystems"
•DI-S4&DI-S5arehighlyrelevantforperformancetestinginP.ASR!
9.6
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
NewworkitemP.ASR
•DI-S4(wordrecognition)andDI-S5(semanticresult)are
"themissingpiece"inthetestsetupforP.ASR
10.1
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
NewworkitemP.ASR
•DI-S4(wordrecognition)andDI-S5(semanticresult)are
"themissingpiece"inthetestsetupforP.ASR
10.2
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
NewworkitemP.ASR
•DI-S4(wordrecognition)and
DI-S5(semanticresult)are
"themissingpiece"inthetestsetupforP.ASR
•Allowsautomatedtestingofvoiceassistantfunctionality
10.3
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
•DI-S4(wordrecognition)and
DI-S5(semanticresult)are
"themissingpiece"inthetestsetupforP.ASR
•Allowsautomatedtestingofvoiceassistantfunctionality
•Signal-basedDIs:
•Simulatedacousticalinsertion
•Offlinetesting/qualificationofsystems
10.4
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
Conclusion
11.1
©HEADacousticsGmbHCITS–StatusreportofQ4(ITU-TSG12)
Conclusion
•Q4/12worksontestmethodsandperformancerequirementsforvehicle-
basedspeechcommunicationterminals
11.2
©HEADacousticsGmbHCITS-StatusreportofQ4(ITU-TSG12)
•Q4/12worksontestmethodsandperformancerequirementsforvehicle-
basedspeechcommunicationterminals
•"Blackboxapproach"fortesting–no
温馨提示
- 1. 本站所有资源如无特殊说明，都需要本地电脑安装OFFICE2007和PDF阅读器。图纸软件为CAD,CAXA,PROE,UG,SolidWorks等.压缩文件请下载最新的WinRAR软件解压。
- 2. 本站的文档不包含任何第三方提供的附件图纸等，如果需要附件，请联系上传者。文件的所有权益归上传用户所有。
- 3. 本站RAR压缩包中若带图纸，网页内容里面会有图纸预览，若没有图纸预览就没有图纸。
- 4. 未经权益所有人同意不得将文件中的内容挪作商业或盈利用途。
- 5. 人人文库网仅提供信息存储空间，仅对用户上传内容的表现方式做保护处理，对用户上传分享的文档内容本身不做任何修改或编辑，并不能对任何下载内容负责。
- 6. 下载文件中如有侵权或不适当内容，请与我们联系，我们立即纠正。
- 7. 本站不保证下载资源的准确性、安全性和完整性, 同时也不承担用户因使用这些下载资源对自己和他人造成任何形式的伤害或损失。
最新文档
- 2026初级审计师考试《审计理论与实务》押题试卷答案
- 2026年北京市烟草专卖局公司人员招聘考试模拟试题及详细答案解析
- 初中英语九年级语法复习教学设计：一般过去时与过去进行时深度辨析与核心素养落实
- 高中三年级理想信念教育主题班会教学设计-用勤奋浇灌理想之花
- 2026年GSP培训试题含答案
- 2026年安宁疗护考试题库及答案
- 2026年安徽省建筑施工企业安管人员A证模拟训练题库(含答案)
- 2026年中国建筑科学研究院有限公司人员招聘考试参考试题及详细答案解析
- 2026年中国电气装备集团有限公司人员招聘考试参考试题及详细答案解析
- 2026年中石油克拉玛依石化有限责任公司人员招聘笔试备考题库及详细答案解析
- 八上数学竞赛试题及答案
- 2026年中国农业银行秋季校园招聘即将开始考试笔试试题（含答案）
- 煤矸石购销合作合同范本
- 抖音直播合作协议书合同
- 重庆綦江县2025年上半年事业单位公开遴选试题含答案分析
- 出生医学证明警示教育
- 《系统工程》课件 第1章绪论
- TD/T 1001-2012地籍调查规程
- 秋冬季节老年人疾病预防指南
- 《森林生态恢复》课件
- 心脏瓣膜病教案
评论
0/150
提交评论