建构于I之无线多媒体技术及应用英文版.ppt

建構於IP之無線多媒體技術及應用WirelessMulti mediaoverIP TechnologiesandApplications主持人 李琳山共同主持人 貝蘇章 吳家麟參與研究教授 鄭士康 陳良基 陳志宏 馮世邁李宇旼 歐陽明 陳文進 黃肇雄 大綱 計劃主題及目標本年度主要工作項目本年度重要成績舉例及展示計劃產出列表下年度工作計劃總檢討及結論 方向調整 90年度教育部考評委員會評語 在原核定項目下進行良好 唯有若干核定項目與電信關連性較低 應考慮調整計劃重心 90年7月決定調整方向 智慧型訊號處理與多媒體資訊環境 IntelligentSignalProcessingandMulti mediaInformationEnvironment 建構於IP之無線多媒體技術及應用 WirelessMulti mediaoverIP TechnologiesandApplications 以無線通訊及IP環境下之多媒體技術為主軸 FutureNetworkEra Multi media Multi lingual Multi functionalities Cross cultures Cross domains Cross regions IntegratingAllKnowledge Information ServicesGloballyMostAttractiveRepresentationforKnowledge Information ServiceswillbeinformofMulti mediaSignals WirelessCommunicationsareCreatingaWholeVarietyofUserTerminalsandaCompletelyNewUserEnvironment NetworkAccessatAnyTime fromAnywherePersonalNotebooks Handsets PDA s Hand heldDevices SmallinSize LightinWeight Ubiquitous Keyboard MouseMostConvenientforPC snotConvenientanylongerhumanfingersnevershrink andapplicationenvironmentischangedMulti mediaSignalswillbetheMostConvenientInterfaceforALLUserTerminalsatAnyTime fromAnywhere WirelessCommunicationsareCreatingaCompletelyNewTransmission NetworkingEnvironment InformationFlowfromServerstoUsersviaBothWiredandWirelessNetworksManyDifferentNetworkTechnologiesforWiredandWirelessCo existing LinkLevelCharacteristicsforWirelessvsWired WirelessLinksexamples PersonalAreaNetworks Bluetooth etc WirelessLAN IEEE802 11 Cellular GSM GPRS 3G etc time varyingfadingandnoisecharacteristicstime varyingsignallevelandsignal to noiseratiosburstyerrorswithmuchhighererrorratesmuchsmalleranddynamicbandwidth muchlowerandchangingbitrateshighlyunreliablesupportingmobility atanytime fromanywhere TransportLevelIssuesinWirelessMulti media UDP IP Real time NoRetransmission DelayasinTCP IPErrorsPacketLossReal timeTransmissionwithLostInformationPacketsoutofSequenceProblemsofWirelessMulti mediamulti mediaapplicationsrequirereal timecontinuoustransmissionofhugequantitiesofdatasmalleranddynamicbandwidthoffersonlylimitedandtime varyingdataratesburstyerrorswithhighererrorratesaredifficulttocorrecterrorstranslatedtopacketloss whicharenotacceptablepacketsoutofsequencealsocreatingproblemstime varyingtransmissionqualityevenvariesacrossdifferentwirelesstechnologies ProposedApproachforWirelessMulti media ImprovedLinkLevelTechnologiesbetterlinkqualityEnhancedTransportLevelProtocolstoaccommodatemulti mediatrafficandlinkunreliabilityDeveloping ConvergenceFunctionalities intheApplicationLevelwirelesslinklevelproblemsandtransportlevelvariationsbecometransparentto coretechnologies coretechnologies shieldedfromandequallyapplicabletoalldifferentlink transportenvironmentsexamples scalability errorconcealment etc Robust CoreTechnologies includingIntelligentUserInterfacesCombattingwithresidualerrorsExamples signalverification errorresilience etc Intelligentuserinterfacefordifferentterminals WirelessMulti mediaoverIP WirelessMulti mediaoverIP Year2001 MostLink TransportLevelTechnologieshavebeenWellStandardizedandWidelyUsedimpactduetoenhancementlesseasyMostEffortsConcentratedonApplicationLevel Multi mediavirtualrealityvideoaudiospeechtext BasicSignalProcessinganalysissegmentationdetection Robustness ErrorConcealment Scalability MissionStatement BasicResearchdevelopingfundamentaltechnologiesformulti mediaconsideringissuescreatedbywirelesscommunicationslinkunreliabilityanduserinterfacerequirementslinklevel transportlevel convergencefunctionalitiesandcoretechnologiesApplicationTasksmulti mediainformationstreamingandretrievalAcademicPrototypeSystemstechnologydemonstration AcademicPrototypeSystems ApplicationTasks BasicResearch IntegrationwithOtherSubprojects WirelessMulti mediaoverIP TechnologiesandApplications MicrowaveandMillimeter waveTechnologies CommunicationsandNetworkingTechnologies 0110 1101 satellites servers GlobalKnowledge InformationandServices radio fiber C cable Networks WirelessMulti mediaoverIP Year2001 MostLink TransportLevelTechnologieshavebeenWellStandardizedandWidelyUsedimpactduetoenhancementlesseasyMostEffortsConcentratedonApplicationLevel Multi mediavirtualrealityvideoaudiospeechtext BasicSignalProcessinganalysissegmentationdetection Robustness ErrorConcealment Scalability ImprovedTransmissionTechnologiesforWireless BlockTimeDivisionMultiplexing BTDM OrthogonalFrequencyDivisionMultiplexing OFDM AMainstreamTransmissionTechnologyforWireless Multi carrierwithManyAttractivePropertiesDifficultiessufferingfromperformanceflooringinthepresenceofspectralnullshighpeak to averagepowerratio PAPR requiringspecialconsiderationsfortransmitteramplifier BTDMSystemBlockDiagram NicePropertiesnoperformanceflooringinthepresenceofspectrallnullsverysmallpeak to averagepowerratioshowntobetheoptimalchannelindependenttransmitterthatminimizesthebiterrorrate BER ImprovedTransmissionTechnologiesforWireless BlockTimeDivisionMultiplexing BTDM ExampleResultsLinearTimeInvariantChannelwithaSpectralNull 3 10dbGainoverOFDMObserved RayleighfadingChannel ImprovedTransmissionTechnologiesforWireless BlockTimeDivisionMultiplexing BTDM WirelessMulti mediaoverIP Year2001 MostLink TransportLevelTechnologieshavebeenWellStandardizedandWidelyUsedimpactduetoenhancementlesseasyMostEffortsConcentratedonApplicationLevel Multi mediavirtualrealityvideoaudiospeechtext BasicSignalProcessinganalysissegmentationdetection Robustness ErrorConcealment Scalability VideoStreaming I ReversibleVariableLengthCode RVLC VariableLengthCodedifferentcodelengthfordifferentsymbolswithdifferentprobabilitiesaveragebitrateminimizedforcompressionpurposesencoded decodedinforwarddirectiononlyerrorsmaypropagateReversibleVariableLengthCode RVLC canbedecodedinboththeforwardandbackwarddirectionstoeliminateerrorpropagationandenhanceerror resiliencecapabilities VideoStreaming I ReversibleVariableLengthCode RVLC TwotypesofRVLCSymmetricRVLC onlyonecodetablerequiredforbothforwardandbackwarddecodingAsymmetricRVLC twocodetablesrequired oneforforwarddecodingandtheotherbackward VideoStreaming I ReversibleVariableLengthCode RVLC BetterCompressionAchievedbyProposedTechniques VideoStreaming I ReversibleVariableLengthCode RVLC VideoStreaming II AnIntegratedErrorHandlingSystem DifferentErrorHandlingTechnologiesatDifferentStagesIntegratedBasedonH 263VideoCodecTechnologiesIntegratedResynchronizationPeriodicallyRefreshingDataPartitioningReversibleVariableLengthCodeForwardErrorCorrectionCodeErrorConcealment VideoStreaming II AnIntegratedErrorHandlingSystem SystemInterface VideoStreaming II AnIntegratedErrorHandlingSystem TypicalExperimentalResultExample VideoStreaming III ErrorHandlingwithVideoProxy NoErrorbitstreamstoredatProxyanddeletedafterARQconfirmed ErrorsOccurimportantinformation e g motionvectors resent whileothersdependingonavailablebandwidthpacketlossmessagesenttosourcerequestingratecontrol VideoStreaming III ErrorHandlingwithVideoproxy Results ErrorFree RandomError1e 3 RandomError1e 3w FEC RandomError1e 3w VideoProxy Forman64kbit secQCIF10fps VideoStreaming III ErrorHandlingwithVideoproxy VideoStreaming IV ScalableVideoCompression DataRateScalabilitybandwidth dataratemuchsmallerandtime varyinginwirelessnetworksSpatialScalabilitydifferentuserterminalsrequiringdifferentvideosizesTemporalScalabilitytradingframeratewithpictureresolutionSNRScalabilitydifferentuserterminalsrequiringdifferentSNRconditionsCoreTechnologiesdiscreteWaveletTransformforspatialcompressionmotionestimation compensationfortemporalcompression VideoStreaming IV ScalableVideoCompression SpatialScalabilityExamples VideoStreaming IV ScalableVideoCompression TemporalScalabilityExample TradingFrameRatewithPictureResolution 30fps 15fps WirelessMulti mediaoverIP Year2001 MostLink TransportLevelTechnologieshavebeenWellStandardizedandWidelyUsedimpactduetoenhancementlesseasyMostEffortsConcentratedonApplicationLevel Multi mediavirtualrealityvideoaudiospeechtext BasicSignalProcessinganalysissegmentationdetection Robustness ErrorConcealment Scalability Multi mediaInformationRetrieval ToFindtheDesiredMulti mediaInformationoutoftheHugeQuantitiesofDataovertheNetworksMulti mediaInformationisDifficultforPatternMatching BrowsingandRetrievingErrorsandBandwidthLimitationsforWirelessContent basedMulti mediaInformationRetrieval Multi mediaInformationRetrieval I ImageRetrieval ShapeIndexingFeaturesMPEG 7ShapeDescriptorColorIndexingFeaturesColorHistogramRegionalColorTextureIndexingFeaturesAngularSecondMomentInverseDifferenceMomentContrastEntropy Multi mediaInformationRetrieval I ImageRetrieval TypicalExperimentalResultExamplesColorHistogram basedImageQuery Multi mediaInformationRetrieval I ImageRetrieval TypicalExperimentalResultExamplesRegionalColor basedImageQuerywith withoutLogicScheme Multi mediaInformationRetrieval I ImageRetrieval TypicalExperimentalResultExamplesTexturebasedImageQuery BothColorandTextureImageQuery Multi mediaInformationRetrieval II 3DObjectRetrieval PrimarilyBasedontheSkeletalandTopologicalStructuresof3DObjectsCalculatingthesumoftheGeodesicdistancefromeachvertextoallothersAReebGraphgeneratedwitheachnoderepresentingaregionaccordingtothesevaluesSimilaritybetweentwoobjectscalculatedfromthenodesontheReebGraphsRobustagainstTranslation Rotation Scaling Simplification Subdivision Noise Deformation AnExamplehttp 3dsite dhs org dynamic445objectsinthedatabase0 08secforcomparingtwoobjectsontheaverage Multi mediaInformationRetrieval II 3DObjectRetrieval Multi mediaInformationRetrieval III MusicRetrieval AudioRetrieval SymbolicMusicDatabase MIDIFiles RetrievedMusic SymbolicNotes AutomaticTranscription MusicQuery AutomaticTranscription MusicDocuments SymbolicNotes SpecialFeature MelodyExtractionincludingOctaveDectionATypicalExample Multi mediaInformationRetrieval III MusicRetrieval SpeechmaybecomeaNewDataType iftheDifficultiesinBrowsingandRetrievalcanbeOvercomeApplicationExamples PersonalMemo MeetingMinutes PersonalPhoneRecords VoiceMailDatabases CourseLecturesDatabases BroadcastPrograms Multi mediaInformationRetrieval IV Voice basedInformationRetrieval TypicalExperimentalResultsforMandarinChineseinNon interpolatedAveragePrecisionSyllable basedisthebestwhenS N N 1 3 P M M 1 3included exceptcharacter basedisthebestforTQ TD TQ TextQueriesTD TextDocumentSQ SpokenQueriesSD SpokenDocument S N N 1 S N N 1 2 S N N 1 3 P M M 1 3 Multi mediaInformationRetrieval IV Voice basedInformationRetrieval InitialStudiesforKeywordSpottingPerformanceunderWirelessEnvironmentPerformanceDegradationduetoQuantizationErrorsat4 4KbpsSignalVerificationTechniquesoftheCoreTechnologiesEssentiallySolvetheProblemTransmissionErrors BurstyErrors ErrorConcealmentunderStudies Multi mediaInformationRetrieval IV Voice basedInformationRetrieval Multi mediaInformationRetrieval Demo RadioStation ChineseText Speech VideoNewsCollectedfromInternetandBroadcastRadioandStoredinaServerUserRetrievingtheDesiredNewsviaaNotebookPCorPDAdifferentlevelofinformationretrievedatdifferentuserterminals 請幫我找 or 請幫我查 astheKeywordsforInitializingtheVoice basedRetrievalspokendialogueinteractionswithmulti modalityNewsCorporaEasytoObtain withPlentyofNewWordsandaVarietyofSubjectsRelativelyHighDegreeofDifficultiesSuitableforAcademicResearch Multi mediaInformationRetrieval Demo AnExample 與國內產業界之互動舉例 舉辦成果說明會廣邀產業界同仁參與 時間 九十一年三月二十一日 星期四 9 30a m 1 30p m 議程 1 Overview 9 30 10 00a m 2 Demo Poster 共12小組 10 00 11 15a m 3 綜合討論 11 15a m 1 30p m 出席單位 工研院 資策會 中華電信 微軟研究院 飛利浦 廣達電腦 友立資訊 倚天資訊 台達電子 華邦電子 太極影音 格力齊 圓剛科技 阡暉科技 訊連科技 禛旺科技 新愷科技 新視科技 聲碩科技 訊流科技 捷聲通訊 晶睿通訊共計22個單位 47人 主要共識 1 本計畫有不少成果都有潛力可以促進國內相關產業之技術升級2 進一步交流合作受到高度期待3 就應用科技領域的卓越計畫而言 促進國內產業技術升級的潛力應是所謂 卓越 的重要指標之一 與國際學界互動舉例 參與籌辦GlobalTelecommunicationsConference Globecom 2002 InternationalConferenceonCommunications ICC 與Globecom為IEEECommunicationsSociety IEEE所屬第二大Society 的兩個涵蓋所有領域的年度FlagshipConferences亞洲到目前為止主辦過的城市只有東京及新加坡TechnicalProgramChair 李琳山 Co Chair 陳光禎IEEECommunicationsSociety所有行政性會議同時在ICC Globecom召開 故所有現任主管及核心人物均將與會 President主持的BoardofGovernorsMeetingVicePresident TechnicalAffairs主持的TechnicalAffairsCouncilMeetingDirectorofJournals主持的JournalPublicationsBoardMeetingEditors in Chief及TechnicalCommitteeChairs主持的相關會議學界 工業界各領域 各地區重要領袖人物幾乎到齊2002年為IEEECommunicationsSociety50週年 特以ICC2002 紐約 IEEE總部 及Globecom2002 台北 紐約的地球的對面 作為慶祝及GrandReunion會場 以彰顯其全球性歷年前後任Presidents至少6人 前後任VicePresidents至少20人與會回顧過去 展望未來的SpecialSession中KeynoteSpeakers至少包括 N Abramson originaldeveloperofALOHA C Kao theFatherofOpticalFiberCommunications G Ungerboeck inventorofTrellis codedModulation 等關鍵領域的pioneers及國際大獎得獎人 90年度計畫產出列表 一 國際期刊論文已發表及接受32篇Y P LinandS M Phoong ISIfreeFIRfilterbanktransceiversforfrequencyselectivechannels IEEETrans SignalProcessing pp 2648 2658 Nov 2001 Y P LinandS M Phoong OptimalISIfreeDMTtransceiversfordistortedchannelswithcolorednoise IEEETrans SignalProcessing pp 2702 2712 Nov 2001 Y P LinandS M Phoong MinimumRedundancyforISIfreeFIRDMTTransceivers acceptedforpublicationinIEEETrans SignalProcessing 2002 S M PhoongandY P Lin OptimalBiorthogonalTransformforColoredNoiseSuppressionwithSubbandWienerFiltering acceptedforpublicationinIEEESignalProcessingLetters 2002 Lin ShanLeeandYuminLee VoiceAccessofGlobalInformationforBroadbandWireless TechnologiesofTodayandChallengesofTomorrow ProceedingsoftheIEEE Vol 89 No 1 pp 1 17 Jan 2001 90年度計畫產出列表 S C PeiandP H Wang AnalyticaldesignofmaximallyflatFIRfractionalHilberttransformers SignalProcessing Vol 81 pp 643 661 2001 S C PeiandC C Tseng Aneweigenfilterbasedontotalleastsquareserrorcriterion IEEETrans onCircuitsandSystems partI FundamentalTheoryandApplications Vol 48 No 6 pp 699 709 June2001 S C PeiandP H Wang Closed formdesignofmaximallyflatFIRHilberttransformers Differentiators andFractionalDelayersbyPowerSeriesExpansion toappearinIEEETrans onCircuitsandSystems PartI FundamentalTheoryandApplications Vol 48 No 4 pp 389 398 April2001 S C PeiandJ J Ding Two dimensionalgeneralizedaffinefractionalFouriertransform IEEETrans onSignalProcessing Vol 49 No 4 p 878 897 April2001 S C PeiandJ J Ding Relationsbetweenfractionaloperationsandtime frequencydistributionsandtheirapplications IEEETransonSignalProcessing Vol 49 No 8 pp 1638 1655 Aug 2001 90年度計畫產出列表 C C TsengandS C Pei StableIIRnotchfilterdesignwithoptimalpoleplacement IEEETrans onSignalProcessing Vol 49 No 11 pp 2673 2681 Nov 2001 S C PeiandM H Yeh Thediscretefractionalcosineandsinetransforms IEEETransonSignalProcessing Vol 49 No 6 pp 1198 1207 June2001 C K Chen P C Tseng Y C ChangandL G Chen ADigitalSignalProcessorwithProgrammableCorrelatorArrayArchitecturefor3rdGenerationWirelessCommunicationSystem IEEETrans onCircuitsandSystemsII AnalogandDigitalSignalProcessing 2001 accepted T H Tsai R J WuandL G Chen ACost EffectiveDesignforMPEG 2AudioDecoderwithEmbeddedRISCCore JournalofVLSISignalProcessing Vol 29 pp 255 265 Nov 2001 SCI EI 90年度計畫產出列表 P C Tseng C K ChenandL G Chen CDSP AnApplication SpecificDigitalSignalProcessorforThirdGenerationWirelessCommunications IEEETrans onConsumerElectronics Vol 47 pp 672 677 No 3 Aug 2001 J F Shen T C WangandL G Chen ANovelLow PowerFullSearchBlock MatchingMotionEstimationDesignforH 263 IEEETrans onCircuitsandSystemsforVideoTechnology Vol 11 No 7 pp 890 897 July2001 SCI EI C Y Chen Z L Yang T C WangandL G Chen AProgrammableParallelVLSIArchitecturefor2DDiscreteWaveletTransform JournalofVLSISignalProcessing Vol 28 pp 151 163 July2001 SCI EI P C WuandL G Chen Anefficientarchitecturefortwo dimensionaldiscretewavelettransform IEEETrans onCircuitsandSystemsforVideoTechnology Vol 11 No 4 pp 536 545 April2001 SCI EI 90年度計畫產出列表 Yi ShinTung Ja LingWu His KangTsaoandChi HuiHuang AHighlyRate ScalableSystemBasedonMPEG 4Spatial Temporal FGSVideoCoding AdvancesinAutomation MultimediaandVideoSystems andModernComputerScience ISBN960 8052 44 0 WSESPress pp 320 325 Chien WuTsaiandJa LingWu ModifiedSymmetricalReversibleVariableLengthCodeAndItsTheoreticalBounds IEEETransactionsonInformationTheory Vol 47 No 6 pp 2543 2548 Sept 2001 Chien WuTsaiandJa LingWu OnConstructingtheHuffman CodeBasedReversibleVariableLengthCodes IEEETransactionsonCommunications Vol 49 No 9 pp 1506 1509 Sept 2001 P C Cheng J H Chen S C HwangandC K Sun Three dimensionalreconstructionsofZeamaysstembymagneticresonanceimaging MRI technology ScanningVol 23 2pp 98 99 2001 90年度計畫產出列表 Kai HsiangChuangandJyh HorngChen IMPACT Image basedPhysiologicalArtifactsEstimationandCorrectionTechniqueforfMRI MagneticResonanceinMedicine 46 344 353 2001 Ching PoLin Wen YihIsaacTseng Hui ChengChengandJyh HorngChen ValidationofDiffusionTensorMagneticResonanceAxonalFiberImagingwithRegisteredManganese enhancedTractography NeuroImage 14 1035 1047 2001 M J Chiu C C Lin K H Chuang J H ChenandK M Huang TissueSegmentation AssistedAnalysisoffMRIforHumanMotorResponse AnApproachCombiningArtificialNeuralNetworkandFuzzyCMeans J DigitalImaging Vol 14 No 1 March2001 pp38 47 H S Chen F R Guo C Y Chen J H ChenandT S Kuo ReviewofTelemedicineProjectsinTaiwan Int J MedicalInformatics May2001 61 2 3 17 29 90年度計畫產出列表 Bor shenLinandLin shanLee Computer aidedAnalysisandDesignforSpokenDialogueSystemsBasedonQuantitativeSimulations IEEETransactionsonSpeechandAudioProcessing Vol 9 No 5 July2001 pp 534 548 Jeih weihHung Jia linShenandLin shanLee NewApproachesforDomainTransformationandParameterCombinationforImprovedAccuracyinParallelModelCombination PMC Techniques papertoappearonIEEETransactionsonSpeechandAudioProcessing Nov2001 BerlinChen Hsin MinWangandLin shanLee DiscriminatingCapabilitiesofSyllable basedFeaturesandApproachesofUtilizingThemforVoiceRetrievalofSpeechInformationinMandarinChinese toappearonIEEETransactionsonSpeechandAudioProcessing Fu ChiangChou Chiu YuTsengandLin shanLee ASetofCorpus basedText to speechSynthesisTechnologiesforMandarinChinese toappearonIEEETransactionsonSpeechandAudioProcessing 90年度計畫產出列表 S C PeiandC L Lai Amorphologicalapproachoftargetdetectiononperspectiveplane bSignalProcessing Vol 81 pp 1975 1984 2001 S C Pei C L TsengandC C Wu Usingcolorhistogramnormalizationforrecoveringchromaticillumination changedimages J Opt Soc Am A Vol 18 No 11 pp 2641 2658 Nov2001 90年度計畫產出列表 二 國際會議論文已發表及接受55篇Y P Lin Wei LuanWengandS M Phoong BlockBase