非结构化数据管理原理与实现技术

1、Managing Unstructured Data (非结构化数据管理非结构化数据管理)AgendaMotivation9 Important IssuesBUD - Bank of Unstructured DataA Reference FrameworkCase StudyVideo Management PlatformNear Future WorksMotivation-Why focus on USD?uUnstructured Data is value-addedvarious potential values, NOT burden information, trend,

2、 knowledge, patternspervasivenon-formed is everywherevolume increases exponentialy80% unstructured, incl. web data, vid/auduBUD - a reference frameworkmanage unstructured dataextract information with time-goingBUD - A Reference FrameworkArchitecturelayeredextensiblescalabledistributed*DB approachDB-

3、Arch.-like9 Important Issues on USD1. fully extensible architecture2. universal data modelthe unstructured has unknown structure3. distributed TSM adaptive data portal4. evolving metadata repos.open sesame 5. QoSunderstand the semantics9 Important Issues on USD7. version mgmtrefined vs. purging8. op

4、timizationimprecise information9. standardized unified query languagestandard makes easy interoperation10.killer application optional but ImportantCase #1 -Video Mgmt Platform example scenarioTo recognize customers who had been the store and bought somethingbefore. Once identifying them, VMP alerts

5、salespersons to providethem better shopping experience, eg. special offers or recommendation. Func: recognition - pattern retrieval - real-time help research topics extensible and scalable architecture hybvideo/UHS(Uninterrupted Helper System) fast knowledge(eg. behavior pattern) mining adaptive sto

6、rage mgmt refinement iterativelyCase #1 -Video Mgmt Platform Basic ArchitectureNeare Future Works Compliance with BUD SOA Optimization feedback-based Advanced keyword search interplay of rel.+semi.+usd Many open problems to be solved just kick-offThanksDiscussion&Questions&Suggestions欢迎讨论数据库体系结构数据库体系结构(数据