数据仓库及应用数据仓库

1、数据仓库数据仓库杭诚方杭诚方 教授教授what is data warehouse data warehouse is a very large database that stores integrated data of one or more business subject areas data warehouse is built to support data analysis for decision making integrated customer data warehouse is a necessary step to the success of the busine

2、ss intelligence strategy data warehouses are also used for many other purposes such as product manufacturing data warehouses data warehouses become the focal point in the enterprise-wide it infrastructurewhat is data warehouse?what is data warehousewhat is data warehousea data warehouse is simply a

3、single, complete, and consistent store of data obtained from a variety of sources and made available to end users in a way they can understand and use in a business context. what is data warehousewhat is data warehousedata warehouse definitionsdata warehouse definitionsthe key elements in the defini

4、tions:subject-oriented: presentation as business subjects, not as computer files.integrated: a single source of information for and about the business.non-volatile: stable information that doesnt change each time an operational process is executed.time-variant: containing a history of the business,

5、as well as current business information.accessible: the primary purpose of a data warehouse is to provide readily accessible information to business people.subject-orientedsubject-orientedintegratedintegratedintegratedintegrated网管系统财务管理系统市场分析决策系统telcom dwsystem分析型大客户crm系统信用度管理客服系统客服系统(call center 10

6、00/180/112/170）系统）系统其它电信专业网业务系统“九七工程九七工程”之营业管之营业管理生产调度系统理生产调度系统（配线（配线/配号配号/开通）开通）112故障查修故障查修系统资源管理系统系统资源管理系统170/催缴系统营催缴系统营业系统业系统本地公司/ic卡/磁卡管理系统网上营业系统商务管理层省级计费结算计费帐务系统中心业务管理层网络及网元管理层电信网网元non-volatilenon-volatiletime varianttime variantaccessibleaccessibledata warehouse characteristicsdata warehouse c

7、haracteristicsdata warehouse separates functions from operational systems. propertyoperationaldata warehouseresponse timesub-second to secondsseconds to hoursdata operationdmlprimarily read onlynature of data30-60 dayssnapshots over timedata organizationapplicationsubject, timesizesmall to largelarg

8、e to very largedata sourcesoperational, internaloperational, internal, externalactivitiesprocessesanalysisdata warehouse characteristicsdata warehouse characteristicsdata warehouse serves as a central repository for recording everything about the business for information retrieval. data is loaded fr

9、om internal business operational system, and external systems. data warehouse characteristicsdata warehouse characteristicsa data warehouse has a fundamental effect on how the users see the data available about the organization, what to do with it and how to use it for decision making.data warehouse

10、 characteristicsdata warehouse characteristicsdata warehouse characteristicsdata warehouse characteristicsa data warehouse is not a single software or hardware product you purchase to strategic. it is a computing environment where users can find strategic information to make better decisions. it is

11、a user-centric environment.data warehouse characteristicsdata warehouse characteristicsdata warehouse is a blend of many different technologies needed for supporting the various functions of a data warehouse environment. these different technologies all work together in a data warehouse environment.

12、applicationadministrationstorage managementanalysisdata managementdata modelingdata acquisitiondata warehouseenterprise data warehouseenterprise data warehouseenterprise data warehouses are funded on a corporate basis. enterprise data warehouse covers the entire business (corporation), incorporating

13、 data from all operational systems. information is extracted from the operational environment, cleansed, and transformed into a central, integrated enterprise-wide data warehouse environment, so that all the departments and other internal organizations of the corporation can benefit from a consisten

14、t, integrated source of decision support information. data martdata martdata marts are often funded on a departmental basis. data mart is a collection of data tailored to the dss processing needs of a particular department. it is a subset of a enterprise data warehouse that has been customized to fi

15、t the needs of a department. data marts serve users at a specific level, or for a specific department. data warehouse versus data martdata warehouse versus data mart propertydata warehousedata martscopeenterprisedepartmentsubjectsmultiplesingle-subjectdata sourcemanyfewsize (typical) tb tbimplement

16、time months to yearsmonthsdata martdata martdata martdata martcontrol: a department can completely control the data and processing that occurs inside a data mart.cost: the cost of storage and processing is less, because the data marts machine is smaller than dwscustomization: the data marts data is

17、customized to suit the peculiar needs of the department.data martdata martdata martdata martdata martdata martdependent data mart: the source is the data warehouse. the extraction, transformation, and loading process is easy. the data mart is part of the enterprise plan.independent data mart: the so

18、urce are operational system external source. the extraction, transformation, and loading process is difficult. the data mart is built to satisfy analytical needs.operational data store (ods)operational data store (ods) integrate information from the production system. relieve the production systems

19、reporting and analysis demands. provide access to current data.odsodsodsodsods looks very much like a data warehouse, such as subject-oriented, and integration. however, the remaining characteristics of an ods are quite different from a data warehouse:volatile: an ods can be updated as a normal part

20、 of processing.current-values: an ods typically contains daily, weekly, or even monthly data, but the data ages very quickly.detailed data: an ods contains detailed data only.different classes of the odsdifferent classes of the odsclass i: a synchronous interface in which a very, very small amount o

21、f time lapses between an applications transaction and the reflection of the transaction in the ods.class ii: if an hour or two passes from the time a transaction is created and interacted in the application environment until that transaction is reflected in the ods.class iii: there may be a time lag

22、 between 12 hours and a day as transaction data is collected in the i&t interface.class iv: the data is fed into the ods directly from the data warehouse.determining the classdetermining the class speed of movement of data into the ods volume of data that must be moved volume of data that must be stored in intermediate location during i & t processing update of data and integrity of transaction processing the time of day the movement needs to occurdata architecture