WEB数据挖掘课件_10.ppt

1、刘 均 电信学院系统结构与网络研究所,WEB MINING日志挖掘,主要内容,Web Usage Mining的定义 Web Usage Mining的分类 Web Usage Mining的应用 Web Usage Mining的方法 预处理方法 挖掘方法,Web Usage Mining 定义,WUM的定义,Application of data mining techniques to discover usage patterns from web log data,WUM的定义,通过根据Web日志记录的挖掘，发现用户访问Web页面的模式，以期改进站点的性能和组织结构，提高Web用户查

2、找信息的质量和效率；并通过统计和关联的分析找出特定用户与特定地域、特定时间、特定页面等要素之间的内在联系，为用户提供个性化的服务。,Web Usage Mining 分类,Web Usage Mining的分类,WUM在Web Mining中的位置 从挖掘的目标：公共的、个体的 从挖掘数据的类型 从挖掘的数据源：客户端、代理、WEB服务器,Web Mining 分类,Web Usage Mining,Web Structure Mining,Web Content Mining,Web Page Content Mining,Search Result Mining,Web Usage Min

3、ing,General Access Pattern Tracking Web Log Mining Uses KDD techniques to understand general access patterns and trends. Can shed light on better structure and grouping of resource providers.,Customized Usage Tracking,Web Usage Mining,Web Usage Mining,General Access Pattern Tracking,Customized Usage

4、 Tracking Analyzes access patterns of each user at a time. Web site restructures itself automatically by learning from user access patterns.,Web Structure Mining,Web Content Mining,Web Page Content Mining,Search Result Mining,Data available,Server logs Error logs Cookie logs Query data,Data Sources,

5、W3C Extended Log File Format,WUM Server logs,123.456.78.9 - - 24/Oct/1999:19:13:44 0400 “GET /Images/tagline.gif HTTP/1.0” 200 1449 “Mozilla/4.51 en (Win98;I)”,Proxy Log,0 - - 23/Jan/1998:11:21:33 +0100 GET TCP_DONE 21495 4 - - 23/Jan/1998:11:21:52 +0100 GET http:/www.panda.c

6、z/simpsons/simpicon.zip TCP_MISS 0 4 - - 23/Jan/1998:11:21:54 +0100 GET http:/www.panda.cz/simpsons/pict/nuclearplant.gif TCP_DONE 2726 0 - - 23/Jan/1998:11:22:10 +0100 GET 1/campus/graphics/2girls.jpg TCP_DONE 33371 4 - - 23/Jan/1998:11:22:40 +01

7、00 GET http:/www.panda.cz/simpsons/pict/school.gif TCP_DONE 3184 4 - - 23/Jan/1998:11:28:41 +0100 GET http:/www.panda.cz/simpsons/pict/simpcity.jpg TCP_DONE 80729 4 - - 23/Jan/1998:11:35:30 +0100 GET http:/www.panda.cz/simpsons/simpicon.zip TCP_DONE 131322 4 - - 2

8、3/Jan/1998:11:37:54 +0100 GET http:/www.panda.cz/simpsons/simpicon.zip TCP_HIT 131322,Web Usage Mining 应用,Web Usage Mining的应用,Market research Site design,Web Usage Mining的应用,System Improvement 1). Site Improvement,根据实际用户的浏览情况，调整网站的网页的连接结构和内容，更好的服务用户,极端：Adaptive web sites,Web Usage Mining的应用,System I

9、mprovement 2). Caching it only indicates the use of a page as a localized navigational nexus for that particular user. The similarity sim(t,s) as the normalized cosine of the angle between the two vectors. K-means algorithm is used to obtain transaction clusters.,The Recommendation Process,The recom

10、mendation engine is the online component of the system based on usage mining. The task of the recommendation engine is to compute a recommendation set(potentially useful links based on the users navigational activity through the site) for the current session. Consider factors: The matching criteria for each cluster or frequent itemset to the current active