Slope One算法在Hadoop平台的改进实现.doc

文档介绍：
Slope One 算法在 Hadoop 平台的改进实现
*
(北京邮电大学信息与通信工程学院,北京 100876)
5
10
15
20
25
摘要:近年来电子商务网站对精确投放广告的需求日益加大,协同过滤的推荐算法作为一种力求准确推测
用户需求的方案,应用越来越普遍。本文在针对协同过滤算法中应用较为广泛的 Slope One 算法研究的基
础上,针对 Slope One 算法存在难于应对在训练集较大的情况下产生过多的中间数据的问题,尝试将云计算
思想引入 Slope One 算法中,提出了一种在云计算的开源实现平台 Hadoop 上对 Slope One 算法进行改进实
现的方案。在对 Slope One 算法和 Hadoop 的特点进行分析的基础上,描述了上述改进方案的具体流程,并
实现了改进方案,进行了仿真测试,验证了方案的可行性和有效性。
关键词:并行处理;Slope One 算法;Hadoop 平台
中图分类号:
Improved Implementation of Slope One Algorithm Based on
Hadoop
BAO Weiwei, SU Fang
(School of Information munication Engineering, Beijing University of Posts and
munications, Beijing 100876)
Abstract: In recent years, merce sites have show great interests on Precise Advertising.
Collaborative filtering mendation algorithm have been widely used as it is a solution to find
users' exactly neeed. In this paper, research has shown that Slope One as one of collaborative filtering
algorithm has been widely used for the sake of it is simple and easy to be implemented. But Slope One
algorithm is also have a greate problem that it is difficult to deal with large intermediate data when
training set is big. This study explore the c bine of puting and Slope One
algorithm,.Then proposes a improved program implementation of Slope One algorithm on a open
source puting platform Hadoop. Based on the deep research of characteristics of Hadoop and