An Evaluation Framework of Trust Aware Recommender System


  • S. Masrom
  • N. Khairuddin
  • A. Abdul Rahman
  • A. Azizan
  • A. S.A. Rahman





Collaborative filtering, Trust aware, Recommender system, Evaluation framework.


To date, there exists a variety of prediction approaches have been used in recommender systems. Among the widely known approaches are Content Based Filtering (CBF) and Collaborative Filtering (CF). Based on literatures, CF with users rating element has been widely used but the approach faced two common problems namely cold start and sparsity. As an alternative, Trust Aware Recommender Systems (TARS) for the CF based users rating has been introduced.  The research progress on TARS improvement is found to be rapidly progressing but lacking in the algorithm evaluation has been started to appear. Many researchers that introduced their new TARS approach provides different evaluation of users’ views for the TARS performances. As a result, the performances of different TARS from different publications are not comparable and difficult to be analyzed. Therefore, this paper is written with objective to provide common group of the users’ views based on trusted users in TARS. Then, this paper demonstrates a comparison study between different TARS techniques with the identified common groups by means of the accuracy error, rating and users coverage. The results therefore provide a relative comparison between different TARS.



[1] Santos Jr EB, Goularte R, Manzato MG (2015), Personalized collaborative filtering: A neighborhood model based on contextual constraints. Proceedings of the 29th Annual ACM Symposium on Applied Computing, pp. 919-924.

[2] Mooney RJ, Roy L (2000), Content-based book recommending using learning for text categorization. Proceedings of the 5th ACM Conference on Digital Libraries, pp. 195-204.

[3] Mahtar SN, Masrom S, Omar N, Khairudin N, Rahim SK, Rizman ZI (2017), Trust aware recommender system with distrust in different views of trusted users. Journal of Fundamental and Applied Sciences 9(5S), 168-182.

[4] Safoury L, Salah A (2013), Exploiting user demographic attributes for solving cold-start problem in recommender system. Lecture Notes on Software Engineering 1(3), 303-307.

[5] Shambour Q, Lu J (2012), A trust-semantic fusion-based recommendation approach for e-business applications. Decision Support Systems 54(1), 768-780.

[6] Massa P, Avesani P (2017), Trust-aware recommender systems. Proceedings of the ACM Conference on Recommender Systems, pp. 17-24.

[7] Nazemian A, Gholami H, Taghiyareh F (2012), An improved model of trust-aware recommender systems using distrust metric. Proceedings of the Advances in Social Networks Analysis and Mining, pp. 1079-1084.

[8] Véras D, Prota T, Bispo A, Prudêncio R, Ferraz C (2015), A literature review of recommender systems in the television domain. Expert Systems with Applications 42(22), 9046-9076.

[9] Jain S, Grover A, Thakur PS, Choudhary SK (2015), Trends, problems and solutions of recommender system. Proceedings of the IEEE International Conference Computing, Communication and Automation, pp. 955-958.

[10] Cuong KM, Minh NT, Van Canh N (2013), An application of fuzzy geographically clustering for solving the cold-start problem in recommender systems. Proceedings of the IEEE International Conference Soft Computing and Pattern Recognition, pp. 44-49.

[11] Devi MK, Samy RT, Kumar SV, Venkatesh P (2010), Probabilistic neural network approach to alleviate sparsity and cold start problems in collaborative recommender systems. Proceedings of the IEEE International Conference Computational Intelligence and Computing Research, pp. 1-4.

[12] Ma H, King I, Lyu MR (2007), Effective missing data prediction for collaborative filtering. Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 39-46.

[13] Kim KJ, Ahn H (2008), A recommender system using GA K-means clustering in an online shopping market. Expert Systems with Applications 34(2), 1200-1209.

[14] Song W, Liang JZ, Park SC (2014), Fuzzy control GA with a novel hybrid semantic similarity strategy for text clustering. Information Sciences 273, 156-170.

[15] Son LH (2014), HU-FCF: A hybrid user-based fuzzy collaborative filtering method in recommender systems. Expert Systems with Applications 41(15), 6861-6870.

[16] Rana C, Jain SK (2014), An evolutionary clustering algorithm based on temporal features for dynamic recommender systems. Swarm and Evolutionary Computation 14, 21-30.

[17] Dao TH, Jeong SR, Ahn H (2012), A novel recommendation model of location-based advertising: Context-aware collaborative filtering using GA approach. Expert Systems with Applications 39(3), 3731-3739.

[18] Gupta S, Nagpal S (2015), Trust aware recommender systems: A survey on implicit trust generation techniques. International Journal of Computer Science and Information Technologies 6(4), 3594-3599.

[19] Guo G, Zhang J, Thalmann D (2012), A simple but effective method to incorporate trusted neighbors in recommender systems. Proceedings of the International Conference on User Modeling, Adaptation, and Personalization, pp. 114-125.

View Full Article: