pyRecLab: A Software Library for Quick Prototyping of Recommender Systems

Abstract

This paper introduces pyRecLab, a software library written in C++ with Python bindings which allows to quickly train, test and develop recommender systems. Although there are several software libraries for this purpose, only a few let developers to get quickly started with the most traditional methods, permitting them to try diferent parameters and approach several tasks without a significant loss of performance. Among the few libraries that have all these features, they are available in languages such as Java, Scala or C#, what is a disadvantage for less experienced programmers more used to the popular Python programming language. In this article we introduce details of pyRecLab, showing as well performance analysis in terms of error metrics (MAE and RMSE) and train/test time. We benchmark it against the popular Java-based library LibRec, showing similar results. We expect programmers with little experience and people interested in quickly prototyping recommender systems to be benefited from pyRecLab.

INTRODUCTION

When software developers face the challenge of learning about recommender systems (RecSys), developing a RecSys for the first time, or quickly prototyping a recommender to test available data, a reasonable option to get started is using an existent software library. Nowadays, it is possible to find several libraries in diferent programming languages, being among of the most popular ones MyMedialite [ 3 ], LensKit [ 2 ], LibRec [ 4 ], lightfm [ 7 ] and rrecsys [ 1 ].

While the aforementioned tools have documentation, implement several methods, and present most of the common functionality required to develop and evaluate a recommendation system, all of them miss some type of functionality or algorithm which hinder specially newcomers. In particular, while teaching for three years a graduate course on Recommender Systems during the Fall Semester (2014-2016) at the Department of Computer Science at PUC Chile, most students have found recurrent dificulties in using existent tools to finish an introductory assignment. The assignment is related to tasks such as rating prediction and item recommendation

>>> import pylibrec to specific users, using well-known collaborative filtering methods such as User K-NN, Item K-NN, Slope One and FunkSVD [ 9 ]. Some of the problems found were: (a) the lack of implementation of certain methods in some libraries, (b) poor train/test time performance under medium-sized datasets (such as Rrecsys which does not implement sparse matrices), (c) lack of functionality which is typical in a recommendation setting, such us suggesting a list of items given a specific user ID, (d) dificulties to change parameters in certain models, and (e) students’ lack of familiarity with certain programming languages such as Java or C#. While Java is the most popular language based on several rankings, it is also the case that Python is the most popular introductory teaching language in the U.S. since 2004 [ 5 ] as well as the one with largest growth in the latest 5 years based on the PYPL ranking1.

For these reasons, we developed pyRecLab2. We wrote it in C++ with Python bindings, in order to facilitate its adoption among new programmers familiar with Python, but also ofering an appropriate performance when dealing with larger datasets. We implemented most of the foundational recommendation methods for rating prediction and recommendation. Moreover, users can easily change parameters to understand their efect and they can also produce recommendations given a specific user ID. 2

OTHER RECOMMENDATION LIBRARIES MyMediaLite[ 3 ]: It implements several recommendation algorithms, supporting explicit and implicit feedback, as well as contextaware methods. It also allows evaluation with metrics such as MAE, RMSE, prec@N, and nDCG [ 9 ]. Many of it functionalities are available from command line; however, to integrate it with other software it is necessary to program in languages like C# or F#, which is dificult for many newcomer Python developers. Lenskit[ 2 ]: 1http://pypl.github.io/PYPL.html 2Documentation and code samples at https://github.com/gasevi/pyreclab Sepulveda et al. pyreclab test 1.4 1.2 librec train pyreclab train librec test A popular library which provides all basic collaborative filtering methods for predicting ratings (User/Item KNN, Slope One and FunkSVD). It is developed in Java, which could be an entry barrier for new programmers who are mostly familiar with Python. LibRec[ 4 ]: Just like MyMediaLite and Lenskit, a well developed library in terms of algorithms implemented and the metrics available for evaluation. However, documentation is not as good as Lenskit and since it is implemented in Java, it also raises the barrier for new programmers. Lightfm[ 7 ]: This library implements several matrix factorization algorithms for both implicit and explicit feedback. It also has an interface for Python, facilitating its use to several developers. However, it does not implement basic traditional recommender algorithms (User/Item KNN, slope One), so it is not advisable for introductory teaching purposes. Rrecsys[ 1 ]: This tool gets the closest to pyRecLab in terms of easy-of-use, quick prototyping and educational purposes. It is written in R language. However, it has two main weaknesses: it misses some traditional algorithms (like Slope One) and it is limited in terms of the amount of data it can process, since it does not support sparse matrices. 3 DESIGN AND IMPLEMENTATION Figure 1, shows the main modules of pyRecLab. At the bottom, the blue block represents the Python interpreter, which loads the methods and data structures when importing the PyRecLab module. At the top, in orange, all the sub-modules of the library: • File IO. This component allows data input/output by means of reading from text files, as well as writing output recommendations in txt and json formats. It allows great flexibility in terms of input file formats (csv, tsv) as well as allowing the user to specify what to file columns represent. • Data handlers. This module implements several data structures, which allow a homogeneous access to the ratings. It grants a good level of independence from the original format from which data were read, with a high level of abstraction. These data structures will be directly used by the recommendation algorithms for the processing, storage and generation of output data. • Recommendation Algorithms. Under the Data handlers block, there are a number of contiguous blocks representing the recommendation algorithms. Algorithms for rating prediction and recommendation are: Item Average, Slope One, User KNN, Item KNN and Funk SVD. On the other hand, Most Popular is only used to generate recommendations. • Python Interface. This module represents the interface between the recommendation algorithms and the Python interpreter. It was developed in C++, and since we aimed at maintaining an appropriate level of code readability, we decided to use 90 80 ]s 70 0 -8 60 5 [e 50 m iT 40 g in 30 n i ra 20 T 10 0 200 400 600 800 1000 1200 1400 1600

Number of latent factors

4 RESULTS & CONCLUSION

To check the performance of pyRecLab, we tested it against the popular library LibRec [ 4 ] in terms of error and train/test time.

Prediction Results. MAE and RMSE results of rating prediction over Movielens 100K dataset are shown in Table 1. Diferences are very small to LibRec, showing that pyRecLab can reproduce results of a mature recommender library. Time Performance. Although the results vary depending on the method, Figure 2 shows train/test performance using FunkSVD. While both libraries perform similarly in training phase, pyRecLab performs faster in testing time at diferent number of latent factors.

Summarizing, we have introduced PyRecLab, a library for recommender systems which combines the performance of C++ in its implementation with the versatility of Python for easy-of-use. We expect to add new algorithms (such as WRMF [ 6 ] and gSLIM [ 8 ]) and recommendations metrics, as well as new code samples to facilitate its adoption.

References

[1] Ludovik Çoba and Markus Zanker . 2016 . rrecsys: an R-package for prototyping recommendation algorithms . ( 2016 ).

[2] Michael D Ekstrand , Michael Ludwig , Jack Kolb, and John T Riedl. 2011 . LensKit: a modular recommender framework . In Proceedings of the fifth ACM conference on Recommender systems. ACM , 349 - 350 .

[3] Zeno Gantner , Stefen Rendle, Christoph Freudenthaler, and Lars Schmidt-Thieme. 2011 . MyMediaLite: A free recommender system library . In Proceedings of the iffth ACM conference on Recommender systems . ACM , 305 - 308 .

[4] Guibing Guo , Jie Zhang, Zhu Sun, and Neil Yorke-Smith. 2015 . LibRec: A Java Library for Recommender Systems. . In UMAP Workshops.

[5] Philip Guo . 2014 . Python is now the most popular introductory teaching language at top us universities . BLOG@ CACM , July ( 2014 ), 47 .

[6] Yifan Hu , Yehuda Koren, and Chris Volinsky . 2008 . Collaborative filtering for implicit feedback datasets . In Data Mining , 2008 . ICDM'08. Eighth IEEE International Conference on. Ieee, 263 - 272 .

[7] Maciej Kula . 2015 . Metadata Embeddings for User and Item Cold-start Recommendations . In Proceedings of the 2nd Workshop on New Trends on Content-Based Recommender Systems (CEUR Workshop Proceedings) , Vol. 1448 . 14 - 21 .

[8] Santiago Larraín , Denis Parra, and Alvaro Soto . 2015 . Towards Improving Top-N Recommendation by Generalization of SLIM. . In RecSys Posters.

[9] Denis Parra and Shaghayegh Sahebi . 2013 . Recommender systems: Sources of knowledge and evaluation metrics . In Advanced Techniques in Web Intelligence-2 . Springer, 149 - 175 .