The paper considers ways to solve the problem of Internet congestion.Analogs of recommendation systems of different researchers are also given. The main algorithms in recommendation systems are analyzed: Content based, demographic based, Coloborative filter. Two types of data are considered, which help to form an overall assessment in the recommendation system. The main problems that shape the work with recommendation systems are considered.The tasks of recommendation systems are analyzed in detail. The paper provides a step-by-step creation of a recommendation system and identifies the main requirements that it must meet.The study presents a similarity matrix, which is calculated from the entire recommendation vector. The personalization of the recommendation is also calculated.The matrix factorization method is analyzed (Matrixfactorization). The evaluation that follows from the user profile is considered.In the work, to get results on the proposed models, offers its own web service for finding movies, where the user can search for movies, as well as view detailed information about them or the movie rating. Recommendations in this system are based on implicit feedback, and it is possible to receive information about the user's id to make personalized recommendations are also analyzed:Linear Regression Prediction, Content-Based Prediction, Collaborative-Filtering Prediction User-Based, Collaborative-Filtering Prediction Item ORCID: 0000-0002-2504-5833 (Yu. Kryvenchuk); 0000-0002-6764-8536 (V. Lakiza); 0000-0002-9780-1546 (Yu.Bidak); 0000-00023761-2276 (I. Myskiv); 0000-0002-7139-5623 (Yu. Malynovskyy)
accurate data [
Today, the problem of Internet congestion remains open. The amount of information on the
Internet is growing exponentially every day [
The study aims to describe models where the components for translating the characteristics of user
behaviour are his assessments, which are used for his content recommendations [
Before starting the study, a list of characteristics that can describe any recommendation system is EMAIL:
2022 Copyright for this paper by its authors. Subject of recommendations - what is recommended. It can be anything: movies, music, products, news, articles, books, products, videos, people and more. Purpose of recommendations - the navigator is recommended. They are gathering, providing information, training, meeting new people. Recommendation context - what the user is doing at the moment. You are browsing products, listening to music, communicating with people. Source of recommendation - who recommends. Audience-like users, experts. Degree of personalization. Non-personal recommendations - when you are recommended all the same as other users. They allow targeting by region or time but do not consider their preferences. Additional enhancements include the number of recommendations for your current session. You have reviewed several products and recommended similar products for you. Personal recommendations contain all available information about customers, including the history of their purchases. Transparency. People trust recommendations more when they understand what they are based on. So there is less chance of coming across a system that recommends offering goods or services. Recommendation format. This can be included in a window, a sorted list found in certain parts of the site, a bar that opens the screen, or something else. Algorithms. Despite many available algorithms, they all come down to a few basic approaches.
The most classic is: Summary (non-personal); Based on content (models based on the product description); Collaborative (collaborative filtering); Matrix factorization (methods based on matrix schedules).
To define recommendations, standard filtering systems must correlate two fundamentally different objects: elements and users. Therefore, the aim of this study is to compare two main approaches, which are the two main methods of joint filtering: the neighborhood approach and the model of hidden factors. Neighbourhood methods focus on relationships between objects or between users.
The relevance of this study is the process of modeling user preferences based on assessments of
similar aspects of the same user [
Hidden factor models, such as matrix factorization (SVD), contain an alternative approach, turning both elements and users into the same confidential factor space. Latent space explains ratings by characterizing products and users by factors that automatically follow from user feedback.
Matrix decomposition methods [
When searching for information, matrix decomposition methods are used to identify hidden
semantic factors. However, its application to precise estimates in co-filtering is complex due to the
large proportion of missing values [
The task of the recommendation system is to inform the user about the product that may interest
him most at a particular time. The customer receives recommendations about the product he needs,
and the service earns, depending on the business model, recommendation systems can be profitable in
different ways [
In the previous section, the main principles, problems and objectives of recommendation systems
were discussed. This should focus on preparing for practical implementation [
1. Coverage. Coverage is the percentage of test items that a test set recommendation system may recommend.. 2. Personalization. Personalization shows how many identical things the recommendation system shows to different users. Personalization is calculated in Table 1.
Binary variables define two states (1 – the subject was recommended to the user. 0 – was not). The next step is to calculate the similarity matrix for users in Table 2.
In the Table 3 defined features about the object - the film, which are determined by the user using the recommendation system. So, in Table 3 genres for recommended movies for the first user. In Figure 2 shows an assessment of similar films received by the user of the recommendation system.
The higher the rating, the more similar movies the user will receive. Therefore, the metrics that determine the quality of the recommendation system should be considered. Recall and Precision at k. This metric was commonly used in binary classification algorithms. Now this is one of the effective ways to determine the quality of the recommendation system. In this case, it is necessary to say whether the recommendation interested the user or not. A rating of 1-5 is usually used for this.
The main part of working with recommendation systems is data. To review the algorithms, use the Deskdrop dataset, which includes 12-month records from CI & T's Internal Communication platform (DeskDrop). It includes information about 73 thousand users who interacted with 3000 articles distributed on the platform and includes 2 files: shared_articles.csv; users_interactions.csv.
Their structure should be considered for analysis. For the Shared_articles.csv file, which contains information about common files on the platform, where each article has its original url, title, content as plain text, language, and information about the user who published the article. Also, each time stamp has two possible events: Content is distributed and available to users; Content has been deleted and is not available to users. In the Table 4 shows data with timestamp, type of interaction, movie ID, user ID, user session ID.
The users_interaction.csvfile stores information about user interaction with articles. This dataset includes the following types of interactions: Views, Preferences, Comments, Tracking (user will be notified of new comments on this article), Saved (the user saved the article to return to it in the future). In the Table 5 users_interaction.csva dataset with a timestamp, type of interaction, movie ID, user ID, user session ID.
The next stage is the transformation of data, where for each type of interaction is given a certain weight (Figure 3), which will reflect the user's interest in a particular article.
Author UserAgent Nan Nan Nan Nan Nan
Also a common problem in referral systems is the cold start problem, so you should only work with users who have 5 or more interactions.. On the DeskDrop platform, the user can view articles several times and interact with them each time, which is why you should create a new column that will reflect the user's interaction with this article by summing up all types of interactions.
In the Table 6 presents data on user interaction with the recommendation system. Let's see what the columns with which the user interacts will look like.
The most common model because of its simplicity. This model is not personalized at all. It simply recommends to the user the most popular (with the highest rating) items or content. In general, it offers good recommendations that are liked and will be interesting to most.
It shows in the metric Recall @ 5, where the figures are about 24%, which means that 24 percent with which the user interacted, the system was able to predict the ranking in the top 5. And with Recall @ 10, the figures generally reach 37% (Figure 4).
2. Content based filtering model.
This model uses content attributes that can be recommended to the user of the article, similar to those with which he has already interacted. TF-IDF, a popular technique in search engines, is commonly used to work with text. This technique converts unstructured text into a vector, where each word is represented by a word and the position of that word in the vector. To prepare a user profile, take all the articles he interacted with and display the main words in them and multiply them by the weight of each article relative to the user (The more the user interacted with the article, the more important the keywords in it will be).
This method received a score of Recall @ 5 = 0.162 ~ 16.2 percent. Recall @ 10 = 0.261 ~ 26 percent (Figure 5). As you can see in Figure 6, this model, despite the fact that it is more difficult to implement showed worse results than a simpler model in popularity.
This model is divided into two types: Memory-based - this model uses previous user interactions with articles to find a user with similar preferences and use it for recommendations in the future. Model baseduses different methods and models of machine learning (neural networks,
Bayesian networks) to cluster users and find common preferences between them.
Next, you need to evaluate a system based on the Matrixfactorization model. In this case, in Figure 6 ratings for Recall @ 5 (33%) and for Recall @ 10 (46%).
In the Table 7 shows the results of comparison of the main models in the recommendation systems.
After the results given in Table 7, it can be concluded that for further development of the system it is necessary to use a hybrid model for the best results. We should also give an example of a more modern method that has gained popularity, namely the factorization of the matrix (Matrixfactorization). To begin with, let's learn what factorization is. Factorization is the decomposition of a matrix into principal components. Take for example a table where the columns correspond to the names of the films, and the rows of user ratings for these films (Table 8).
If there is a dash at the place of evaluation, it means that the user has not watched this movie and the task is to predict his impressions after watching.
Accordingly, in Figure 9 the initial matrix is marked in blue, let's call it V , and the next two matrices, on which the initial matrix should be decomposed, are called W and H . Thus it is possible to deduce the general kind of expression: V (m * n) W (m * k ) * H (k * n) , where k – count of components. This means that when multiplying matrices W and H we obtain an approximate matrix V in which empty values will take on a certain meaning that will correspond to the predicted estimates of users for certain products. There are three main methods of decomposing matrices and their comparison is shown in Figure 8.
As can be seen from Figure 8 SVD and NNMF methods work best. The choice between them depends only on the data set, but they have one significant difference. When SVD works with a range of numbers from minus infinity to plus infinity, the result of the method can give the same range of numbers. And in the analysis, the NNMF method works only with positive numbers.
To get results on the proposed models, the work created a web service for finding movies, where the user can search for movies, as well as view detailed information about them, as well as the movie rating. Based on this data about the user's interaction with the site, you can create recommendations. MovieLensDataset was used to build the service. Recommendations should be based on implicit feedback. To do this, the client side collects information about user clicks, while recording information in the object, which consists of the name of the movie, the number of clicks on this movie, as well as its evaluation. After the user has watched several movies, the information is sent to the server where the object was used as test data (Figure 9). As can be seen from Figure 10, the server also receives user id information to make personalized recommendations. As initial data on object the client with 10 films which can be interesting to the user is sent and we receive the list of recommendations. In general, the system implements several methods of recommendations, so you need to call a certain, of your choice, to get results. The following methods of recommendations are implemented in the proposed system: Linear Regression Prediction, Content-Based Prediction, Collaborative-Filtering Prediction User-Based, Collaborative-Filtering Prediction Item –Based.
In an information-saturated world, referral systems play an essential role in the user's interaction only with potentially exciting information. In this paper, a comparative analysis of the main approaches to implementing procedures of this kind. Several basic methods were compared during the study. The most popular are basic, subject-basic, hybrid-basic and matrix factorization. Figure 11 shows the results of this study. On the results shown in Figure 11, it can be seen that models give the best accuracy based on the hybrid approach and matrix factorization. If there are opportunities and necessary personalized recommendations, then the best ones are the ones that are different from neural networks and other approaches. After all, they remain transparent and easy to implement. If personalization is not required, using a popularity system is sufficient for most tasks. They also significantly simplify the procedure.
Today, during a pandemic, many businesses have their recommendation pages. For example, we can name such giants as Amazon, Google, Linkedin. In this paper, much attention was paid to methods based on matrix expansions for recommendation systems, namely for the reconstruction of the rating table. Based on these methods, data analysis for the selected dataset was performed. Each of the studied methods has its characteristics and is worth noting because it is helpful for a specific range of goals set by the developer of recommendation systems. Thus, the proposed models allow us to focus on the characteristics of the object, which determine the rating of the product or service it is looking for. The application of the proposed algorithms allowed you to choose the best option for creating your recommendation system, which offers the user a behaviour model.