When to Recommend What? A Study on the Role of Contextual Factors in IP-based TV Services Jing Yuan Fikret Sivrikaya Stefan Marx Frank Hopfgartner Technische Universität Berlin Ernst-Reuter-Platz 7, 10587 Berlin, Germany {jing.yuan, fikret.sivrikaya, stefan.marx, frank.hopfgartner}@dai-labor.de reached 87.2 million globally as of mid-2013. 17 mil- lion of these subscribers have been acquired within the Abstract last twelve months alone. This success story is due to various factors. First of all, novel techniques for Today’s IP-based TV services commonly the compression and streaming of multimedia content strive for personalizing their content offers have been developed. Moreover, the rapid develop- using complex recommendation systems to ment of fixed and mobile broadband communication match their users’ interests. These systems technologies resulted in increased availability of band- try to capture the relevance of content rec- width for the streaming of multimedia content over the ommended to a user, which may also depend web. Apart from these technological advancements, on many contextual factors such as time, lo- the main reason for the success of IPTV services can cation, or social company. Nevertheless, in be considered as the flexible, dynamic access to content most cases, these factors are either omitted or provided via these services. Differing from traditional integrated in recommendation systems with- television channels that broadcast rather static con- out a concrete modeling of what different roles tent for all consumers, content provided by IP-based each may play on different users’ experiences. television and Video-on-Demand (VoD) services can Do users really care about all of these spe- be adapted to the individual customer’s interests. An cific factors? How do those factors interact important aspect of this adaptation process is the de- with or influence each other? Can this inter- velopment of appropriate recommendation techniques action be modeled commonly for all users or such as [2, 3, 4]. is it more specific to the user profile? To the These personalization techniques strongly depend best of our knowledge, answers to these ques- on understanding users’ needs, which is, however, a tions have not been studied in detail yet. In non-trivial task. Users’ needs and interests can change this paper, we introduce the results of a ques- over time and can depend on external contextual fac- tionnaire and a focus group discussion to elab- tors such as the time, location or company of other orate on the influence of contextual factors on people [5]. Various studies (e.g., [6, 7, 8]) have shown IP-based TV services from the users’ point-of- that recommender systems can benefit significantly view. when these contextual factors are incorporated. Given that we are all individuals though, it is not premature 1 Introduction to assume that contextual factors are not equally im- portant for all of us. For example, the time of the day According to a recent survey performed by Point Topic might be important for some people, but not so impor- [1], the number of subscribers of IPTV services has tant for others. As far as we know, a detailed analysis of the choice of contextual factors for a recommender Copyright c 2014 for the individual papers by the paper’s au- has not been studied yet. thors. Copying permitted for private and academic purposes. This volume is published and copyrighted by its editors. With this paper, we intend to shed some light on In: U. Kruschwitz, F. Hopfgartner and C. Gurrin (eds.): Pro- the role of contextual factors on individual users. The ceedings of the MindTheGap’14 Workshop, Berlin, Germany, work is divided into two parts. First, we present the 4th March 2014, published at http://ceur-ws.org outcome of an online questionnaire where we asked participants about their usage of IP-based TV ser- sumer of IP-based TV services. In this paper, we in- vices. Second, we summarize the results of a focus clude social networks, which are a more detectable so- group discussion where we discussed the results of the cial factor, into the discussion range to observe users’ questionnaire with various participants of our survey. attitudes towards social company. The paper is structured as follows. In Section 2, four possible influential contextual factors are pro- External breaking news may be treated not posed, which form the basis of the questionnaire pre- only as a content type for recommendation, but also sented and analyzed in Section 3. Section 4 summa- as a contextual factor. Studies in [15, 16] make use rizes the participants’ opinions in the focus group dis- of trending topics on microblogs to mine real-time hot cussion. Finally, Section 5 concludes the work and news. In IP-based TV services, external breaking news outlines future work. might be quite relevant for the consumer’s choice on programs beyond news, and thus worthy of being stud- 2 Contextual Factors ied as a contextual factor. For example, a famous singer’s death may arouse users’ interests in his old In literature, various contextual factors have been pro- music videos or concerts, apart from the news of his posed that should be considered when providing rec- death itself. ommendations. In the context of this paper, we con- centrate on a subset of them, i.e., the most commonly In order to study the role of these contextual factors used contextual factors. These include time, location, for individual users, we performed a user survey where social company and external breaking news, each of we asked participants to answer specific questions on which we elaborate next. five-point likert scale, multiple choice or radio. More- over, we organized a focus group session where we dis- Time Various researchers (e.g., [9, 10, 11]) focus cussed the role of these factors with different types of on time as contextual factor to improve their recom- IP-based TV content consumers. mendation algorithms. Although these works suggest that time can be a very strong and thus helpful factor, it remains unclear if this observation is valid for every 3 User Study Questionnaire user in an IP-based TV scenario. For example, free- In our design of the user questionnaire, we focused on lancers with flexible working hours might not consider the four specific contextual factors for IP-based TV time to be a significant factor, while employees on a recommendations introduced in the previous section. strict work schedule generally consider it to be highly At the beginning of the questionnaire, we gave users important. We argue that further investigations are a description of our “IP-based TV service” concept, required to study the role of time as contextual factor. which covers not just IPTV through set-top boxes, Location is another frequently mentioned contex- but also WebTV and web-based mobile apps. In this tual factor for recommenders [6, 12]. In most cases, lo- section we share some of the statistical results of the cation as a contextual factor is considered by following survey, through which we try to provide a clearer pic- simple matching rules. A concrete approach for build- ture of the contextual factors’ influence from the users’ ing relations between location and content evaluation perspective. procedure has not been studied yet. Given the unclear picture of location factor’s involvement in personaliza- 3.1 Respondents’ Basic Info tion and recommendation methods, we consider it to be a relevant factor that need to be investigated fur- The online questionnaire remained in effect through- ther. out the month of August 2013, with a total of 51 re- spondents. The demographic information of the ques- Social company Users’ acceptance of social com- tionnaire respondents is listed in Table 1. All respon- pany during IP-based TV service usage has been iden- dents are digital natives, i.e. were born after the start tified in literature (e.g., [13, 14]). In a social con- of the digital age (around 1960); so their understand- text, functionalities such as exchanging thoughts on ings of legacy TV (terrestrial, cable, satellite) and IP- TV programs or recommending each other interest- based TV services are clear. Most participants are ei- ing TV content are very common amongst users. So- ther employees or students at our university. In terms cial context can provide users an opportunity to evade of their place of birth and residence, Asians and Euro- the filtering bubble, which guides users to their own peans form the two largest groups of our respondents. preferred directions, thus leading to large amount of This coincides with the survey result from Point Topic hidden content. Nevertheless, it can not easily be as- [1], which shows that Asia and Europe are the two sumed that social company is important for every con- biggest markets for IP-based TV content with 48.7% and 36.6% market share of the worldwide IPTV sub- ests for specific types of content: “What kind of pro- scribers, respectively. Given these similarities, we ar- grams would you prefer watching a) in the morning, b) gue that our participants form a subset of the main during a break at daily work, c) in the evening and d) target groups for such services. on weekends?” As presented in Figure 1, twelve basic Table 1: Questionnaire Demographic Info genres of TV content were listed as choices for each of the four categorical time periods. In line with the intuitive reasoning, we observe the following trends: i) weather report and daily news seem to be favor- able choices in the morning or during a break at work, when people usually spend much less time watching TV; ii) similarly, during a break at work, those rela- tively short TV content such as daily news, sport, mu- sic and entertainment content are usually consumed; iii) users’ preference in the evening and on weekends show very similar behavior, with the comparatively longer programs such as movies, TV series and doc- umentaries outweighing other content types. Despite of the resemblances to some TV company strategies, users’ intuitive choices still make these trends worthy Table 2 represents TV usage habits of the respon- of being referred to when recommending, especially for dents. We first observe that a large majority con- VoD services. sumes IP-based TV services much more than tradi- tional TV, with more than half of the participants spending at least five times more time on IP-based TV services than on normal TV. Moreover, 86.3% (19.6%+25.5%+41.2%) report that they have been us- ing IP-based TV services for over two years. These statistics confirm that the respondents to the ques- tionnaire represent experienced IP-based TV service users, possessing the required reference value for our survey. Table 2: Respondents Basic Usage Info Figure 1: Users’ Choices on Program Categories The next question that we cover is on the user’s direct opinion on a more limited set of recommenda- tion types given to them in a set of changing con- texts regarding time and location: “Consider three types of content recommendations provided to you at the same time (habitual content at this time, breaking news or events happening just now, friends’ instant suggestions). In each of the contexts (at home in the morning; at work hours during a break; at home in the evening; on weekends), which of those recommended contents are you most likely to choose for watching?” As depicted in Figure 2, the users seem to be much more interested in hearing about breaking news and events during work hours or in the morning at home, 3.2 Context Influence on Content Selection similar to the earlier question’s result. Conversely, the The first question that we analyze in the questionnaire habitual content or friends’ suggestions become much tries to capture the temporal changes in users’ inter- more favorable in the evening or on weekends. In other words, the influence of contextual factors as break- ing news and social company on users’ preference may change with alterations in certain contexts as time and location. In addition to supporting the existence of contex- tual factors’ influence on TV content selection or rec- ommendations, which can be turned out from the first question’s result, the second question’s result also pro- Somewhat vides an interesting insight on contextual factors’ mu- Not important important Can't decide Important Very important tual influence, when we consider the breaking news and social effects as contextual factors. Figure 3: Users’ Scoring Distribution on Contextual Factors’ Importance deviation for each of the factor’s ratings (Daily viewing habit: 1.12, Time: 1.22, Location: 1.34, Social com- pany: 1.20 and External breaking event: 1.32), we ob- serve the largest variation also for Location, although the difference among the four factors are again not so significant. These spread distributions (according to Chebyshev’s rule, there will be at least 3/4 of the data within 2 standard deviations of the mean and at least 8/9 of the data within 3 standard deviations of the mean) illustrate that there is no strong and unified ten- Figure 2: Contextual Factors’ Influence on dency towards the valued importance of specific con- Recommendation Type textual factors. Moreover, it seems that the contextual factors’ influences are valued differently by the users, and that there is no specific contextual factor that is 3.3 Users’ Perspective on the Importance of equally important for everyone. This further supports Contextual Factors the existence of individual difference when considering the importance of specific contextual factors, which Aiming to study the importance of these contextual differs from the usual overall consistent treatment of factors from the individual users’ points of view, we them. posed the following question: “How important is each of the following factors regarding their influence on We then compute the Pearson Correlation Coeffi- your own (subjective) choice of TV programs recom- cient for each pair of the given factors based on re- mended? ” Participants were then asked to assess the spondents’ ratings, as given in Figure 4. The fact that importance of the four factors (Time, Location, So- the correlation between any two factors turns out to cial company and External breaking events), in addi- be quite weak indicates that a user’s interpretation of tion to the option of using their standard user profile each factor’s influence level may be independent on (based on daily viewing habits). The assessment was their evaluation of the other factors. based on a five-point likert scale, ranging from “1-Not important, 2-Somewhat important, 3-Can’t decide, 4- Important, 5-Very important”. Figure 3 depicts the distribution of the respondents’ 0.43 0.14 ratings. Intuitively, scores for each factor’s importance 0.41 are relatively evenly distributed in the five-point lik- 0.41 0.24 ert scale. Considering the average score for each fac- tor’s importance (Daily Viewing Habit: 2.78, Time: 0.43 0.40 0.16 2.98, Location: 3.39, Social company: 3.25 and Exter- 0.14 nal breaking events: 3.29), location is viewed among Breaking Events respondents as the one factor having slightly more in- 0.48 fluence than others on TV content selection, although there is no clear winner. Obviously, there is no evi- Figure 4: Pearson Correlation Coefficient of Different dent preference for any specific contextual factor from Pair of Factors a general view. When analyzing the sample standard 3.4 Subjective Responses paring them as follows: “Location means more than timing in my case. I only watch program through in- We also provided two free-text style opinion questions ternet at home. Whenever in the office, I’ll be busy in the questionnaire to gain additional user insight on with my work and won’t open any TV related applica- the assessment of IP-based TV services and contextual tions.” Along the same lines, P1 expressed his view as: factors. “Whether I’m working or on vacation will result dif- Q1: From your point of view, what features should ferently on my willingness to accept recommendations. a perfect IP-based TV service offer? For me, time of the day, day of the week can regularly determine my status of busy or not and thereby drive Q2: What other contextual factors may influence my choices.” P6 shared a different perspective from your decision to follow a certain program on IP- her own experience: “Whenever it is or wherever I based TV services? am, if I am using IP-based TV services for recreation, Even though these questions did not have any pre- it means I have time and will enjoy the content I’m scribed options for the answers, the responses have interested in; so both time and location factors won’t shown some natural clustering around a few concepts. influence that much.” For Q1, several respondents explicitly referred to Concluding from these statements, we argue that the contextual factors External breaking news and “busy or not” might be a decisive factor for users’ events and Social company as requirements for an ideal choices when watching TV content, while the directly IP-based TV service. In addition, more variety in con- measurable contextual factors time and location are tent, less advertisement, free of charge service, and a less important but might be clues to figure out users’ clear and fast UI were also suggested. Responses to status of “busy or not”. Q2 supplemented influential contextual factors with some inspiring comments. Some claimed that the sta- tus of “busy or not” would play a central role in users’ 4.1.2 Comments on Social Company preferred type and length of TV content, and others suggested mood as an independent contextual factor. When the topic moved on to social company, P2 and As implicit factors though, “busy or not” and “mood” P8 have shown strong interest by expressing that it is can not be so easily detected from existing datasets. always a great experience to exchange thoughts with Therefore, any clue that can help deduce users’ such friends on the programs of common interest, and that status would be quite valuable. Some respondents also they always get great suggestions from friends. P2 indicated that the quality of TV programs is of impor- mentioned the more concrete case of watching soc- tance. Comprehensive factors such as players, guests, cer games while discussing and sharing opinions with theme were all referred to as quality evaluation indica- friends. Yet, on the totally opposite side, P3 com- tors on programs, which are already well studied and plained, “I really hate being bothered by others; I just integrated in most recommendation systems. would like to be immersed in my own interested pro- grams alone.” These statements illustrate that content 4 Focus Group Discussion categories and occasions should be carefully considered when providing social-based recommendation. In order to further find out users’ personal usage expe- riences and remedy their unavoidable misunderstand- ings of objective questions, we invited participants of 4.1.3 Being Cautious with Breaking News and our questionnaire to join a focus group discussion. Events Eight respondents were able to participate in the dis- cussion session. In this section, we label these par- As to the newly proposed contextual factor of break- ticipants as P1 to P8 to share some of their valuable ing news and events, P8 stated, “I feel disturbed when ideas. small windows pop-up to remind me of some so-called ’news’, unless they are really appealing to me.” P7 4.1 Discussion on Contextual Factors supported this with: “I routinely view news from the news websites; I don’t think it’s necessary to get rec- Considering the main purpose of the work in this pa- ommendation from a TV application with respect to per, participants’ opinions on contextual factors were news again.” Just as the participants warned, TV rec- undoubtedly the main focus group discussion. ommenders should be extra cautious in the way they select and notify their users of breaking news and 4.1.1 Time and Location vs. “Busy or Not” events. Otherwise the recommendation could be more Contextual factors of time and location were always annoying than appealing, no matter how important it referred together. Participant 3 (P3 ) started by com- is. 4.2 Other Points of Discussion In accordance with the guides and insights turned out by this paper, our next step is to design and develop Aside from the intended discussion on proposed con- a context-adaptive recommender system for our own textual factors, there were other points initiated by IP-based TV service that incorporates these factors. participants. 4.2.1 Users’ Sensitivity to Content Quality Acknowledgements Opinions on popularity and quality of TV content, as The first author has been funded by the Chinese Schol- appeared in subjective responses of the questionnaire, arship Council. were proposed again in the focus group. P4 stated, “Popularity is a useful reference when I choose TV References content, while it won’t work sometimes since content’s [1] Point topic iptv statistics - market analysis q2 popularity can’t directly determine its quality.” P2 2013, June 2013. continued, “I also found that some so-called popular TV content are pushed in front of us only due to com- [2] James Davidson, Benjamin Liebald, Junning Liu, mercial reasons rather than users’ preference.” Appar- Palash Nandy, Taylor Van Vleet, Ullas Gargi, ently, users are more sensitive to TV content’s quality Sujoy Gupta, Yu He, Mike Lambert, Blake Liv- now than ever before, and they won’t be satisfied with ingston, and Dasarathi Sampath. The youtube just the popularity statistics. Thus distinguishing high video recommendation system. In Proceedings of quality content would be quite an important aspect for the fourth ACM conference on Recommender sys- recommenders. tems, RecSys ’10, pages 293–296, New York, NY, USA, 2010. ACM. 4.2.2 Bookmarking also Implies Success for Recommendations [3] Yu Xin and Harald Steck. Multi-value proba- Another unexpected acquirement from the focus group bilistic matrix factorization for ip-tv recommen- was users’ supplementary view on recommender’s ef- dations. In Proceedings of the fifth ACM confer- fectiveness. P1 said, “When I don’t have time to ence on Recommender systems, RecSys ’11, pages watch TV content that was correctly recommended, 221–228, New York, NY, USA, 2011. ACM. I’ll bookmark it and watch it later on.” P2 commented [4] Yu-Cheng Chen, Hsien-Chao Huang, and Yueh- similarly: “I also have the same habit of bookmarking Min Huang. Community-based program recom- pages when I use WebTV; it is quite convenient.” Ev- mendation for the next generation electronic pro- idently, apart from users’ instant positive reaction to gram guide. Consumer Electronics, IEEE Trans- recommendations, such as clicking or watching dura- actions on, 55(2):707 –712, may 2009. tion, the behavior of bookmarking can also be a rep- resentative indicator for a recommender’s success. [5] Gediminas Adomavicius and Alexander Tuzhilin. Context-aware recommender systems. In Pro- 5 Conclusion and Future Work ceedings of the 2008 ACM conference on Recom- mender systems, RecSys’08, pages 335–336, New In this paper, we analyzed the role of common con- York, NY, USA, 2008. ACM. textual factors that are usually applied to recommend content to users of IP-based TV services. We ad- [6] Songbo Song, H. Moustafa, and H. Afifi. Ad- dressed this question from the perspective of the con- vanced iptv services personalization through sumers, i.e., we asked for their opinions in an online context-aware content recommendation. Multi- questionnaire and a succeeding focus group discus- media, IEEE Transactions on, 14(6):1528 –1537, sion. We conclude from our samples that i) contex- dec. 2012. tual factors’ influence and their interplay indeed ex- ist; ii) users’ attitudes toward contextual factors’ in- [7] Paolo Cremonesi and Roberto Turrin. Time- fluence are individually different, which refutes tradi- evolution of iptv recommender systems. In Pro- tional contextual factors’ treatments of modeling them ceedings of the 8th international interactive con- separately or incorporating them equally on every in- ference on Interactive TV & Video, EuroITV ’10, dividual. At the same time, users’ new suggestions on pages 105–114, New York, NY, USA, 2010. ACM. contextual factors such as “busy or not” and mood, their advanced cognition of TV content’s quality and [8] Alexandros Karatzoglou, Xavier Amatriain, Linas their taboos of being interrupted by dull recommen- Baltrunas, and Nuria Oliver. Multiverse recom- dations are all factors that should be studied further. mendation: n-dimensional tensor factorization for context-aware collaborative filtering. In Proceed- [13] Keith Mitchell, Andrew Jones, Johnathan Ish- ings of the fourth ACM conference on Recom- mael, and Nicholas J. P. Race. Social tv: The mender systems, RecSys ’10, pages 79–86, New impact of social awareness on content naviga- York, NY, USA, 2010. ACM. tion within iptv systems. Comput. Entertain., 9(3):19:1–19:29, November 2011. [9] Yehuda Koren, Robert Bell, and Chris Volinsky. Matrix factorization techniques for recommender [14] Daniel Schreiber. Social iptv: a survey on chances systems. Computer, 42(8):30–37, August 2009. and user-acceptance. In Martin Atzmüler, Do- minik Benz, Andreas Hotho, and Gerd Stumme, [10] Yi Ding and Xue Li. Time weight collaborative editors, Proceedings of LWA2010 - Workshop- filtering. In Proceedings of the 14th ACM interna- Woche: Lernen, Wissen & Adaptivitaet, Kassel, tional conference on Information and knowledge Germany, 2010. management, CIKM ’05, pages 485–492, New [15] Owen Phelan, Kevin McCarthy, and Barry York, NY, USA, 2005. ACM. Smyth. Using twitter to recommend real-time topical news. In Proceedings of the third ACM [11] Pedro G. Campos, Fernando Dı́ez, and Iván Can- conference on Recommender systems, RecSys ’09, tador. Time-aware recommender systems: a com- pages 385–388, New York, NY, USA, 2009. ACM. prehensive survey and analysis of existing evalua- tion protocols. User Model. User-Adapt. Interact., [16] Nargis Pervin, Fang Fang, Anindya Datta, 24(1-2):67–119, 2014. Kaushik Dutta, and Debra Vandermeer. Fast, scalable, and context-sensitive detection of trend- [12] M. Dabrowski, J. Gromada, and H. Moustafa. ing topics in microblog post streams. ACM Context-awareness for iptv services personaliza- Trans. Manage. Inf. Syst., 3(4):19:1–19:24, Jan- tion. In Innovative Mobile and Internet Services uary 2013. in Ubiquitous Computing (IMIS), 2012 Sixth In- ternational Conference on, pages 37–44, July.