Web site personalization could be immensely improved if the user's current intentions could be recognized by the surfing behavior. The latter can be captured in the form of events occurring in the browser, like mouse moves or opening Web pages. But which aspects of the user's behavior best contribute to the recognition of the task a user is performing? Is it the number of mouse clicks, the amount of time spent on each page, the use of the back button or anything else? First results of an exploratory study give hint that already simple attributes, such as the average page view duration, the number of page views per minute and the number of different URLs requested, may be usable for the automatic user task identification. 20 participants solved exemplary exercises which corresponded to the user tasks Fact Finding, Information Gathering and Just Browsing. Due to the event logging, true display times were identified, even cached pages and the use of browser tabs were recorded.
INTRODUCTION What if we could recognize the task a Web user is currently performing just by the surfing behavior? The automatic identification of user tasks would improve existing personalization methods by adding a semantic component without explicitly asking the users to give away personal information. Furthermore, users with handicaps, like visually impaired people, would profit from this approach: as soon as the objective is recognized, the user can be supported by a wizardlike program which leads through the next steps to the intended target.
This paper describes a work in progress. It deals with the
question which aspects of the behavior are influenced by the
task so that eventually an automatic identification of the user
task will be possible. This work differs from many existing
approaches in the field of interaction tracking, such as [
First investigations showed that there exist differences regarding the page view attributes average page view duration, number of page views per minute, number of unique URLs in proportion to the total number of page views and the time proportion spent on the start page of the newspaper. The total output of the study will be used to formulate hypotheses describing task-dependent behavioral patterns, like “Fact Finding exhibits significantly shorter dwell times than Information Gathering and Just Browsing” etc. Not until enough hypotheses are derived from the study’s findings, a field study can be conducted where the surfing behavior of the users will be recorded in a natural surrounding with ev∗Supported by the German Research Council (DFG).
†http://www.spiegel-online.de eryday activities. Thus, the exploratory study described in this paper is an indispensable prerequisite on the way to automatic user task recognition.
The subsequent content is structured as follows: in the next
section, user tasks in general and in the context of on-line
newspapers are defined based on existing user task
taxonomies. Moreover, the state of the art concerning the automatic
identification of user tasks is briefly described. The third
section is dedicated to the design of the exploratory study.
Afterwards, first results of the study are presented followed
by a section about related work. The last section summarizes
the findings and gives an outlook to future research.
DEFINITION OF USER TASKS
According to Paterno`, tasks are “activities that have to be
performed to reach a goal.” A goal is described as “either
a desired modification of the state of an application or an
attempt to retrieve some information from an application.”
Tasks can be divided into subtasks of lower complexity and
the relationship between the tasks can be modeled in various
ways [
In the past, several authors tried to systemize high level user
tasks on the Internet [
Information Gathering: The users are collecting information about a certain topic, thus, their target is more open. An exemplary goal might be learning something about baroque music. Due to its research-like character, Information Gathering may take longer, even last for more than one session. Just Browsing: This category describes surfing the Internet with no certain target in mind. It is often of long duration. Transaction: Activities like on-line banking or checking emails on-line are summarized in this category.
Other: The last category comprises all activities which
cannot be assigned to any of the other four categories.
The recognition of these high level tasks would already be
a significant breakthrough. Kellar et al. logged the surfing
behavior of a group of users who were asked to document
their activities during that time period. Events like the usage
of the back button, hyperlinks, bookmarks and the history
were captured and gathered in log files [
THE EXPLORATORY STUDY Participants Twenty students and employees from various institutes of the University of Rostock took part in the test. Their average age was 26.6 years.
Setting The participants had to perform exercises on one version of a German on-line newspaper called Spiegel Online. The access to external Web pages was blocked. So, the influence different kinds of Web sites can have on the behavior was eliminated and test conditions were as similar as possible for everyone. Each participant underwent the experiment separately, but on the same computer. The Mozilla Firefox browser was used with a software extension for recording all events occurring during the surfing.
Procedure
In the experiment, the user task was the only parameter which
was changed in order to check in which way the behavior
changes depending on the task. The participants had to
perform exercises which correspond to the user tasks Fact
Finding, Information Gathering and Just Browsing following the
example of [
At the beginning, the participants were asked to get familiar with the pages of the Web site. They were allowed to surf the Web site as they liked. The maximal duration of this warm-up phase was ten minutes, but the participants were free to decide whether they wanted to finish earlier. This already represented the first exercise and the user task Just Browsing.
The two following exercises both corresponded to Fact Finding. The first exercise was to look up a certain weather forecast and the second one to find a football result. After having read what they were expected to do, the search was started from the start page of Spiegel Online. When the information was found, the participants told the investigator the answer aloud and turned back to the start page for the next exercise. The last exercise was to collect information on the G8 summit and thus represented Information Gathering. The participants were informed that after 10 minutes a few questions pertaining to the topic would have to be answered. This was supposed to act as motivation.
During the experiment, the users’ behavior was recorded by capturing every event occurring in the browser. A Mozilla Firefox extension was developed to log the following events: • mouse events (clicks, moves and touching page elements) • scrolling • keystrokes • tab events (open, select and close) • browser events (reload, stop etc.) • page events (show and hide) Besides the time of occurrence of the event, further details were saved; e.g. for each mouse click event the information about the element that was clicked was stored; i.e. whether it was a hyperlink and to which page it leads, whether it was a simple text paragraph, a headline, an image or a browser button etc.
At the end, the participants were presented with a questionnaire which ascertained demographic information as well as the level of experience concerning computer and Internet usage, the familiarity with on-line newspapers and their browser preferences.
DATA ANALYSIS The log files gained from the experiment represent lists of events from which behavioral attributes have to be extracted. Significance tests are done to find differences between the user tasks regarding these attributes. When such a significant difference is found, this attribute may be suitable for the automatic identification of user tasks.
The first investigations concentrated on page views which represent the time a user was looking at a Web page. Page views are derived from the log by considering the page events, i.e. when a page is shown and hidden, but also tab events. Sometimes, users like to load a page in a tab in the background, but this does not actually start a page view as the user cannot yet see the page. The page view only starts when the user selects the according tab.
The page views were examined concerning their average duration as well as the number of page views per task and per minute. Furthermore, the time proportion of start page visits during the task and the number of unique URLs (page views without repetition) in proportion to the total number of page views were of interest. A t-test with pairwise samples was done to measure the significance of the difference between the tasks. Usually, t-tests require a normal distribution which cannot be guaranteed here, as the sample size is too small. However, due to the exploratory character of the study this uncertainty is accepted.
RESULTS The Average Duration of a Page View For each user and each task an average page view duration was calculated. Figure 1 shows the results for the three tasks Fact Finding (FF), Information Gathering (IG) and Just Browsing (JB) including average value and the standard deviation depicted as error bar. The t-test reveals that the difference between each pair of tasks is significant as the significance value is always less than a minimal level of p = 0.05 (see Table 1). The degree of freedom is always df = 19.
This allows the assumption that Fact Finding takes less time than the other tasks. The high values of the standard deviations suggest that a differentiation between Information Gathering and Just Browsing might turn out difficult. To draw generally valid conclusions and to see if this attribute is reliable for the identification of the tasks, it is necessary to collect data of more participants in a natural surrounding with arbitrary activities. However, these results show that low average duration of a page view is a good clue for Fact Finding. The investigations will be extended in order to reveal possible patterns; e.g. if there is a development during the session like page views becoming gradually shorter or longer depending on the task.
Figure 2 illustrates the frequency distributions for the three tasks. Their shape allows the presumption of a normal distribution. However, the size of the sample is too small to allow generally valid statements.
The Number of Page Views With regard to the number of Web pages viewed during one task, a significant difference is evident between Fact Finding and the other two goals. However, a significant difference between Information Gathering and Just Browsing could not be found as Table 2 shows (see also Figure 3). A similar result turns out when normalizing this attribute by referring it to a time period of one minute as depicted in Figure 4 and Table 3. This seems quite evident as Fact Finding is characterized as a quick search for a well-defined piece of information. Again, this attribute seems to be very suitable for the recognition of Fact Finding whereas Information Gathering and Just Browsing appear similar. Figure 5 indicates a normal distribution for the number of page views per minute.
Unique URLs and Start Page Visits Two further behavioral aspects were investigated: the number of unique URLs in proportion to the total number of page views and the time proportion of start page visits. The URL proportion reflects whether pages have been visited several times. If the value is high most of the pages have been visited only once. A lower value indicates more repetitions. Again, Fact Finding turns out to be significantly different from the other two user tasks with a high average value. In contrast, Information Gathering and Just Browsing are less easy to differentiate (see Figure 6 and Table 4). The investigations have to be extended in order to find out what causes these repetitions. Maybe one reason is that users navigate deep into the structure and navigate back on the same path to their starting point several times.
The time proportion of start page visits was expected to bring a difference between Just Browsing and Information Gathering. The t-test confirms this assumption (see Figure 7 and • Fact Finders do not tend to page revisits. • Users performing Information Gathering spend little time on the start page of the newspaper compared to Fact Finding and Just Browsing.
This list is not complete as the similarities between the tasks also have to be included. Furthermore, more detailed investigations have do be done, e.g. on the page view duration as it has already been mentioned.
An issue of concern are the high values of standard deviation for some attributes. Until now, one can only guess that their origin lies in the different motivation of the participants. Some, for example, read very carefully whereas others seemed to be keen on finishing the test. If, however, these differences between the participants are caused by individual surfing habits, this might cause problems with the task identification.
Limitations The study collected data of only few users under very controlled conditions. Clearly, this causes some limitations, but these were not accepted without reason. As it was explained at the beginning, we wanted to guarantee that the users are performing exactly the tasks we were expecting in order to have an unambiguous picture of the task-dependent behavior. If the participants were allowed to do what they wanted they could have become distracted or constantly switched between tasks. That way, we gained ideal data in which the behavioral patterns could be searched.
It was decided to conduct the test on only one Web site and exactly one version of it to keep external influences as little as possible. The participants were supposed to see the same and to do the same. However, further tests must include more Web sites. This will show if the differences found so far also occur on other newspaper sites and eventually also on totally different Web sites. We will also include the category Transaction as there will certainly be some on-line newspapers requiring this kind of activity.
Conclusion With regard to the behavioral attributes described above, differences between the three user tasks occurred. They allow The list of evaluated attributes is still limited to very simple attributes. More evaluations will be done on the scroll behavior and, connected to this, the information whether a page was viewed completely or only its beginning. Furthermore, the use of browser buttons like the back button will be analyzed as well as mouse moves; e.g. do Just Browsers click on images rather than on text? This leads to a very important point: until now, the content has not yet been taken into consideration. This information will highly enrich the behavior analysis.
Moreover, the range of evaluation methods will have to be extended. The attributes we have so far derived from the event log will also be used for testing machine learning techniques such as classification trees, clustering or Bayesian models to examine the expressiveness of the attributes. The subsequent step will be a field study in which the hypotheses gained from the pilot study will be tested under realistic conditions. The event recording tool will be installed on the participants’ computers and log their behavior for a period of four weeks. The users will have to document their activities to maintain a connection between the log and the user task. Until now, it was not possible to draw generally valid conclusions due to the small sample size in the pilot study. The field study will bring the amount of data necessary to create and test a method for identifying the user task. RELATED WORK In the second section some state of the art concerning user tasks and user task taxonomies has already been presented. There are, however, further areas besides the Web where the identification of user tasks is of interest.
In the area of workflow management, for example, processes
are to be identified which can be compared to user tasks as
we have described them here. In [
Most of these approaches do not only deal with the question about what the user is doing, they are, above all, interested in what the user needs, which is closely connected with the user task and the user’s goal. However, a final satisfying solution of gaining this information has yet to be found. SUMMARY AND OUTLOOK An exploratory study was conducted to examine the connection between the task a user is currently performing and the resulting behavior. The investigations referred to on-line newspapers to avoid the influence different kinds of Web sites could have on the surfing behavior. Exercises were set that each corresponded to a user task: Fact Finding, Information Gathering or Just Browsing. During the test, every event was recorded in a log file. The first evaluations referred to attributes of page views and already led to promising results. Fact Finding was distinguishable from the other two user tasks in four of five attributes, whereas Information Gathering and Just Browsing showed a difference for only two attributes. The next step will be to examine if the attributes are suitable for the prediction of the task by applying different machine learning techniques such as classification trees or Bayesian models.
The study was to gain hints on which aspects of the behavior might be useful to enable automatic task identification. These hints have to be wrapped in clear hypotheses like “Fact Finders usually view Web pages only briefly, scroll fast, and often do not scroll down to view a page in total.” These hypotheses have to be tested in another study which must be more extensive concerning participant number and time. Furthermore, the data should be collected when the users are involved in their everyday activities and not in a laboratory situation.
As soon as a feasible task identification can be implemented, a variety of user support mechanisms can be realized. A recommender system for an on-line newspaper could, for example, use different algorithms for the determination of link suggestions depending on the user task. When dealing with Fact Finding, text mining could be preferred: the user is looking for a small piece of information like a keyword, so we could look for documents containing the same keywords as those Web pages the user has just visited. When dealing with Information Gathering, it would be advisable to search for recommendations within the same topic frame whereas Just Browsing seems eligible for a method like association mining where articles are suggested that were often read together with those articles the current user has just seen. Depending on the task, different services could also be offered, e.g. a Fact Finder would probably welcome a search functionality provided with the next Web page opened. Furthermore, one could examine whether certain task types regularly occur at certain times of day for a specific user, e.g. in the morning the person often performs Information Gathering, at noon Just Browsing and during the afternoon Fact Finding. Thus, the time of day could already give hint on the task.
The utility of identifying user tasks is, however, not restricted to recommender systems. A live assistant can be developed that recognizes the user task and, connected with this, the user’s needs and gives according hints.
The list of utilities that automatic user task recognition could make possible is by far not complete. This underlines even more how important this topic is and will still be in the future.