=Paper=
{{Paper
|id=Vol-435/paper-25
|storemode=property
|title=A User-Centred Evaluation Framework for the SeaLife Semantic Web Browsers
|pdfUrl=https://ceur-ws.org/Vol-435/poster13.pdf
|volume=Vol-435
|authors=Gayo Diallo,Gemma Madle,Gawesh Jawaheer,Patty Kostkova,Dimitra Alexopoulou,Robert Stevens,Simon Jupp,Khaled Khelif
|dblpUrl=https://dblp.org/rec/conf/swat4ls/DialloMJKASJK08
}}
==A User-Centred Evaluation Framework for the SeaLife Semantic Web Browsers==
<pdf width="1500px">https://ceur-ws.org/Vol-435/poster13.pdf</pdf>
<pre>
            A User-Centered Evaluation Framework for the
                  SeaLife Semantic Web Browsers

                            1                  1                    1               1
       Gayo Diallo , Gemma Madle , Gawesh Jawaheer , Patty Kostkova , Dimitra
                                     2                 3                3           4
                      Alexopoulou , Robert Stevens , Simon Jupp , Khaled Khelif
                  1
                      City eHealth Research Centre, City University of London, London, UK
        2
            Bioinformatics Group, Biotechnological Centre T U Dresden, Dresden, Germany
              3
                  School of Computer Science, University of Manchester, Manchester, UK
                                4
                                    INRIA Sophia Antipolis Méditerranée, France



Abstract

The SeaLife project1 is investigating semantic browsing and its application to the life
science domain. SeaLife’s main objective is to develop the notion of context-based
information integration by extending three existing semantic web browsers (SWB) to
link the existing Web to the eScience infrastructure. The browsers under development
are COHSE2, Corese3 and GoPubMed4, all of which already offer some semantic
browsing functionality. This poster presents a user-centered evaluation framework for
the SeaLife browsers. There is a need for a common framework and we will focus on
evaluating the end-user perception of the SWB and how a SeaLife browser helps them
gather desired information. The criteria used in the evaluation is related to the user
experience and the impact the semantic browsers have on two case studies involving
the NeLI portal5 and PubMed6. They will help to confirm or contradict the following
hypotheses: i) having a SWB reduces the length of the pathway taken or time taken to
find information or perform a task; ii) having a SWB reduces the number of links to
be explored and the ability to explore information the user may not have been aware
of; iii) users think that semantic links/ranking is a good help and this facilitate the use
of the system; iv) users always prefer using the system with the semantic browser
capability. Users range from infectious disease practitioners to molecular biologists,
who will perform a set of tasks in both workshop and online-based evaluations. Three
sources will provide the necessary data: i) Web server logs collected automatically as
users navigate the portals; ii) a task performance questionnaire constituted by a set of
tasks to be performed; iii) a user satisfaction and attitude questionnaire about the
system with and without the semantic browsers.

1
  http://www.biotec.tu-dresden.de/sealife
2
  http://cohse.cs.manchester.ac.uk/
3
  http://www-sop.inria.fr/edelweiss/software/corese
4
  http://www.gopubmed.com/
5
  http://www.neli.org.uk
6
  http://www.ncbi.nlm.nih.gov/pubmed/

</pre>