Proceedings of the
  Second International
Workshop on Evaluation
of Semantic Technologies
     (IWEST 2012)


              Held at the
9th Extended Semantic Web Conference
            (ESWC 2012)



   May 28th, Heraklion, Greece



      CEUR Workshop Proceedings Vol. 843
                                  Preface


Every year the International Workshop on Evaluation of Semantic Technologies
(IWEST) brings together researchers and practitioners dealing with different
aspects of semantic technology evaluation. The first edition of the workshop was
held in 2010, building on the success of the International Workshop on Evaluation
of Ontology-based Tools (EON) workshop series initiated in 2002.
    The aims of the IWEST workshop are twofold. Firstly, to initiate discussion
about the current trends and future challenges of evaluating semantic technolo-
gies. Secondly, to support communication and collaboration with the goal of
aligning the various evaluation efforts within the community and accelerating
innovation in all the associated fields.
    This volume contains the papers accepted for publication in IWEST 2012.
The workshop received 6 submissions, which were reviewed by at least three
Program Committee members; 5 papers were selected as a result of this process.
    We would like to take the opportunity to express our gratitude to the Pro-
gram Committee members, to the SEALS European project who kindly has
supported this years edition of IWEST as sponsor, and to all the researchers
that have contributed in making the IWEST workshop a forum around seman-
tic technology evaluation.



May 2012                                                     Raúl Garcı́a-Castro
                                                                   Lyndon Nixon
                                                                  Stuart Wrigley
                             Organization


Organizing Committee
Raúl Garcı́a-Castro (Universidad Politécnica de Madrid, Spain)
Lyndon Nixon (STI International, Austria)
Stuart Wrigley (University of Sheffield, UK)


Program Committee
Paul Buitelaar (DERI)
Philipp Cimiano (University of Bielefeld)
Oscar Corcho (Universidad Politécnica de Madrid)
Mathieu d’Aquin (Open University)
Thierry Declerck (DFKI)
Jérôme Euzenat (INRIA)
Ning Li (Open University)
Francisco Martı́n-Recuerda (Universidad Politécnica de Madrid)
Christian Meilicke (Universität Mannheim)
Natasha Noy (Stanford University)
Filip Radulovic (Universidad Politécnica de Madrid)
Pavel Shvaiko (Informatica Trentina)
Cassia Trojahn dos Santos (INRIA)
Mikalai Yatsevich (Oxford University)


Sponsoring Institution
Semantic Evaluation At Large Scale FP7 project (RI-238975)
http://www.seals-project.eu/
                                         Table of Contents


Multilingual Ontology Matching Evaluation – A First Report on using
MultiFarm . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .      1
  Christian Meilicke, Cássia Trojahn, Ondřej Šváb-Zamazal, and Do-
  minique Ritze

Automatic Conformance Test Data Generation Using Existing
Ontologies in the Web . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .              13
   Irlán Grangel-González and Raúl Garcı́a-Castro
Evaluating Semantic Search Systems to Identify Future Directions of
Research . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .   25
   Khadija Elbedweihy, Stuart N. Wrigley, Fabio Ciravegna, Dorothee Rein-
   hard, and Abraham Bernstein
Building the WSMO-Lite Test Collection on the SEALS Platform . . . . . . .                                                   37
   Liliana Cabral, Ning Li, and Jacek Kopecký

Using WS-BPEL for Automation of Semantic Web Service Tools
Evaluation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .     49
   Serge Tymaniuk, Ioan Toma, and Liliana Cabral