In this paper we present TROvE (Tool for Rapid OWL Reasoner Evaluation), a tool aimed to o er to a non-expert user the possibility to evaluate OWL reasoners on several reasoning tasks by means of a simple \push-button" solution. Reasoning with ontologies is one of the core tasks of research in Description Logics (see, e.g., [1]). This is also witnessed by the large number of reasoners currently available, see, e.g., the results of the last OWL Reasoner Evaluation (ORE) [2]. Given the wide range of potential practical applications in the Semantic Web [3], practitioners leveraging semantic reasoners in their applications have to answer the question \Which system should I use?". To answer such a question, several projects and events have been implemented, e.g., the SEALS project http://www.seals-project.eu and the ORE. Also if in such kind of events reasoners are evaluated using transparent and fair methods, in a practical application context a practitioner could be interested in understanding the current state of the art related to a particular reasoning task for which data could not be available to the research community. This can lead a non-expert user to deal with several issues, both technical and theoretical. In this paper we present TROvE (Tool for Rapid OWL Reasoner Evaluation), a tool aimed to o er to a non-expert user the possibility to evaluate OWL reasoners on several reasoning tasks. In the spirit of tools such as weka [4] for the experimental evaluation of machine learning algorithms, TROvE o ers to the user a \push-button" solution aimed to help the user answer the question above, focusing only on input data at the user execution stage, and showing data in order to evaluate both correctness and performance at the user validation stage. The architecture of TROvE1 builds on and extends the one of FRaQuE [5], a command line tool aimed to o er to a non-expert user easy solutions aimed to help her to evaluate query processors for Ontology Based Data Access. Figure 1 presents the architecture of TROvE. It is composed of six modules: 1 TROvE is available for download at http://sites.google.com/site/trove14.
INTERFACE manages the input received by the user by means of the Graphical User Interface (GUI) depicted in Figure 2. It also dispatches the input data to TASK MANAGER, ONTOLOGY MANAGER, and QUERY MANAGER (if it is the case). ONTOLOGY MANAGER is devoted to manage the OWL input le(s). TASK MANAGER is aimed to manage the reasoning task selected by the user. At the time of writing, TROvE supports classi cation, consistency checking and query answering.
QUERY MANAGER is devoted to process the query input le. It checks the compliance of the query with the SPARQL 1.0 syntax, and, considering the selected reasoner(s), it applies syntactic modi cations to the input query le or returns to INTERFACE an error message if the input query is not supported by the selected reasoner(s).
REASONER MANAGER is aimed to manage the interaction of TROvE with the supported reasoners. Selected reasoners are executed in a sequential way with default parameters.
RESULT MANAGER takes in charge outputs: (i) as performance metrics managing shell and log les, (ii) as text le(s) containing the query result(s) in case of query answering task.
The reasoners currently supported by TROvE are listed below:
{ ARQ [
In TROvE it is used with owl-dl semantics.
{ BaseVISor (version 2.0)2 a reasoner for owl2 rl.
{ Clipper [
Concerning the GUI, looking at Figure 2, we can see that it is composed of several blocks. In Reasoning Tasks, users can select a reasoning task and, accordingly, in Reasoners, users can choose a set of suitable reasoners by checking them (reasoners not available to cope with the selected task are not checkable). 2 See the BaseVISor web site at http://visiology.com/basevisor/basevisor.
html
In Ontologies Loading, users can load a (set of) OWL le(s) in the following ways: (i) single le selection; (ii) folder selection; and (iii) copy & paste using a text area. In Queries Loading, users can load a (set of) query les with the same options available in Ontologies Loading. In Output directory, users can select a folder to gather the results. Finally, in Results user can launch the experiment pushing the \Start" button. 3
In this paper, we presented TROvE, a graphical tool that allows a non-expert user to perform a rapid evaluation of state-of-the-art reasoners on di erent reasoning tasks, e.g., classi cation, consistency checking, and query answering.
Currently, we are working to extend TROvE in two main directions. The rst one concerns the usability of the GUI, especially considering the visualization of the results related to a given experiment. The second one is related to the modularity of TROvE, in order to simplify the mechanism used to add a new reasoner to the pool supported by TROvE.
Acknowledgments The authors wish to thank the anonymous reviewers for their comments and suggestions for improving the paper. This work is supported by Regione Autonoma della Sardegna e Autorita Portuale di Cagliari con L.R. 7/2007, Tender 16 2011, CRP-49656 \Metodi innovativi per il supporto alle decisioni riguardanti lottimizzazione delle attivita in un terminal container", the desctop project (http://visionlab.uniss.it/desctop).