<?xml version="1.0" encoding="UTF-8"?>
<TEI xml:space="preserve" xmlns="http://www.tei-c.org/ns/1.0" 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" 
xsi:schemaLocation="http://www.tei-c.org/ns/1.0 https://raw.githubusercontent.com/kermitt2/grobid/master/grobid-home/schemas/xsd/Grobid.xsd"
 xmlns:xlink="http://www.w3.org/1999/xlink">
	<teiHeader xml:lang="en">
		<fileDesc>
			<titleStmt>
				<title level="a" type="main">Named Entity Recognition using FOX</title>
			</titleStmt>
			<publicationStmt>
				<publisher/>
				<availability status="unknown"><licence/></availability>
			</publicationStmt>
			<sourceDesc>
				<biblStruct>
					<analytic>
						<author>
							<persName><forename type="first">René</forename><surname>Speck</surname></persName>
							<affiliation key="aff0">
								<orgName type="department">Department of Computer Science</orgName>
								<orgName type="laboratory">AKSW</orgName>
								<orgName type="institution">University of Leipzig</orgName>
								<address>
									<country key="DE">Germany</country>
								</address>
							</affiliation>
						</author>
						<author>
							<persName><forename type="first">Axel-Cyrille</forename><surname>Ngonga</surname></persName>
							<affiliation key="aff0">
								<orgName type="department">Department of Computer Science</orgName>
								<orgName type="laboratory">AKSW</orgName>
								<orgName type="institution">University of Leipzig</orgName>
								<address>
									<country key="DE">Germany</country>
								</address>
							</affiliation>
						</author>
						<title level="a" type="main">Named Entity Recognition using FOX</title>
					</analytic>
					<monogr>
						<imprint>
							<date/>
						</imprint>
					</monogr>
					<idno type="MD5">57331F1287FD6131958A36ECBBF94513</idno>
				</biblStruct>
			</sourceDesc>
		</fileDesc>
		<encodingDesc>
			<appInfo>
				<application version="0.7.2" ident="GROBID" when="2023-03-24T20:10+0000">
					<desc>GROBID - A machine learning software for extracting information from scholarly documents</desc>
					<ref target="https://github.com/kermitt2/grobid"/>
				</application>
			</appInfo>
		</encodingDesc>
		<profileDesc>
			<abstract>
<div xmlns="http://www.tei-c.org/ns/1.0"><p>Unstructured data still makes up an important portion of the Web.</p><p>One key task towards transforming this unstructured data into structured data is named entity recognition. We demo FOX, the Federated knOwledge eXtraction framework, a highly accurate open-source framework that implements RESTful web services for named entity recognition. Our framework achieves a higher Fmeasure than state-of-the-art named entity recognition frameworks by combining the results of several approaches through ensemble learning. Moreover, it disambiguates and links named entities against DBpedia by relying on the AGDISTIS framework. As a result, FOX provides users with accurately disambiguated and linked named entities in several RDF serialization formats. We demonstrate the different interfaces implemented by FOX within use cases pertaining to extracting entities from news texts.</p></div>
			</abstract>
		</profileDesc>
	</teiHeader>
	<text xml:lang="en">
		<body>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="1">Introduction</head><p>The Semantic Web vision requires the data on the Web to be represented in a machinereadable format. Given that a significant percentage of the data available on the Web is unstructured, tools for transforming text into RDF are of central importance. In this demo paper, we present FOX, the federated knowledge extraction framework. <ref type="foot" target="#foot_0">1</ref> It integrates state-of-the-art named entity recognition (NER) frameworks by using ensemble learning <ref type="bibr">(EL)</ref>. By these means, FOX can achieve up to 95.23% F-measure where the best of the current state-of-the-art system (Stanford NER) achieves 91.68% F-measure. In this paper, we aim to demonstrate several of the features of FOX, including the large number of input and output formats it supports, different bindings with which FOX can be integrated into Java and Python code and the easy extension model underlying the framework. Our framework is already being used in several systems, including SCMS <ref type="bibr" target="#b4">[5]</ref>, ConTEXT <ref type="bibr" target="#b2">[3]</ref> and IR frameworks <ref type="bibr" target="#b7">[8]</ref>. The approach underlying FOX is presented in <ref type="bibr" target="#b6">[7]</ref>, which will be presented at the same conference. All features presented herein will be part of the demonstration.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2">Demonstration</head><p>The goal of the demonstration will be to show the whole of the FOX workflow from the gathering and preprocessing of input data to the generation of RDF data. In addition, we will show how to configure and train FOX after it has been enhanced with a novel NER tool or EL algorithm. Further, we will present FOX's feedback RESTful service to improve the training and test datasets. In the demonstration, we also go over the Python<ref type="foot" target="#foot_1">2</ref> and Java bindings <ref type="foot" target="#foot_2">3</ref> for an easy use of FOX's RESTful service within an application. At the end we will explain how to use the FOX Java interfaces to integrate future algorithms.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2.1">Workflow</head><p>The workflow underlying FOX consists of four main steps: (1) preprocessing of the unstructured input data, (2) recognizing the Named Entities (NE), (3) linking the NE to resources using AGDISTIS <ref type="bibr" target="#b8">[9]</ref> and (4) converting the results to an RDF serialization format.</p><p>Preprocessing FOX allows users to use a URL, text with HTML tags or plain text as input data (see the top left part of Figure <ref type="figure" target="#fig_0">1</ref>). The input can be carried out in a form (see the center of Figure <ref type="figure" target="#fig_0">1</ref>) or via FOX's web service. In case of a URL, FOX sends a request to the given URL to receive the input data. Then, for all input formats, FOX removes HTML tags and detects sentences and tokens. Entity Recognition Our approach relies on four state-of-the-art NER tools so far: <ref type="bibr" target="#b0">(1)</ref> the Stanford Named Entity Recognizer (Stanford) <ref type="bibr" target="#b1">[2]</ref>, (2) the Illinois Named Entity Tagger (Illinois) <ref type="bibr" target="#b5">[6]</ref>, (3) the Ottawa Baseline Information Extraction (Balie) <ref type="bibr" target="#b3">[4]</ref> and (4) the Apache OpenNLP Name Finder (OpenNLP) <ref type="bibr" target="#b0">[1]</ref>. FOX allows using a particular NER approach which is integrated in it (see bottom right of Figure <ref type="figure" target="#fig_0">1</ref>). To this end, FOX light has to be set to the absolute path to the class of the tool to use. If FOX light is off, then FOX utilizes these four NER tools in parallel and stores the received NEs for further processing. It maps the entity types of each of the NER tools to the classes Location, Organization and Person. Finally, the results of all tools are merged by using FOX's EL layer as discussed in <ref type="bibr" target="#b6">[7]</ref>. We will show the named entities recognized by FOX and contrast these with those recognized by the other tools. Moreover, we will show the runtime log that FOX generates to point to FOX's scalability.</p><p>Entity Linking FOX makes use of AGDISTIS <ref type="bibr" target="#b8">[9]</ref>, an open-source named entity disambiguation framework able to link entities against every linked data knowledge base, to disambiguate entities and to link them against DBpedia. In contrast to lookup-based approaches, our framework can also detect resources that are not in DBpedia. In this case, these are assigned their own URIs. Moreover, FOX provides a Java interface and a configuration file for easy integration of other entity linking tools. We will show the messages that FOX generates and sends to AGDISTIS as well as the answers it receives and serializes.</p><p>Serialization Formats FOX is designed to support a large number of use cases. To this end, our framework can serialize its results into the following formats: JSON-LD <ref type="foot" target="#foot_3">4</ref> , N-Triples<ref type="foot" target="#foot_4">5</ref> , RDF/JSON<ref type="foot" target="#foot_5">6</ref> , RDF/XML<ref type="foot" target="#foot_6">7</ref> , Turtle<ref type="foot" target="#foot_7">8</ref> , TriG<ref type="foot" target="#foot_8">9</ref> , N-Quads<ref type="foot" target="#foot_9">10</ref> . FOX allows the user to choose between these formats (see bottom left part of Figure <ref type="figure" target="#fig_0">1</ref>). We will show how the out of FOX looks like in the different formats and point to how they can be parsed.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3">Evaluation and Results</head><p>We performed a thorough evaluation of FOX by using five different datasets and comparing it with state-of-the-art NER frameworks (see Table <ref type="table" target="#tab_0">1</ref>). Our evaluation shows that FOX clearly outperforms the state of the art. The details of the complete evaluation are presented in <ref type="bibr" target="#b6">[7]</ref>. The evaluation code and datasets are also available at FOX's Github page, i.e., http://github.com/AKSW/FOX. </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4">Conclusion</head><p>We will present FOX, a NER framework which relies on EL and demonstrate how it can be used. In future work, we will extend the number of tools integrated in FOX. Moreover, we will extend the tasks supported by the framework. In particular, we aim to integrate tagging, keyword extraction as well as relation extraction in the near future.</p></div><figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_0"><head>Fig. 1 .</head><label>1</label><figDesc>Fig. 1. Request form of the FOX online demo.</figDesc><graphic coords="2,134.77,376.23,345.83,184.13" type="bitmap" /></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" type="table" xml:id="tab_0"><head>Table 1 .</head><label>1</label><figDesc>Comparison of the F-measure of FOX with the included NER tools. Best results are marked in bold font. Web Reuters All News News * Web Reuters All FOX 92.73 95.23 68.81 87.55 90.99 90.70 93.09 63.36 81.98 90.28 Stanford 90.34 91.68 65.81 82.85 89.21 87.66 89.72 62.83 79.68 88.05 Illinois 80.20 84.95 64.44 85.35 79.54 76.71 83.34 54.25 83.74 76.25 OpenNLP 73.71 79.57 49.18 73.96 72.65 67.89 75.78 43.99 72.89 67.66 Balie 71.54 79.80 40.15 64.78 69.40 69.66 80.48 35.07 68.71 67.82</figDesc><table><row><cell>token-based</cell><cell>entity-based</cell></row><row><cell>News News  *</cell><cell></cell></row></table></figure>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="1" xml:id="foot_0">FOX online demo:http://fox-demo.aksw.org FOX project page:http://fox.aksw.org. Source code, evaluation data and evaluation results:http://github.com/AKSW/FOX.</note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="2" xml:id="foot_1">https://pypi.python.org/pypi/foxpy</note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="3" xml:id="foot_2">https://github.com/renespeck/fox-java</note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="4" xml:id="foot_3">http://www.w3.org/TR/json-ld</note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="5" xml:id="foot_4">http://www.w3.org/TR/n-triples/</note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="6" xml:id="foot_5">http://www.w3.org/TR/rdf-json</note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="7" xml:id="foot_6">http://www.w3.org/TR/REC-rdf-syntax</note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="8" xml:id="foot_7">http://www.w3.org/TR/turtle</note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="9" xml:id="foot_8">http://www.w3.org/TR/trig</note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="10" xml:id="foot_9">http://www.w3.org/TR/n-quads</note>
		</body>
		<back>
			<div type="references">

				<listBibl>

<biblStruct xml:id="b0">
	<monogr>
		<title level="m" type="main">The opennlp project</title>
		<author>
			<persName><surname>Baldridge</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2005">2005</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b1">
	<analytic>
		<title level="a" type="main">Incorporating non-local information into information extraction systems by gibbs sampling</title>
		<author>
			<persName><forename type="first">Jenny</forename><forename type="middle">Rose</forename><surname>Finkel</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Trond</forename><surname>Grenager</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Christopher</forename><surname>Manning</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">ACL</title>
				<imprint>
			<date type="published" when="2005">2005</date>
			<biblScope unit="page" from="363" to="370" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b2">
	<analytic>
		<title level="a" type="main">context -lightweight text analytics using linked data</title>
		<author>
			<persName><forename type="first">Ali</forename><surname>Khalili</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Sören</forename><surname>Auer</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Axel-Cyrille Ngonga</forename><surname>Ngomo</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">11th Extended Semantic Web Conference (ESWC2014)</title>
				<imprint>
			<date type="published" when="2014">2014</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b3">
	<monogr>
		<title level="m" type="main">Balie-baseline information extraction: Multilingual information extraction from text with machine learning and natural language techniques</title>
		<author>
			<persName><forename type="first">David</forename><surname>Nadeau</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2005">2005</date>
		</imprint>
		<respStmt>
			<orgName>University of Ottawa</orgName>
		</respStmt>
	</monogr>
	<note type="report_type">Technical report</note>
</biblStruct>

<biblStruct xml:id="b4">
	<analytic>
		<title level="a" type="main">SCMS -Semantifying Content Management Systems</title>
		<author>
			<persName><forename type="first">Axel-Cyrille Ngonga</forename><surname>Ngomo</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Norman</forename><surname>Heino</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Klaus</forename><surname>Lyko</surname></persName>
		</author>
		<author>
			<persName><forename type="first">René</forename><surname>Speck</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Martin</forename><surname>Kaltenböck</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the International Semantic Web Conference</title>
				<meeting>the International Semantic Web Conference</meeting>
		<imprint>
			<date type="published" when="2011">2011</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b5">
	<analytic>
		<title level="a" type="main">Design challenges and misconceptions in named entity recognition</title>
		<author>
			<persName><forename type="first">Lev</forename><surname>Ratinov</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Dan</forename><surname>Roth</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the Thirteenth Conference on Computational Natural Language Learning, CoNLL &apos;09</title>
				<meeting>the Thirteenth Conference on Computational Natural Language Learning, CoNLL &apos;09<address><addrLine>Stroudsburg, PA, USA</addrLine></address></meeting>
		<imprint>
			<publisher>Association for Computational Linguistics</publisher>
			<date type="published" when="2009">2009</date>
			<biblScope unit="page" from="147" to="155" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b6">
	<analytic>
		<title level="a" type="main">Ensemble learning for named entity recognition</title>
		<author>
			<persName><forename type="first">René</forename><surname>Speck</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Axel-Cyrille Ngonga</forename><surname>Ngomo</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the International Semantic Web Conference</title>
		<title level="s">Lecture Notes in Computer Science</title>
		<meeting>the International Semantic Web Conference</meeting>
		<imprint>
			<date type="published" when="2014">2014</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b7">
	<analytic>
		<title level="a" type="main">Combining linked data and statistical information retrieval</title>
		<author>
			<persName><forename type="first">Ricardo</forename><surname>Usbeck</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">11th Extended Semantic Web Conference, PhD Symposium</title>
				<imprint>
			<publisher>Springer</publisher>
			<date type="published" when="2014">2014</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b8">
	<analytic>
		<title level="a" type="main">Agdistis -agnostic disambiguation of named entities using linked open data</title>
		<author>
			<persName><forename type="first">Ricardo</forename><surname>Usbeck</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Axel-Cyrille Ngonga</forename><surname>Ngomo</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Sören</forename><surname>Auer</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Daniel</forename><surname>Gerber</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Andreas</forename><surname>Both</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Submitted to 12th International Semantic Web Conference</title>
				<meeting><address><addrLine>Sydney, Australia</addrLine></address></meeting>
		<imprint>
			<date type="published" when="2013-10-25">21-25 October 2013. 2013</date>
		</imprint>
	</monogr>
</biblStruct>

				</listBibl>
			</div>
		</back>
	</text>
</TEI>
