<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Creating and Using an Education Standards Ontology to Improve Education</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Rensselaer Polytechnic Institute</string-name>
        </contrib>
      </contrib-group>
      <abstract>
        <p>We present an education standards ontology that has the potential for simplifying lesson planning for teachers, providing support for students by linking relevant resources, and providing a potential terminology for use in a lingua-franca for communicating with multiple communities about education components. We address the United Nations sustainable development goals concerned with education, with the support of semantic technologies. The goals of ensuring that all children graduate from primary and secondary schools and ensuring literacy and numeracy are our targets. We have created an education standards ontology along with a methodology for automatically generating this ontology. In this submission, we review literature related to educational applications that use semantic technologies and describe a web scraping method that we designed and used to automatically generate an education standards ontology. We also describe some potential uses of this ontology to assist in the UN education goals and reflect on next steps on uses of these existing educational resources to aide in improving literacy and numeracy in students and enabling future potential services and impact for an Educational Semantic Web.</p>
      </abstract>
      <kwd-group>
        <kwd>Educational Semantic Web</kwd>
        <kwd>education</kwd>
        <kwd>semantic web</kwd>
        <kwd>ontology generation</kwd>
        <kwd>education standards ontology</kwd>
        <kwd>Common Core</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 Introduction</title>
      <p>
        Shortly after the 2001 article presenting the vision of the Semantic Web [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], a
discussion on the future of education on the Educational Semantic Web arose
with the 2004 special issue of the Journal of Interactive Media in Education [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
The authors presented visions of the efect of Semantic Web technologies on the
coming decade of education, discussing possible advancements in information
storage and retrieval, agents, and communication. Educational practitioners, in
turn, provided reactions and rebuttals, voicing concerns with practicality and
implementation.
      </p>
      <p>
        Since the Semantic Web 3.0 has more features than its hypertext-based Web
2.0 predecessor, educators may not be versed in the added functionality, or they
may not have enough motivation and time to perform manual annotations of
resources that may be needed to efectively enable use of some of the advanced
Web 3.0 resources. For humans, education is traditionally an interactive,
personal experience, or as one educator describes, “an artistic, social interchange
rather than one waiting for enhancement and possible substitution by a
humanmachine interaction [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].” Nevertheless, advances toward an Educational Semantic
Web have the potential to reduce workload on instructors, create useful learning
opportunities, improve content accessibility for society as a whole, and provide
a well defined vocabulary for discussions about learning objectives and skills,
thereby enhancing intercommunication across communities.
      </p>
      <p>
        The Common Core standards for mathematics [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] and English Language
Arts (which includes reading, writing, history, and the sciences) [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] are a set
of guidelines designed to outline learning objectives for students at each given
grade, from primary to secondary education (Kindergarten through 12th grade).
They define the essential knowledge foundation and skills each student must
acquire by the end of each school year in “core” subjects. While the benefits of
standards in education have been the topic of ongoing debate [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], forty-one US
states, the District of Columbia, and four territories have adopted the Common
Core1.
      </p>
      <p>
        In order to assess one’s knowledge, students often take examinations
throughout the academic year to determine if educational standards are being met.
Problems frequently arise when students prepare for these tests, as students often find
themselves frustrated as to which methods to use to approach certain problems
[
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. As education systems evolve, parents may have dificulties helping when they
have been taught diferently how to approach a problem, or are unfamiliar with
the concepts being taught. A Common Core standards-based ontology can aid
with the design of online tutoring systems and can reduce ambiguity of
terminology by encoding explicit computer and human understandable definitions.
Making such platforms publicly accessible can provide benefit to the “Social
Good” by contributing to the UN Sustainable Development Goals related to
quality education2, helping to ensure literacy, numeracy, and that all students
are able to graduate from primary and secondary schools. A standards-based
ontology can support parents, educators, and students in communication using
a common vocabulary. The precise definitions and encodings of the standard can
also be used by those unfamiliar with specific common core methods to create
their own methods of meeting the standard. We further reflect in Section 4.1,
where we describe personalized learning environments tailored toward individual
students.
      </p>
      <p>Our contributions include a literature review on the Educational Semantic
Web domain, an automatic extraction method to generate an education
standards ontology from web content, and the resulting open source ontology. The
Python-based extraction code is available on GitHub3. We also have published</p>
      <sec id="sec-1-1">
        <title>1 http://www.corestandards.org/standards-in-your-state/</title>
      </sec>
      <sec id="sec-1-2">
        <title>2 https://sustainabledevelopment.un.org/sdg4</title>
      </sec>
      <sec id="sec-1-3">
        <title>3 See https://github.com/tetherless-world/education-standards-ontology</title>
        <p>the generated education standards ontology in order to aid with the linking of
education standards in semantic education applications4. Finally, we describe a
vision of a semantically-enabled education of the future.
2</p>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>Literature Review</title>
      <p>Semantic Web for education may leverage work from a wide range of areas.
We identify some foundations in the areas of learning objects, semantic grid
frameworks, content modeling, mobile learning, data science-driven learning, and
open scholarship.
2.1</p>
      <sec id="sec-2-1">
        <title>Learning Object</title>
        <p>
          Building on earlier notions of a Learning Object (LO), in the context of
technology aided e-learning [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ], refines the definition to be “any digital, reproducible
and addressable resource used to perform learning or support activities, made
available for others to use.” While the XML based Education Modeling
Language (EML), developed to describe learning objects, was not quite RDF, this
definition could be used to describe many resources on the Semantic Web
today. EML provides the basis for IMS Learning Design (LD) specification [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ], a
metadata based language that distinguishes between learning objects and
activities in order to describe both content and processes from varying perspectives.
The authors consider both the importance of individual, personalized learning
as well as collaborative, competence-based, or problem based learning. EML
includes Learner (Student) and Staf (Teacher) roles, nested activity structures,
Learning Object environments and services. This allows for conditions to inform
lfow of activity, producing outcomes and notifications for the learner, resulting
in an interactive learning environment.
2.2
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>Semantic Grid Frameworks</title>
        <p>
          Other e-learning systems in the 2000s began to leverage both education grid
systems as well as ontologies. The Semantic Grid-based E-Learning Framework
(SELF) [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ] uses the idea that Grid computing (distributed open service-oriented
network architecture) can leverage semantics to create a Semantic Grid for
elearning. As well as Grid components, the SELF architecture supports the idea
of open learning by considering collaborative tools, personalization and inference
services, and software agents.
        </p>
        <p>
          OntoEdu [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ] addresses the need for new technologies to be used to make
e-learning more mobile. The OntoEdu platform architecture for e-learning
includes user adaptation service and content models, and an education ontology.
The value provided by the ontology includes reasoning to produce activity
descriptions for the user to plan a sequence of actions. For example, the inferred
        </p>
        <sec id="sec-2-2-1">
          <title>4 Available at https://archive.org/services/purl/purl/ontology/edu/</title>
          <p>
            activity description can be used by a teacher to restrict a sequence of actions
such that a student must select a lesson before selecting a homework set.
Recent work in the e-learning direction includes an OWL ontology for metadata of
Interactive Learning Objects (ILO), created using the ILO Standard to permit
user interaction in eTutor applications [
            <xref ref-type="bibr" rid="ref16">16</xref>
            ]. In the context of semantic network
architectures, the JuxtaLearn project uses content analysis along with domain
ontologies to check the understanding of science concepts [
            <xref ref-type="bibr" rid="ref8">8</xref>
            ]. Science concepts
are acquired through video creation and sharing, performing network text
analysis, and constructing a multimodal network of categorized concepts. This work
reflects on the role of videos as a media for learning, which may be aided by the
categorization of pedagogical, domain, and general concepts, as well as tools and
actors.
2.3
          </p>
        </sec>
      </sec>
      <sec id="sec-2-3">
        <title>Ontologies for Education Content Modeling</title>
        <p>
          In order to consider the impacts of the Semantic Web (Web 3.0) on education,
it is fruitful to reflect on the impacts of the hypertext-based web (Web 2.0).
Almost all levels of education today use at least Web 2.0 with support ranging
from managing course websites to discovering research articles on the Internet,
and much more. The Semantic Web implies a change in web architecture to go
beyond static HTML. As people have learned to use the hypertext model of Web
2.0, they can similarly learn how to use Semantic Web RDF model as they see
the value proposition, eventually resulting in a potential improvement on future
education [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ].
        </p>
        <p>
          Educator Greg Kearsley argues however that busy teachers will not have
time to become ‘hyperkrep (hypertextual knowledge representation) hackers’
and adoption of technologies will require simplicity from the end user
perspective [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ]. We agree both that given a clear value proposition, teachers and other
relevant users will adopt more semantic web methodologies, and simultaneously
agree with a version of Kearsley’s position, that simplified tools and services are
needed.
        </p>
        <p>
          Even before the aforementioned journal discussion, ontologies were beginning
to be used to model hypermedia content, such as with Ontoportal, a framework
for building web-based educational portals [
          <xref ref-type="bibr" rid="ref24">24</xref>
          ]. Ontoportal aims to address the
concern that educational materials on the web are usually weakly interlinked.
Interlinking of web-based educational resources can be achieved by combining
ontological and hypermedia research principles. The authors of Ontoportal
describe two use cases where concepts can be designed to help educators gather
resources or populate course information for students.
        </p>
        <p>
          The teacher TPortal includes concepts aimed at experts and institutions,
including concepts related to teaching, assessment, and support materials. The
student XPortal additionally includes tutorials, courses, evaluation materials,
and standards. Similarly, a recent educational domain ontology designed for a
case study for the University of Palestine [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ] includes concepts such as course,
schedule, employee, student, and organization.
        </p>
      </sec>
      <sec id="sec-2-4">
        <title>Mobile Learning</title>
        <p>
          With the rise in popularity of mobile phones and the development of hand-held
technology for education, the idea of Mobile- or M-Learning naturally emerges
[
          <xref ref-type="bibr" rid="ref21">21</xref>
          ]. However, despite digital applications improving education, they are not
readily available in all countries or languages.
        </p>
        <p>
          A recent M-Learning System aims to address this concern for the Arabic
language by designing a mobile story-telling application that links to related images
by using Natural Language Processing (NLP) techniques for Arabic text
extraction [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ]. The system performs segmentation, tagging, and grammar linking,
while also using Semantic Web constructs to aid in semantic query
construction for question answering and semantic extraction, where ontology instances
are generated. Combining Semantic Web and NLP techniques for M-learning
can improve query navigation, the speed of information retrieval, and instance
consistency.
2.5
        </p>
      </sec>
      <sec id="sec-2-5">
        <title>Data Science-driven Education Initiatives</title>
        <p>
          The Big Data to Knowledge (BD2K) initiative to facilitate both in-person and
online learning has resulted in the Educational Resource Discovery Index
(ERuDIte). ERuDIte has been applied in the context of general data science [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ] as well
as domain specific biomedical data science [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ]. Also, knowledge resources are
imported from many sources, including Massive Open Online Courses (MOOC),
videos of tutorials or research conference talks, textbooks, blog posts, and web
pages. In this efort many metadata resources are integrated, including the
Dublin Core, Learning Resource Metadata Initiative (LRMI), IEEE’s
Learning Object Metadata (LOM), eXchanging Course Related Information (XCRI),
Metadata for Learning Opportunities (MLO), and Schema.org vocabularies.
        </p>
        <p>The Data Science Education Ontology (DSEO) uses data science methods
to teach data science, and includes an ontology of learning domains. We plan to
build a tutoring system that connects concepts from the DSEO with concepts
from our ontology. By connecting mathematics standards to statistical terms,
we can determine practice problems for the student to solve.
2.6</p>
      </sec>
      <sec id="sec-2-6">
        <title>Open Scholarship</title>
        <p>
          As the Semantic Web is decreasing ambiguity by supporting explicit term
definitions for use by both humans and machines, and a major goal of Web 3.0 is
related to data integration and interoperability, the implications on education
are plentiful [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ]. Possible impact areas include knowledge construction,
personalized learning network maintenance, personal educational administration, and
collaborative education tools. It is important for researchers and educators to
collaborate in the creation of content, as there are inherent biases associated
with the design of content.
        </p>
        <p>
          An open scholarship environment, which includes sharing articles, code, data,
and education resources, can improve research and education [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ]. Sharing of
resources can result in positive contributions to society, as it improves the
dissemination of knowledge. Further interconnected education tools that “understand”
each other’s usage of terminology have the potential to build community learning
environments.
3
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Methodology</title>
      <p>
        While there are numerous resources on the web related to education, many
were designed under the hypertext paradigm of Web 2.0. For example, the
Common Core Standards website5 is written in Javascript and HTML and does not
leverage the more expressive RDF representation, resulting in dificulties and/or
limitations in machine understanding. Even though these websites are typically
not encoded in a Semantic Web language (that would encourage more structure
and links), we still observe some hierarchy and structure often including sets of
organized links. By observing the HTML structure of a web page, it is possible
to extract information in a structured way by leveraging web scraping libraries
such as BeautifulSoup [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ]. We take this approach to automatically construct
an education standards ontology from the Common Core Standards in less than
100 lines of Python code.
      </p>
      <sec id="sec-3-1">
        <title>5 www.corestandards.org</title>
        <p>The Common Core website is divided into two main portals, one for
mathematics topics6 and another for English Language Arts7. Each of these pages
contains a well-structured HTML sidebar, which links to each set of standards
for given grade levels and topics. By selecting specific HTML tags and list items
from the sidebars, we are able to traverse each link and extract relevant
information that is used to generate ontology classes with labels, comments, and the
subsumption hierarchy. We also capture provenance by connecting the URL of
each link to the corresponding concept using prov:wasQuotedFrom. Using this
methodology, we are able to generate 1906 ontology classes. A subset of the
concepts from the English Language Arts standards associated with speaking and
listening is shown in Figure 1.
4</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Discussion</title>
      <p>An oft-quoted proverb states, “Give a man a fish, and you feed him for a day.
Teach a man to fish, and you feed him for a lifetime.” Analogously, we believe
students will benefit from learning how to learn. We expect open access
learning resources will aide in self-learning. The Education Standards Ontology can
be used to help students align the knowledge they gain with standards in the
Common Core. Self-guided learning will not only support learning required in
standard education systems but will also provide a foundation that will
support “continuous learning” beyond primary or secondary education. Further,
in today’s interdisciplinary world where many people often become self-taught
experts or near-experts in new areas, we expect increased need for evaluating
expertise and communicating that evaluation. Open ontologies and
ontologyenabled environments that use well defined terms and that are aligned with
published standards can provide a foundation for communication and
comparison.
4.1</p>
      <sec id="sec-4-1">
        <title>Personalized Learning</title>
        <p>In today’s teaching approaches, we often find that lessons are taught in a
standardized way, despite a multitude of students with varying learning rates and
interests. This results in dificulties for students who learn at a slower pace and
disengagement (or boredom) for higher performing students. Furthermore,
individuals may have diferent learning styles (auditory, kinesthetic, or visual), often
based on the way their brain processes information. We foresee an increase in
personalized learning environments, where the approaches to conveying
knowledge are targeted towards individual students’ needs, sometimes in response to
special needs students.</p>
        <p>In order for precision systems such as personalized learning environments
to be successful, it is important to evaluate how well a student is receiving the</p>
        <sec id="sec-4-1-1">
          <title>6 http://www.corestandards.org/Math/</title>
        </sec>
        <sec id="sec-4-1-2">
          <title>7 http://www.corestandards.org/ELA-Literacy/</title>
          <p>material being taught. Unfortunately, representative measurements of student
progress are dificult to obtain, as much is left out in the examination process
and complicating factors such as test anxiety sometimes skew results. A wide
range of additional learning assessment technologies, including for example
biometric measures of physiological indicators, to evaluate information reception
may be included. Semantic annotations can provide support for connecting and
integrating new assessment modalities.
4.2</p>
        </sec>
      </sec>
      <sec id="sec-4-2">
        <title>Question Answering</title>
        <p>
          In order for teachers to adopt new technologies, the value of the system has to
outweigh the learning barriers or ease of use issues. One such example includes
reliable automatic grading systems, as we are already beginning to see today.
Such platforms have been adopted because they are not overly complicated to
use, and are beneficial as they reduce the manual teacher workload. Question
answering capabilities of intelligent systems are continuously improving, from
search engines like Google to virtual assistants like Cortana [
          <xref ref-type="bibr" rid="ref23">23</xref>
          ] and Siri [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ].
We are likely to see further improvements in machine dialog capabilities with
advances in text to query syntax conversion, such as derivations of SPARQL
queries from natural language sentences. Ontology-enabled environments can
help improve query formation and result integration.
4.3
        </p>
      </sec>
      <sec id="sec-4-3">
        <title>Learning Resources</title>
        <p>Current day access to learning resources, including teaching materials, literature,
and lesson plans, are often limited to students who are part of an academic
institution. We predict expansion and improvement of remote access to learning
resources. Physical class materials may be replaced by interactive materials, such
as web-based learning resources.</p>
        <p>Open access learning resources can benefit institutions, teachers, students,
and parents by decreasing subscription fees, supporting customized lesson
planning, and improving opportunities for learners globally. Also open-source
resources help allow for collaborative learning and communication across
communities.</p>
        <p>
          We already see significant strides in terms of cloud-based education, where
teachers (and sometimes parents) have direct access to student homework, grades,
and projects. Students have direct access to course and library resources, and can
remotely attend lectures or watch video recordings. We are likely to see
intelligent classroom environments leverage sensor networks, as the Internet of Things
(IoT) [
          <xref ref-type="bibr" rid="ref25">25</xref>
          ] holds promising opportunities. By mapping these devices to ontology
concepts, semantic and social networks may be used to aid sensor networks.
4.4
        </p>
      </sec>
      <sec id="sec-4-4">
        <title>Virtual Classrooms</title>
        <p>Augmented reality techniques may be applied to learning environments, where
virtual reality headsets can be used to add visual demonstrations to augment
the physical classroom. Future augmented reality virtual classrooms may allow
students and/or teachers to connect to a virtual reality environment where an
educational lesson can take place. Of course, this does not have to be a classroom
in the traditional sense, as virtual field-trips may provide methods for learners
to witness world wonders, the outer reaches of space, or interactions at the
molecular level. With virtual applications, learning can be fun rather than a
chore; game-like simulations can provide enriching, interactive, and enjoyable
environments. The efects of a virtual classroom are likely to have a huge impact
in terms of social networking, in a sense the Facebook of the future. Ontologies
will be used to semi-automatically create and connect virtual environments.
5</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Future Work</title>
      <p>We introduce an approach for automatically generating an education standards
ontology from the Common Core website. It should be noted that the
extraction code is specific to the Common Core website, as we observe the HTML
structure of the relevant web pages in order to know from where to extract
concepts and descriptions. Despite minimal generality in the Common Core-specific
script, the described approach of observing the HTML web structure of a page
to automatically generate an ontology can be applied to other web pages. Future
work includes exploring methods of automatic web scraping techniques that are
robust or adaptable to the structure of the web page. More importantly, we
believe a useful, relatively simply-generated ontology is produced.</p>
      <p>In order to evaluate the value of our ontology, we plan to develop a smart
tutoring framework that takes advantage of earlier education ontologies and uses
the education standards ontology to link course concepts and questions to
Common Core standards. This will help provide useful lessons to students who are in
school districts that have adopted the Common Core, thereby potentially greatly
simplifying lesson planning for teachers and providing much more support for
students in the form of additional relevant resources. Such work has potential to
improve literacy, numeracy, and graduation rates for students.
6</p>
    </sec>
    <sec id="sec-6">
      <title>Conclusion</title>
      <p>We reviewed literature related to Semantic Web and education applications. We
identified active research for at least the last 15 years, with researchers
publishing methods related to the use of learning objects, semantic grid frameworks,
content modeling, mobile learning, and open scholarship. We describe the
automatic extraction method we used to generate an education standards ontology.
We have made both the extraction script and generated ontology publicly
available in order to encourage collaboration and reuse. We also discuss some ways
in which the education ontology and an ontology-enabled infrastructure can
advance realizing the vision of the Educational Semantic Web.</p>
    </sec>
    <sec id="sec-7">
      <title>Acknowledgements</title>
      <p>This work was partially supported by the RPI Tetherless World Constellation.
We thank the members of the Constellation for their suggestions, in particular
Rebecca Cowan.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Abbas</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Umer</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Odeh</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McClatchey</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ali</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Farooq</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <article-title>A semantic grid-based e-learning framework (self)</article-title>
          .
          <source>In Cluster Computing and the Grid</source>
          ,
          <year>2005</year>
          .
          <article-title>CCGrid 2005</article-title>
          . IEEE International Symposium on (
          <year>2005</year>
          ), vol.
          <volume>1</volume>
          , IEEE, pp.
          <fpage>11</fpage>
          -
          <lpage>18</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Ambite</surname>
            ,
            <given-names>J. L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fierro</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Geigl</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gordon</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Burns</surname>
            ,
            <given-names>G. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lerman</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          , and Van Horn,
          <string-name>
            <surname>J. D.</surname>
          </string-name>
          <article-title>Bd2k erudite: The educational resource discovery index for data science</article-title>
          .
          <source>In Proceedings of the 26th International Conference on World Wide Web Companion (Republic and Canton of Geneva, Switzerland</source>
          ,
          <year>2017</year>
          ), WWW '17 Companion, International World Wide Web Conferences Steering Committee, pp.
          <fpage>1203</fpage>
          -
          <lpage>1211</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Anderson</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Whitelock</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <article-title>The educational semantic web: Visioning and practicing the future of education</article-title>
          .
          <source>Journal of interactive Media in Education</source>
          <year>2004</year>
          ,
          <volume>1</volume>
          (
          <year>2004</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Berlanga</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>García</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          <article-title>Ims ld reusable elements for adaptive learning designs</article-title>
          .
          <source>Journal of Interactive Media in Education</source>
          <year>2005</year>
          ,
          <volume>1</volume>
          (
          <year>2005</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Berners-Lee</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Hendler</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <article-title>Publishing on the semantic web</article-title>
          .
          <source>Nature</source>
          <volume>410</volume>
          ,
          <issue>6832</issue>
          (
          <year>2001</year>
          ),
          <fpage>1023</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Clark</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Parsia</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Hendler</surname>
            ,
            <given-names>J. Will</given-names>
          </string-name>
          <article-title>the semantic web change education?</article-title>
          <source>Journal of Interactive Media in Education</source>
          <year>2004</year>
          ,
          <volume>1</volume>
          (
          <year>2004</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Cooney</surname>
            ,
            <given-names>T. J.</given-names>
          </string-name>
          <article-title>A beginning teacher's view of problem solving</article-title>
          .
          <source>Journal for research in mathematics education</source>
          (
          <year>1985</year>
          ),
          <fpage>324</fpage>
          -
          <lpage>336</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Daems</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Erkens</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Malzahn</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Hoppe</surname>
          </string-name>
          , H. U.
          <article-title>Using content analysis and domain ontologies to check learners' understanding of science concepts</article-title>
          .
          <source>journal of computers in education 1</source>
          ,
          <fpage>2</fpage>
          -
          <lpage>3</lpage>
          (
          <year>2014</year>
          ),
          <fpage>113</fpage>
          -
          <lpage>131</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Delandshere</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Arens</surname>
            ,
            <given-names>S. A.</given-names>
          </string-name>
          <article-title>Representations of teaching and standardsbased reform: are we closing the debate about teacher education?</article-title>
          <source>Teaching and Teacher Education</source>
          <volume>17</volume>
          ,
          <issue>5</issue>
          (
          <year>2001</year>
          ),
          <fpage>547</fpage>
          -
          <lpage>566</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Gruber</surname>
            ,
            <given-names>T. R.</given-names>
          </string-name>
          <string-name>
            <surname>Siri</surname>
          </string-name>
          ,
          <article-title>a virtual personal assistant-bringing intelligence to the interface</article-title>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Guangzuo</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fei</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hu</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Shufang</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          <article-title>Ontoedu: a case study of ontology-based education grid system for e-learning</article-title>
          . In GCCCE2004 International conference, Hong
          <string-name>
            <surname>Kong</surname>
          </string-name>
          (
          <year>2004</year>
          ), pp.
          <fpage>1</fpage>
          -
          <lpage>9</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Hummel</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Manderveld</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tattersall</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Koper</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <article-title>Educational modelling language and learning design: new challenges for instructional re-usability and personalized learning</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Initiative</surname>
            ,
            <given-names>C. C. S.</given-names>
          </string-name>
          , et al.
          <article-title>Common core state standards for english language arts and literacy in history/social studies, science, and technical subjects</article-title>
          . Washington, DC: National Governors Association (
          <year>2012</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Initiative</surname>
            ,
            <given-names>C. C. S. S.</given-names>
          </string-name>
          , et al.
          <article-title>Common core state standards for mathematics</article-title>
          . washington, dc:
          <article-title>National governors association center for best practices and the council of chief state school oficers</article-title>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Karkar</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , and Al Ja'am,
          <string-name>
            <surname>J.</surname>
          </string-name>
          <article-title>An educational ontology-based m-learning system</article-title>
          .
          <source>International Journal of Interactive Mobile Technologies (iJIM) 10</source>
          ,
          <issue>4</issue>
          (
          <year>2016</year>
          ),
          <fpage>48</fpage>
          -
          <lpage>56</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Luz</surname>
            ,
            <given-names>B. N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Santos</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Alves</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Areão</surname>
            ,
            <given-names>A. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yokoyama</surname>
            ,
            <given-names>M. H.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Guimarães</surname>
            ,
            <given-names>M. P.</given-names>
          </string-name>
          <article-title>An owl ontology for metadata of interactive learning objects</article-title>
          .
          <source>International Association for Development of the Information Society</source>
          (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>McKiernan</surname>
            ,
            <given-names>E. C.</given-names>
          </string-name>
          <article-title>Imagining the “open” university: Sharing scholarship to improve research and education</article-title>
          .
          <source>PLoS biology 15</source>
          ,
          <issue>10</issue>
          (
          <year>2017</year>
          ),
          <year>e1002614</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Naser</surname>
            ,
            <given-names>S. S. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Atallah</surname>
            ,
            <given-names>R. R.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Hamo</surname>
            ,
            <given-names>S. Building</given-names>
          </string-name>
          <article-title>an ontology in educational domain case study for the university of palestine</article-title>
          .
          <source>International Journal of Research in Engineering and Science (IJRES) 3</source>
          ,
          <issue>1</issue>
          (
          <year>2015</year>
          ),
          <fpage>15</fpage>
          -
          <lpage>21</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Ohler</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <article-title>The semantic web in education</article-title>
          .
          <source>EDUCAUSE quarterly 31</source>
          ,
          <issue>4</issue>
          (
          <year>2008</year>
          ),
          <fpage>7</fpage>
          -
          <lpage>9</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Richardson</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          <article-title>Beautiful soup</article-title>
          .
          <source>Crummy: The Site</source>
          (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Sharples</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Taylor</surname>
          </string-name>
          , J., and
          <string-name>
            <surname>Vavoula</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          <article-title>A theory of learning for the mobile age</article-title>
          .
          <source>In Medienbildung in neuen Kulturräumen</source>
          . Springer,
          <year>2010</year>
          , pp.
          <fpage>87</fpage>
          -
          <lpage>99</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Van Horn</surname>
            ,
            <given-names>J. D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fierro</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kamdar</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gordon</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stewart</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bhattrai</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Abe</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lei</surname>
            ,
            <given-names>X.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>O'Driscoll</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sinha</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , et al.
          <article-title>Democratizing data science through data science training</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Warren</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          <article-title>The story of cortana, microsoft's siri killer</article-title>
          .
          <source>Published on: Apr</source>
          <volume>2</volume>
          (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Woukeu</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wills</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Conole</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Carr</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kampa</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Hall</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          <article-title>Ontological hypermedia in education: A framework for building web-based educational portals</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Xia</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yang</surname>
            ,
            <given-names>L. T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Vinel</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <article-title>Internet of things</article-title>
          .
          <source>International Journal of Communication Systems</source>
          <volume>25</volume>
          ,
          <issue>9</issue>
          (
          <year>2012</year>
          ),
          <fpage>1101</fpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>