<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Development of Ontology Based Competence Management Process Model for Non-Formal Education</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Uldis Zandbergs</string-name>
          <email>Uldis.Zandbergs@bda.lv</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jānis Grundspeņķis</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Baltic Computer Academy</institution>
          ,
          <addr-line>Riga</addr-line>
          ,
          <country country="LV">Latvia</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Riga Technical University</institution>
          ,
          <addr-line>Riga</addr-line>
          ,
          <country country="LV">Latvia</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The demand for constantly higher competences of employees nowadays is growing permanently. One of the main challenges of implementation of competence management processes is that, as a rule, they are based on the experts' implicit knowledge that practically limits possibilities to transform the already existing knowledge about competences from one organization to another. The paper describes the ontology based competence management process model that is useful for non-formal education service providers in their efforts to use different competence management frameworks together instead of forcing organizations to change their routine competence management processes. The proposed model is based on the previously developed ontology based competence management model which defines more accurately the concept of competence. The competence management process is divided into three main steps competence identification, competence assessment and competence development. The description of the first step is extended by including the concepts of goal and task to be achieved and performed correspondingly, as well as by adding the concept of creation of competence profile. The conceptual architecture of competence management system based on the prototype with a limited functionality for supporting competence management processes is presented.</p>
      </abstract>
      <kwd-group>
        <kwd>Competence Management Process</kwd>
        <kwd>Competence Management Model</kwd>
        <kwd>Ontology</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>A competence-based approach to education has gained popularity in recent years in
Latvia. As a consequence, one can observe a growing need for competence
management services that, in principle, can be provided both by formal and non-formal
education service providers to their customers.</p>
      <p>
        Non-formal education is an alternative to formal education that provides
institutionalized, intentional and planned form of education [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Non-formal education
enables a faster response to changes providing employees with competences needed for
work [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Non-formal education benefits from competence-based education [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]
because that enables relevant know-how for work situations. Non-formal education is
acknowledged by the organisations [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. It is forecasted that currently there is a need
for development of new competences or “human skills” [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] but the involvement in
non-formal education is lagging behind the expected numbers [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] because training
solutions do not correspond to organisation requirements.
      </p>
      <p>
        Three reasons make providing competence management services difficult. First,
organisations in contact with a non-formal education service provider (NFESP) have
different concepts of competence. Second, there exist organisation specific
competence frameworks that are hard to integrate between themselves. Third, NFESPs may
need to simultaneously use and reuse parts of existing competence frameworks and
integrate several frameworks into one competence management process (CMP). In
order to address the issue a novel ontology-based approach for simultaneous use of
different competence frameworks needs to be developed to facilitate the interaction
between NFESP and customer organisations. This will also help the development of
appropriate competence management support tools [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>The goal of this paper is to present a competence management process model for a
non-formal education service provider that: describes competence-based training that
is an accepted form of non-formal training, is based on formal ontological model of
competence management process in order to provide relevant and uniform service to
participants of training, can be used as a basis for development of IT tools that
support the CMP.</p>
      <p>The rest of the paper gives an overview of related work (section 2), presents the
results of modelling of CMP (section 3), and proposes the conceptual architecture of
competence management system for the support of a CMP at an NFESP and is based
on the prototype with a limited functionality (section 4). At the end of the paper
conclusions and the outline of the future work are presented.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Related Work</title>
      <p>
        The CMP is the process that guides the organisations in managing the competences of
their employees. When an NFESP offers a service of assessment and development of
the competences of its customer organisations, it gets involved in a CMP. It is
beneficial for an NFESP to adapt a competence-based approach to training [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. When
adapting a competence-based approach to training NFESPs get involved in CMP and
would benefit from clearly defined concept of CMP.
      </p>
      <p>
        A precise definition of CMP is difficult to devise. The concept of competence is
fuzzy [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] and uses different definitions including concepts of the ability to complete
the assigned task [
        <xref ref-type="bibr" rid="ref8 ref9">8, 9</xref>
        ] and elements like knowledge, skills and attitude and
sometimes other elements, too [
        <xref ref-type="bibr" rid="ref10 ref11 ref12 ref13">10-13</xref>
        ]. Concept of competence may be specific to the
organisation [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] or the industry [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. To avoid the need to adjust to customer specific
understanding of competence, NFESPs need to have a new competence management
model (CMM) that briefly is described in the next section (for details see [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]).
      </p>
      <p>
        Ontology helps to gain common understanding of a domain specific knowledge
that needs to be analysed, shared and reused, and needs to be represented in an
explicit form [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. The used ontology should facilitate common understanding between
experts [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ], the parties involved in non-formal education, and between the people and
software agents [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ].
      </p>
      <p>
        The competence management systems (CMSs) must be based on a competence
model [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. Ontology based approaches to competence modelling have been
presented in [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]. Competence management support tools can be organisation specific [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]
but basing the tools on common understanding of competence can facilitate common
understanding of the CMP as a whole [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ].
3
      </p>
      <p>
        Competence Management Process Description
The ontology-based competence management model (CMM) defining relationships
between various concepts of competence management is presented in [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. The model
uses Competence as the main concept and describes the parts and properties of
Competence, how Competence is related to Organisation and Employee and their goals.
The CMP also describes the link between CompetenceGap, AssessmentMethod and
DevelopmentMethod. This model is used to describe the CMP which would allow the
identification of all steps that would be performed in this process by an NFESP when
managing competences of their customer organisations.
      </p>
      <p>
        Based on the CMM the CMP can be divided in 3 main subprocesses: competence
identification (divided in definition of the competence and creation of competence
profile), competence assessment and competence development. The same
subprocesses have also been used for CMP in formal education [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ].
      </p>
      <p>
        Other process steps are identified in the scientific literature, for example, use of
competence [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ] and goal and task management in relation to CMP [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ]. The use of
competence is outside of scope of CMP for NFESPs. The goal and task management
are addressed in the process description. The competence development goal is
interpreted as one of the relevant goals to manage in CMP [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ].
      </p>
      <p>Further on, the individual steps of CMP are described using UML activity
diagrams. The following symbols have been used in the figure: a rounded rectangle for
separate process steps, an arrow for transition between steps, a diamond for decision
choice, black bars for start and end of parallel process steps, a full circle for start of
the process, a double full circle for end of the process.</p>
      <p>Fig. 1 shows that a competence identification subprocess starts with DefineGoal
and DefineTask steps that provide a reason for competence identification.
IdentifyRequiredCompetence step consists of several simultaneously performed steps: definition
of the parts of Competence (Knowledge, Skill and Attitude) and definition of
properties of competence (CompetenceTitle, CompetenceDescription and
CompetenceLevel). At the end of this part of CMP a competence is added to a repository that contains
all competences used to build CompetenceProfiles.</p>
      <p>Creation of competence profiles is a part of competence identification which
requires feedback information from competence assessment and competence
development steps. The main purpose of the CompetenceProfiles is to compare required and
acquired CompetenceLevel and to identify a CompetenceGap.</p>
      <p>Start of the
process</p>
      <p>Define Goal</p>
      <p>Define Task</p>
      <p>Identify Required</p>
      <p>Competence
Create Competence</p>
      <p>Profile</p>
      <p>Select Assessment</p>
      <p>Method
Assign Required
Competence</p>
      <p>Assign Acquired
Competence</p>
      <p>Select Assessment
Tool/ Instrument</p>
      <p>Select Assessment</p>
      <p>Assessor
Apply Competence</p>
      <p>Level</p>
      <p>Level</p>
      <p>NotKnown</p>
      <p>LevelKnown
Apply Competence</p>
      <p>Level
Identify Competence</p>
      <p>Gap</p>
      <p>Gap&gt;0</p>
      <p>Gap&lt;=0
Report Competence</p>
      <p>Gap
Make Competence
Management Decision</p>
      <p>End of the
process</p>
      <p>Conduct Assessment
Gather Assessment</p>
      <p>(Results)
Interpret Assessment Results
as Competence Level</p>
      <p>Define Parts of
Competence</p>
      <p>Define Properties of</p>
      <p>Competence
Add Competence to</p>
      <p>Repository</p>
      <p>Identify
Development Need
Create Development</p>
      <p>Plan
Select Development</p>
      <p>Method
Select Development
Tool/ Instrument</p>
      <p>Select Developer
Conduct Competence</p>
      <p>Development
Assess Development</p>
      <p>Results</p>
      <p>Interpret Development</p>
      <p>Results as Competence Level</p>
      <p>The competence assessment subprocess provides the information of acquired
CompetenceLevel of an employee within an organisation. This combined with the required
CompetenceLevel (described as the property of Competence during a competence
identification step) provides the basis for a CompetenceGap.</p>
      <p>
        The competence assessment step starts with a recognized need to assess a
CompetenceLevel for specific competence that is included in a CompetenceProfile by a
CompetenceAssessmentMethod. There can be several
CompetenceAssessmentInstruments and Assessors (in this case, persons who participate in a competence
assessment) involved in these steps. By using ontology for the definition of the
concept of Competence it is possible to create competence assessment instruments that
are automated and thus decrease the required workload for an assessment [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ]. The
results of competence assessment are interpreted as acquired competence level that
can be used as a basis for decision making, for example, what kind of competence
development is needed by the employee.
      </p>
      <p>The competence development subprocess starts with identification of
DevelopmentNeed that is based on a CompetenceGap. A CompetenceGap is a signal that the
acquired CompetenceLevel is lower than the required. Creation of DevelopmentPlan
involves the identification of missing competences. If a competence
DevelopmentNeed represents a theoretical need to develop a competence, a DevelopmentPlan
represents a proposed intent to decrease the CompetenceGap and improve the
acquired CompetenceLevel.</p>
      <p>
        Selection of competence development methods is based on the required
competences and their levels. Scientific literature suggests that specific competences require
different development methods and the same is true for competence assessment
methods [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ]. The selection of the most appropriate method is out of the scope of this
paper. The process description enables the selection of a DevelopmentMethod that
consists of DevelopmentInstrument and a Developer (in this case a person who is
involved in developing a competence). It is worth to stress that there is a potential to use
computer-based competence development instruments [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ] but it is not the only
option available.
4
      </p>
    </sec>
    <sec id="sec-3">
      <title>Conceptual Architecture of CMS</title>
      <p>The CMP described above can be conducted at an NFESP without the use of
additional support tools other than already mentioned competence assessment and
competence development instruments. However, there is a benefit from introducing a CMS
that can support a CMP. Such CMS may improve the ability to process data gathered
during a CMP and decrease time spent on individual steps of this process.</p>
      <sec id="sec-3-1">
        <title>Competence Management System</title>
      </sec>
      <sec id="sec-3-2">
        <title>Knowledge</title>
      </sec>
      <sec id="sec-3-3">
        <title>Management Tools</title>
      </sec>
      <sec id="sec-3-4">
        <title>Competence</title>
      </sec>
      <sec id="sec-3-5">
        <title>Knowledge</title>
      </sec>
      <sec id="sec-3-6">
        <title>Base</title>
      </sec>
      <sec id="sec-3-7">
        <title>Assessment</title>
      </sec>
      <sec id="sec-3-8">
        <title>Instruments</title>
      </sec>
      <sec id="sec-3-9">
        <title>Competence</title>
      </sec>
      <sec id="sec-3-10">
        <title>Levels</title>
      </sec>
      <sec id="sec-3-11">
        <title>Competences</title>
      </sec>
      <sec id="sec-3-12">
        <title>Competence</title>
      </sec>
      <sec id="sec-3-13">
        <title>Profiles</title>
      </sec>
      <sec id="sec-3-14">
        <title>Competence</title>
      </sec>
      <sec id="sec-3-15">
        <title>Assessment</title>
      </sec>
      <sec id="sec-3-16">
        <title>Results</title>
      </sec>
      <sec id="sec-3-17">
        <title>Organisation</title>
      </sec>
      <sec id="sec-3-18">
        <title>Management</title>
      </sec>
      <sec id="sec-3-19">
        <title>Employee</title>
      </sec>
      <sec id="sec-3-20">
        <title>Management</title>
      </sec>
      <sec id="sec-3-21">
        <title>Personnel</title>
      </sec>
      <sec id="sec-3-22">
        <title>Management Tools</title>
      </sec>
      <sec id="sec-3-23">
        <title>Performance</title>
      </sec>
      <sec id="sec-3-24">
        <title>Management</title>
      </sec>
      <sec id="sec-3-25">
        <title>Tools</title>
      </sec>
      <sec id="sec-3-26">
        <title>Competence</title>
      </sec>
      <sec id="sec-3-27">
        <title>Develpment</title>
      </sec>
      <sec id="sec-3-28">
        <title>Results</title>
      </sec>
      <sec id="sec-3-29">
        <title>Competence</title>
      </sec>
      <sec id="sec-3-30">
        <title>Development</title>
      </sec>
      <sec id="sec-3-31">
        <title>Instruments</title>
      </sec>
      <sec id="sec-3-32">
        <title>Competence Assessment Tools</title>
      </sec>
      <sec id="sec-3-33">
        <title>Competence Development Tools</title>
        <p>
          In Fig. 2 the conceptual architecture of CMS is proposed. It consists of several
functional blocks some of which are directly related to CMP and other tools used in the
organization. A CMS could be linked to personnel management tools and knowledge
management processes and tools [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ]. In this paper the competence assessment tools
and competence development tools are considered to be parts of CMP but there are
already existing instruments that can be selected for the use. Fig. 2 only includes
competence assessment results and competence development results as the proposed
functional blocks for the CMS leaving assessment instruments and competence
development instruments outside the CMS with the possibility to create the interface
between them.
        </p>
        <p>The main concepts of CMP that need to be managed by the CMS are Competence,
CompetenceLevel and CompetenceProfile. Previously in the paper the environment of
an NFESP has been described stating that there is a need to manage competences that
are used by different customer organizations preferably without forcing these
organizations to change their understanding about competences. This is the reason why there
is a challenge to manage competence data in CMSs that are company specific. That is
why an organization management and an employee management are included as
functional blocks in the conceptual architecture of CMS.</p>
        <p>For such a CMS to work for an NFESP that can be involved in managing
competences that are stored in competence profiles relevant for employees and the customer
organisations, the links between data tables should be defined. CompetenceTitle,
CompetenceDescription and CompetenceLevel should be linked with Organisation
and Employee, and organisation specific information should be stored in CMS.</p>
        <p>Based on the CMM, the conceptual architecture of the CMS and the links between
data tables, the CMS prototype was developed for the support of competence
management process at an NFESP (due to limited volume of the paper the prototype is not
described).
5</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Conclusions and Future Work</title>
      <p>The paper proposes a competence management process description and system’s
conceptual architecture that is based on the ontology-based CMM and can be used by
NFESPs to manage competences of their customer organizations. A common CMP is
beneficial for an NFESP as it decreases the need to necessarily adjust to each
individual customer organization.</p>
      <p>Ontology based approach for competence modelling is used in the CMP
description. It establishes a common understanding of the concepts of competence and the
CMP, allows an NFESP to manage competences of different customer organisations
and develop IT support tools for CMP. The conceptual architecture of the CMS
proposed in this paper addresses the need for IT support tools for competence
management. Such system may be linked to the existing tools that are already used by the
organizations for competence management. The CMS prototype has been developed
based on the CMM that can be used for the support of CMP.</p>
      <p>The application of the CMS prototype with extended functionality to several CMPs
at the NFESP to support the management of customer competences, as well as the
investigation of options how to use the existing resource and knowledge management
systems and to establish interfaces between them and the CMS prototype are foreseen
as the future work.</p>
      <p>Acknowledgment. The present research has been supported by the ERDF research
project “The Application of Principles for Information System Modelling to
Structured and Goal-Oriented Competence Management”, agreement No.
1.1.1.1/16/A/252.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1. UNESCO Institute for Statistics:
          <article-title>International Standard Classification of Education, ISCED</article-title>
          <year>2011</year>
          (
          <year>2012</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>European</surname>
          </string-name>
          <article-title>Centre for the Development of Vocational Training: Terminology of European Education</article-title>
          and
          <string-name>
            <given-names>Training</given-names>
            <surname>Policy</surname>
          </string-name>
          .
          <source>A Selection of 130 Key Terms, 2nd Edition</source>
          .
          <article-title>Publications Office of the European Union</article-title>
          ,
          <string-name>
            <surname>Luxembourg</surname>
          </string-name>
          (
          <year>2014</year>
          ). https://doi.org/10.2801/15877
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Markowitsch</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hefler</surname>
          </string-name>
          , G.:
          <article-title>Future Developments in Vocational Education and Training in Europe: Report on Reskilling and Upskilling Through Formal and Vocational Education Training</article-title>
          . European Commission,
          <string-name>
            <surname>Seville</surname>
          </string-name>
          (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <source>World Economic Forum: The Future of the Jobs Report</source>
          <year>2018</year>
          (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>European</given-names>
            <surname>Commission</surname>
          </string-name>
          :
          <article-title>Education and Training Monitor 2019 Latvia. Publications Office of the European Union</article-title>
          ,
          <string-name>
            <surname>Luxembourg</surname>
          </string-name>
          (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Zandbergs</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grundspeņķis</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Judrups</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Briķe</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Development of ontology based competence management model for non-formal education services</article-title>
          .
          <source>Applied Computer Systems</source>
          <volume>24</volume>
          (
          <issue>2</issue>
          ),
          <fpage>111</fpage>
          -
          <lpage>118</lpage>
          (
          <year>2019</year>
          ). https://doi.org/10.2478/acss-2019
          <source>-0014</source>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>van der Klink</surname>
            ,
            <given-names>M.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Boon</surname>
          </string-name>
          , J.:
          <article-title>Competencies: the triumph of a fuzzy concept</article-title>
          .
          <source>International Journal of Human Resources Development and Management</source>
          <volume>3</volume>
          (
          <issue>2</issue>
          ),
          <fpage>125</fpage>
          -
          <lpage>137</lpage>
          (
          <year>2003</year>
          ). https://doi.org/10.1504/IJHRDM.
          <year>2003</year>
          .002415
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>McLelland</surname>
            ,
            <given-names>D.C.</given-names>
          </string-name>
          :
          <article-title>Testing for competence rather than for “intelligence”</article-title>
          .
          <source>American Psychologist</source>
          <volume>28</volume>
          (
          <issue>1</issue>
          ),
          <fpage>1</fpage>
          -
          <lpage>14</lpage>
          (
          <year>1973</year>
          ). https://doi.org/10.1037/h0034092
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Boyatzis</surname>
            ,
            <given-names>R.E.</given-names>
          </string-name>
          :
          <article-title>The Competent Manager: A Model for Effective Performance</article-title>
          . Wiley, New York (
          <year>1982</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Succar</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sher</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Williams</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>An integrated approach to BIM competency assessment, acquisition and application</article-title>
          .
          <source>Automation in Construction 35</source>
          ,
          <fpage>174</fpage>
          -
          <lpage>189</lpage>
          (
          <year>2013</year>
          ). https://doi.org/10.1016/j.autcon.
          <year>2013</year>
          .
          <volume>05</volume>
          .016
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Draganidis</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chamopoulou</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mentzas</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          :
          <article-title>An ontology based tool for competency management and learning paths</article-title>
          .
          <source>In: 6th International Conference on Knowledge Management</source>
          (
          <year>2006</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Campion</surname>
            ,
            <given-names>M.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fink</surname>
            ,
            <given-names>A.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ruggeberg</surname>
            ,
            <given-names>B.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Carr</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Phillips</surname>
            ,
            <given-names>G.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Odman</surname>
          </string-name>
          , R.B.:
          <article-title>Doing competencies well: best practices in competency modeling</article-title>
          .
          <source>Personnel Psychology</source>
          <volume>64</volume>
          (
          <issue>1</issue>
          ),
          <fpage>225</fpage>
          -
          <lpage>262</lpage>
          (
          <year>2011</year>
          ). https://doi.org/10.1111/j.1744-
          <fpage>6570</fpage>
          .
          <year>2010</year>
          .
          <volume>01207</volume>
          .x
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Marrelli</surname>
            ,
            <given-names>A.F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tondora</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hoge</surname>
            ,
            <given-names>M.A.</given-names>
          </string-name>
          :
          <article-title>Strategies for developing competency models</article-title>
          .
          <source>Administration and Policy in Mental Health</source>
          <volume>32</volume>
          (
          <issue>5-6</issue>
          ),
          <fpage>533</fpage>
          -
          <lpage>561</lpage>
          (
          <year>2005</year>
          ). https://doi.org/10.1007/s10488-005-3264-0
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Rozewski</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Malachowski</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Approach to competence modelling for enterprise knowledge management</article-title>
          .
          <source>In: Proceedings of the 14th IFAC Symposium on Information Control Problems in Manufacturing</source>
          , pp.
          <fpage>1159</fpage>
          -
          <lpage>1164</lpage>
          (
          <year>2012</year>
          ). https://doi.org/10.3182/20120523-3-RO-
          <year>2023</year>
          .
          <fpage>00331</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Gruber</surname>
            ,
            <given-names>T.R.</given-names>
          </string-name>
          :
          <article-title>Toward principles for the design of ontologies used for knowledge sharing</article-title>
          .
          <source>International Journal of Human-Computer Studies</source>
          <volume>43</volume>
          (
          <issue>5-6</issue>
          ),
          <fpage>907</fpage>
          -
          <lpage>928</lpage>
          (
          <year>1995</year>
          ). https://doi.org/10.1006/ijhc.
          <year>1995</year>
          .1081
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Noy</surname>
            ,
            <given-names>N.F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McGuinness</surname>
            ,
            <given-names>D.L.</given-names>
          </string-name>
          :
          <article-title>Ontology development 101: a guide to creating your first ontology</article-title>
          .
          <source>Stanford Knowledge Systems Laboratory Technical Report KSL-01-05 and Stanford Medical Informatics Technical Report SMI-2001-0880</source>
          (
          <year>2001</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Musen</surname>
            ,
            <given-names>M.A.</given-names>
          </string-name>
          :
          <article-title>Dimensions of knowledge sharing and reuse</article-title>
          .
          <source>Computers and Biomedical Research</source>
          <volume>25</volume>
          (
          <issue>5</issue>
          ),
          <fpage>435</fpage>
          -
          <lpage>467</lpage>
          (
          <year>1992</year>
          ). https://doi.org/10.1016/
          <fpage>0010</fpage>
          -
          <lpage>4809</lpage>
          (
          <issue>92</issue>
          )
          <fpage>90003</fpage>
          -S
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Schmidt</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kunzmann</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Towards a human resource development ontology for combining competence management and technology-enhanced workplace learning</article-title>
          .
          <source>In: OTM Confederated International Workshops. LNCS</source>
          , vol.
          <volume>4278</volume>
          , pp.
          <fpage>1078</fpage>
          -
          <lpage>1087</lpage>
          . Springer, Heidelberg (
          <year>2006</year>
          ). https://doi.org/10.1007/11915072_
          <fpage>10</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Decius</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schaper</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          :
          <article-title>The competence management tool (CMT) - a new instrument to manage competences in small and medium-sized manufacturing enterprises</article-title>
          .
          <source>Procedia Manufacturing</source>
          <volume>9</volume>
          ,
          <fpage>376</fpage>
          -
          <lpage>383</lpage>
          (
          <year>2017</year>
          ). https://doi.org/10.1016/j.promfg.
          <year>2017</year>
          .
          <volume>04</volume>
          .041
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Bouras</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zainal</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Education ontology modeling for competency gap analysis</article-title>
          .
          <source>In: 3rd IEEE International Conference on Computational Science and Computational Intelligence</source>
          (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Butkēviča</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dudareva</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Namsone</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zandbergs</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Čakāne</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bērtule</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Designing and piloting online tests as part of a teacher competence assessment</article-title>
          .
          <source>In: Proceedings of the International Scientific Conference “Society. Integration. Education”</source>
          , vol. V, pp.
          <fpage>333</fpage>
          -
          <lpage>343</lpage>
          (
          <year>2019</year>
          ). http://doi.org/10.17770/sie2019vol5.3846
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Rozewski</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Malachowski</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jankowski</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Prys</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Danczura</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Preliminaries for dynamic competence management system building</article-title>
          .
          <source>In: 2013 Federated Conference on Computer Science and Information Systems</source>
          , pp.
          <fpage>1291</fpage>
          -
          <lpage>1297</lpage>
          (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Coi</surname>
            ,
            <given-names>J.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Herder</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Koesling</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lofi</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Olmedilla</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Papapetrou</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Siberski</surname>
            ,
            <given-names>W.:</given-names>
          </string-name>
          <article-title>A model for competence gap analysis</article-title>
          .
          <source>In: 3rd International Conference on Web Information Systems and Technologies</source>
          , pp.
          <fpage>304</fpage>
          -
          <lpage>312</lpage>
          (
          <year>2007</year>
          ). https://doi.org/10.5220/0001272603040312
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Zandbergs</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Briķe</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Namsone</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Butkēviča</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Model of linking organisation goals to employee competence management for formal and non-formal education providers</article-title>
          .
          <source>In: Joint Proceedings of the 13th International Baltic Conference on Databases and Information Systems</source>
          , pp.
          <fpage>74</fpage>
          -
          <lpage>83</lpage>
          (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Zandbergs</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Judrups</surname>
          </string-name>
          , J.:
          <article-title>Evaluating competences with computerized tests</article-title>
          .
          <source>Engineering for Rural Development</source>
          <volume>14</volume>
          ,
          <fpage>625</fpage>
          -
          <lpage>630</lpage>
          (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Kaiser</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Busse</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hoth</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>König</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Blömeke</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>About the complexities of videobased assessments: theoretical and methodological approaches to overcoming shortcomings of research on teachers' competence</article-title>
          .
          <source>International Journal of Science and Mathematics Education</source>
          <volume>13</volume>
          (
          <issue>2</issue>
          ),
          <fpage>369</fpage>
          -
          <lpage>387</lpage>
          (
          <year>2015</year>
          ). https://doi.org/10.1007/s10763-015-9616-7
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>Judrups</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zandbergs</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Arhipova</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vaisnore</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Architecture of a competence-based human resource development solution</article-title>
          .
          <source>Procedia Computer Science</source>
          <volume>77</volume>
          ,
          <fpage>184</fpage>
          -
          <lpage>190</lpage>
          (
          <year>2015</year>
          ). https://doi.org/10.1016/j.procs.
          <year>2015</year>
          .
          <volume>12</volume>
          .382
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>