<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Model of Linking Organization Goals to Employee Competence Management for Formal and Non-Formal Education Providers</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Uldis Zandbergs</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Signe Brike</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Dace Namsone</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Anete Butkevica</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Model</string-name>
        </contrib>
      </contrib-group>
      <fpage>74</fpage>
      <lpage>83</lpage>
      <abstract>
        <p>This paper presents an approach to describe the impact on competence management in organizations under the assumption that all competence management should be goal-oriented and serve the organization's interests in reaching the goals. Ontology-based model is proposed to represent the interaction of goal setting and competence management. The related concepts of the model are described introducing development goals as a link between organization goals and competence management. The algorithm for integration of competence management into goal setting is proposed. The paper also explores the possibilities for formal and non-formal education providers to provide competence management linked to goal setting as a process of double-loop learning to help organizations become learning organizations.</p>
      </abstract>
      <kwd-group>
        <kwd>Competence</kwd>
        <kwd>Organizational learning</kwd>
        <kwd>Organization</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>1 Baltic Computer Academy, Ltd
2 University of Latvia</p>
      <p>
        uldis@bda.lv
Goal setting has been proposed to be used in organizations as a tool to align the
activities of the employees with the objectives of the organization. It is used both for
organizing the work and motivating the employees [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Goal setting helps to achieve
integration of individual and organizational interests which is important for successful
management of an organization [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Balance of individual needs and institutional
expectations is essential for promoting productive work environments [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>
        Competence management has been established as a way to manage human
resources that are available to the organizations. There are best practice examples
analyzed to improve competence management in organizations [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Linking organization
goals to the existing employee competences may increase benefits from both
processes. One of the main tasks or education providers is to provide competence
development or competence management in general. Linking competences to organization
goals can act as an additional incentive for the customers of education providers to
seek their services.
      </p>
      <p>The goal of this paper is to describe the process of linking goals to employee
competences in a way that can be accepted by both formal and non-formal education
providers by using ontology based approach so that it may benefit both types of providers
to recognize their respective niche and allow them to apply best practice from one
another. Ontology based approach can also be further exploited to address an issue
with processing the fairly large amounts of data that need to be processed when
managing the process of linking goals to employee competence management by building a
goal-oriented competence management system. Such a system should be based on a
competence management model that complies with the need to align competence
management with goal setting. The paper also offers a viewpoint on how such a
goaloriented competence management system can be integrated more successfully if the
members of an organization collaboratively and continuously re-examine the fitness
between goals and competences.
2
2.1</p>
    </sec>
    <sec id="sec-2">
      <title>Linking Goals to Competences</title>
      <sec id="sec-2-1">
        <title>In Formal Education Organizations</title>
        <p>
          In formal education organizations like schools employees (mainly teachers) are
directly involved in competence management. Teachers teach students and help them
achieve their goals. At the same time teachers achieve their own goals by using their
competences [
          <xref ref-type="bibr" rid="ref5 ref6 ref7 ref8 ref9">5- 9</xref>
          ].
        </p>
        <p>
          Formal education providers perform appraisal of their employees on regular basis.
Appraisal includes evaluation of individual and organizational goal met. Those goals
also include increase of students’ competences. Teacher appraisal is theoretically
considered more value-added when it is linked to achievement of their student goals
[
          <xref ref-type="bibr" rid="ref10 ref11 ref12 ref13 ref14 ref15 ref16 ref17 ref18">10- 18</xref>
          ]. However, there is limited evidence that formal education organizations in
Latvia are linking their employee competences to the employee goals [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ].
2.2
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>Linking Goals to Competences in Formal Education Organizations</title>
      </sec>
      <sec id="sec-2-3">
        <title>Through Double-loop Learning</title>
        <p>
          Linking employee competences to goals in formal education providers facilitates
continuing learning process or in this case competence management. Evidence shows
that although some competence management practice is present in formal education
providers a systematic integration of organizational goals and employee competences
is not fully established [
          <xref ref-type="bibr" rid="ref20 ref21">20, 21</xref>
          ].
        </p>
        <p>
          Competence management in formal education providers often takes form of
singleloop learning when inability of reaching a goal is addressed on case-by-case basis by
changing the goal or improving the competence on that particular occasion.
Doubleloop learning provides the organization with the opportunity to adjust the underlying
policies when goals are not reached due to lack of employee competence [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ].
        </p>
        <p>
          Stoll et al [
          <xref ref-type="bibr" rid="ref23">23</xref>
          ] describe single and double-loop learning as interaction of action,
outcome of an action and inquiry and re-examination of a procedure. In case of
interaction of employee competence and a goal, outcome of an action is a goal that is not
reached, action is change of a single competence related to a goal, and inquiry of the
procedure is the change of competence management principles to one better aligned
to goals.
        </p>
        <p>
          Also, since the education providers develop competences in their customers they
can act as agents of change for improvements of goal-oriented competence
management in their customers or organizations they represent. This should diminish the
negative effects of process changes in organizations [
          <xref ref-type="bibr" rid="ref24">24</xref>
          ].
2.3
        </p>
      </sec>
      <sec id="sec-2-4">
        <title>Linking Goals to Competences in Non-Formal Education Organizations</title>
        <p>
          Formal education providers are similar to non-formal education since they use the
competences of their employees to reach their own goals and help developing
customer competences to reach customers’ goals. The difference is usually in the level of
social maturity of the customer, sense of real goals and the time when competences
are expected to be applied [
          <xref ref-type="bibr" rid="ref25">25</xref>
          ].
        </p>
        <p>
          In short, non-formal education in the individual level is concerned to develop
competences for reaching a learner’s goal. These education areas are mainly defined and
analyzed in broader terms, for example, who counts as an adult educator, what is the
purpose and content of such education or how does non-formal education influence
individual personality, or the quality of workforce or the wider society and economy
(for a review see [
          <xref ref-type="bibr" rid="ref26 ref27">26, 27</xref>
          ]).
        </p>
        <p>Non-formal education providers often see themselves as organizations that have
similar goals and problems as their existing and potential customers.
3</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Ontology of Linking Goals to Competences</title>
      <p>Competence management is a complex process that involves different positions in an
organization and may require the management of large number of individual
competences. This justifies a development of a competence management system. However,
since the system is intended for use at education providers it should be able to
accommodate the needs of customers of education providers. That is why an ontology
should be used as a basis for requirements of the competence management system.</p>
      <p>Two sources were used to define the concepts of ontology; a comparison of
concepts used in the documents describing competence management and goal
management in education provider organizations, and a set of semi-structured interviews
performed asking the managers of the organizations to describe how they set goals
and manage competences. The concepts were analyzed and compared to each other
for similarities.</p>
      <p>
        Employee goals are similar in meaning to agent goals that Lopez-Lorca et al use
[
        <xref ref-type="bibr" rid="ref28">28</xref>
        ]. While goals in general are used in a similar way as Sterling and Taveter [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ]
who describe them as a functional requirement of the system. In this case a goal is a
requirement of a competence management system that acts as justification for
competence management, e.g. competence management is only done for those competences
that correspond to employee goals.
      </p>
      <p>We consider a problem of linking goals to competences as a problem of an
education provider being able to forecast competence assessment and competence
development needs before the customer fails to reach their goals because of lack of
employee competences that have not been recognized on time and/or have not been
developed enough to facilitate the reaching of set goals.</p>
      <p>The main concepts of to define ontology of linking employee goals to competences
are OrganisationGoal, EmployeeGoal, DevelopmentGoal,
GoalForecast, GoalAssessment, GoalAssessmentMethod,
EmployeeCompetence, CompetenceAssessment,
CompetenceAssessmentMethod, CompetenceDevelopmentPlan and
CompetenceDevelopmentMethod.</p>
      <p>Fig. 1 represents the visual depiction of main concepts with respective
relationships between themselves. Rectangles represent concepts of the ontology that may
influence each other. Arrows represent the relationships between concepts.
Arrowheads are used to indicate which concepts are considered inputs to the respective
concepts the arrowhead is pointing to. Names of the relationships are used with arrows to
describe the type of relationship. The following descriptions of relationships are used
in the figure:
 Is part of – indicates that a concept towards which the arrowhead points is
considered to consist of the concept that the arrow originates from;
 Is used by – indicates that the concept towards which the arrowhead points is using
the concept that the arrow originates from as an input, but the later concepts does
not change the individual instance of former concept itself;
 Produces – indicates that the concept towards which the arrowhead points is
created as a result of the concept that the arrow originates from;
 Evidences – indicates that the concept from which the arrow originates is used as a
proof that the concept has been managed successfully.
More detailed descriptions of the concepts follow further in the text using informal
definitions of the concepts.</p>
      <p>OrganisationGoal describes an objective the organization is set to achieve.
OrganisationGoal requires for the EmployeeGoal to be achieved.
OrganisationGoal has a set due date when the objective needs to be completed
and set interim evaluation dates when progress towards the objective is evaluated and
GoalForecast for the remaining part of objective is created.</p>
      <p>EmployeeGoal describes an objective that is part of OrganisationGoal and
is assigned to a specific employee. EmployeeGoal has a set due date and set
interim evaluation dates. EmployeeGoal is assigned based on
EmployeeCompetence. Progress towards EmployeeGoal is evaluated and
GoalForecast for the remaining part of objective is created.</p>
      <p>DevelopmentGoal describes a need and commitment to improve
EmployeeCompetence when the need is identified at
CompetenceAssessment by using a CompetenceAssessmentMethod.
DevelopmentGoal is set at the creation of EmployeeGoal or GoalForecast.</p>
      <p>GoalForecast for the purpose of this research is essentially a function of
EmployeeGoal. It represents a set of planned tasks that still need to be finished and
a set of newly identified tasks that are needed in order to reach EmployeeGoal.</p>
      <p>GoalAssessment is a business management process that evaluates the progress
of achieving OrganisationGoal or EmployeeGoal. GoalAssessment is
performed at due date and at interim evaluation dates when it produces
GoalForecast.</p>
      <p>GoalAssessmentMethod is any method that is available to the organization
and is deemed appropriate by the organization to receive GoalAssessment.</p>
      <p>EmployeeCompetence is used in this model as a measurement unit that
describes an employee. Each employee may have a set of several
EmployeeCompetence.</p>
      <p>CompetenceAssessment is a process that uses
CompetenceAssessmentMethod to evaluate EmployeeCompetence. The
result of CompetenceAssessment indicates if DevelopmentGoal should be
created. CompetenceAssessment is part of GoalAssessment when
evaluation of EmployeeGoal is made based on the EmployeeCompetence required to
reach EmployeeGoal.</p>
      <p>CompetenceAssessmentMethod is any method that is available to the
organization and is deemed appropriate by the organization to receive
CompetenceAssessment. CompetenceAssessmentMethod can be used
as part of GoalAssessmentMethod where organizations consider
EmployeeCompetence being a factor that influences the reaching of
EmployeeGoal.</p>
      <p>CompetenceDevelopmentPlan is created after DevelopmentGoal has
been identified.</p>
      <p>CompetenceDevelopmentMethod is used to develop
EmployeeCompetence. CompetenceDevelopmentMethod treats
CompetenceDevelopmentPlan
EmployeeCompetence to develop.</p>
      <p>as
an
objective
of
which
3.1</p>
      <sec id="sec-3-1">
        <title>Goal-Oriented Competence Development in Education Providers</title>
        <p>The link between goals and competences described in Fig. 1 apply to education
providers and to their customers. In addition there is a link between the competences of
employees of education providers and the goals of their customers. Fig. 2 describes
the impact of linking customer organization’s goals to competence management on
the education provider’s link of goals to competence management. For simplicity only
most significant concepts of previously proposed ontology are included in the figure.</p>
        <p>Fig. 2 indicates that education provider can use the same processes descriptions for
linking employee goals to employee competences as would its customer organization.
However, there is an interaction between the concepts of ontology between the two
organizations. The figure intentionally displays the same concepts twice to show that
goal-oriented competence management can be the same in two organizations but has
impact on other organizations.</p>
        <p>A trainer’s EmployeeCompetence is used to reach trainer’s EmployeeGoal
and customer’s EmployeeCompetence is used to reach customer’s
EmployeeGoal. But trainer’s EmployeeGoal is also to produce customer’s
EmployeeCompetence. In turn, customer’s DevelopmentGoal is used as an
indicator for the required trainer’s EmployeeCompetence. If a trainer is assigned
to develop customer’s EmployeeCompetence and the trainer does not have the
necessary trainer’s EmployeeCompetence the trainer needs trainer’s
DevelopmentGoal.
3.2</p>
      </sec>
      <sec id="sec-3-2">
        <title>Competence-Based Goal Setting Algorithm</title>
        <p>The model of linking goals to employee competence may act as a basis for the
creation of competence management system that includes management of concepts related
to employee competence assessment and development. When build on the basis of
ontology based model the system is more likely to serve the needs of various
organizations providing formal and non-formal education. To support the model several
algorithms for managing various concepts need to be developed.</p>
        <p>
          Based on empirical evidence gathered [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ] we propose one of the needed
algorithms. For example, an organization has an employee. The organizations assigns a
goal to the employee and identifies a competence needed to reach the goal. The
organization then conducts competence assessment for the employee and realizes that
the competence is not sufficient to reach the goal successfully. The organization sets a
development goal and prepares a competence development plan for the employee to
improve the competence.
        </p>
        <p>Using the previously defined concepts of ontology, first EmployeeGoal is
identified. Then EmployeeCompetence is identified from a list of competences that
are related to EmployeeGoal. EmployeeCompetence is assessed by using
CompetenceAssessmentMethod. If EmployeeCompetence is not present or
not sufficient enough to reach EmployeeGoal a DevelopmentGoal is set and
CompetenceDevelopmentPlan is created to improve
EmployeeCompetence.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Conclusion</title>
      <p>Linking goals to employee competences provides the managers of various
organizations with a tool that provides the means to forecast the ability of employees to reach
the goals and to act upon competence gaps that may be identified at the start of goal
setting period or during it. Education providers may benefit from goal-oriented
competence management in the customer organizations since it provides them with a
justification for setting their own goals and managing their own employee competences.</p>
      <p>Formal and non-formal education providers may differ in their perception of their
own procedures regarding goal setting and employee competence management but
evidence suggests that there are similarities to be exploited so that both sides can
learn from each other and improve their effectiveness of participation in competence
management of their customers.</p>
      <p>A model describing the linking of goals to employee competences could improve
the ability of education providers to offer a quality service for their customer but in
order for the model to be used it has to be described in terms that both formal and
non-formal education providers can relate to. Ontology based model so far as it
describes the concepts of the model in a language that is less prone to interpretation
seems to be a solid choice.</p>
      <p>The model proposed in this paper defines the main concepts that are included in the
model and are recognized by formal and non-formal education providers. It links the
results of competence development and competence assessment that are fully or
partially conducted by education providers with the employee and organization goals that
are set by various organizations. This allows for transfer of expertise gathered in
education providers about goal-oriented competence management irrespective of their
field and still leaves the room for customization of tools and methodology used by
specific education providers.</p>
      <p>The model also acts as a basis for education providers to become the agents of
guiding their customer organizations to overcome challenges that occur in changing
environment where goals assigned to employees are prone to have frequents changes
in the competences required for employees to reach the goals. Competence
management linked to goal setting implies that organizational members need to inquire and
re-evaluate into their procedures and capacities. Continuous collaboration is needed
and education providers can help to guide organization members to develop
competences for reaching organizational goals.</p>
      <p>Ontology based model of linking goals to employee competences also provides the
basis for developing a competence management system that can support the
competence management process conducted by education providers in the future.</p>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgment</title>
      <p>This research is supported by the ERDF research project ''The Application of
Principles for Information System Modelling to Structured and Goal-Oriented Competence
Management'', agreement No. 1.1.1.1/16/A/252.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Locke</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Latham</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>New directions in goal-setting theory</article-title>
          .
          <source>Current Directions in Psychological Science</source>
          ,
          <volume>15</volume>
          (
          <issue>5</issue>
          ),
          <fpage>265</fpage>
          -
          <lpage>268</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Castetter</surname>
            ,
            <given-names>W. B.</given-names>
          </string-name>
          (
          <year>1996</year>
          ).
          <article-title>The Personnel Function in Educational Administration (6th ed</article-title>
          .).
          <source>Englewood Cliffs</source>
          , NJ: Prentice-Hall
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>March</surname>
            ,
            <given-names>J. G.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Simon</surname>
            ,
            <given-names>H. A.</given-names>
          </string-name>
          (
          <year>1993</year>
          ).
          <source>Organizations (2nd ed.)</source>
          . Cambridge, MA: Blackwell Business.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Campion</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fin</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ruggeberg</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Carr</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Phillips</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Odman</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>2011</year>
          ).
          <article-title>Doing competencies well: Best practices</article-title>
          .
          <source>Personnel Psychology</source>
          ,
          <volume>64</volume>
          ,
          <fpage>225</fpage>
          -
          <lpage>262</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Helmke</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2009</year>
          ).
          <article-title>Unterrichtsqualität und Lehrerprofessionalität - Diagnose, Evaluation und Verbesserung des Unterrichts</article-title>
          . Seelze: Klett - Kallmeyer in.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Hattie</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>Visible Learning for Teachers: Maximizing Impact on Learning</article-title>
          .
          <source>Routledge.</source>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Baartman</surname>
            ,
            <given-names>L. K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bastiaens</surname>
            ,
            <given-names>T. J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kirschner</surname>
            ,
            <given-names>P. A.</given-names>
          </string-name>
          , and van der Vleuten,
          <string-name>
            <surname>C. P.</surname>
          </string-name>
          (
          <year>2007</year>
          ).
          <article-title>Evaluating assessment quality in competence-based education: A qualitative comparison of two frameworks</article-title>
          .
          <source>Educational Research Review</source>
          ,
          <volume>2</volume>
          (
          <issue>2</issue>
          ),
          <fpage>114</fpage>
          -
          <lpage>129</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Skedsmo</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Huber</surname>
            ,
            <given-names>S. G.</given-names>
          </string-name>
          (
          <year>2018</year>
          ).
          <article-title>Teacher evaluation: the need for valid measures and increased teacher involvement</article-title>
          .
          <source>Educational Assessment, Evaluation and Accountability</source>
          ,
          <volume>30</volume>
          (
          <issue>1</issue>
          ),
          <fpage>1</fpage>
          -
          <lpage>5</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9. OECD. (
          <year>2013</year>
          ).
          <article-title>Teachers for the 21st Century. Using Evaluation to Improve Teaching</article-title>
          . http://dx.doi.org/10.1787/9789264193864-en
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Stronge</surname>
            ,
            <given-names>J. H.</given-names>
          </string-name>
          <article-title>and</article-title>
          <string-name>
            <surname>Tucker</surname>
            ,
            <given-names>P. D.</given-names>
          </string-name>
          (
          <year>2003</year>
          ).
          <article-title>Handbook on Teacher Evaluation: Assessing and Improving Performance</article-title>
          . Larchmont, NY: Eye on Education.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Stronge</surname>
            ,
            <given-names>J. H.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>Teacher evaluation and school improvement: Improving the educational landscape. Evaluating teaching: A guide to current thinking and best practice</article-title>
          ,
          <volume>2</volume>
          ,
          <fpage>1</fpage>
          -
          <lpage>23</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Huber</surname>
            ,
            <given-names>S. G.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Skedsmo</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          (
          <year>2016</year>
          ).
          <article-title>Teacher evaluation-accountability and improving teaching practices</article-title>
          .
          <source>Educational Assessment, Evaluation and Accountability</source>
          ,
          <volume>28</volume>
          (
          <issue>2</issue>
          ),
          <fpage>105</fpage>
          -
          <lpage>109</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Heck</surname>
            ,
            <given-names>R. H.</given-names>
          </string-name>
          (
          <year>2009</year>
          ).
          <article-title>Teacher effectiveness and student achievement: Investigating a multilevel cross-classified model</article-title>
          .
          <source>Journal of Educational Administration</source>
          ,
          <volume>47</volume>
          (
          <issue>2</issue>
          ),
          <fpage>227</fpage>
          -
          <lpage>249</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Goddard</surname>
          </string-name>
          , R. D.,
          <string-name>
            <surname>Hoy</surname>
            ,
            <given-names>W. K.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Hoy</surname>
            ,
            <given-names>A. W.</given-names>
          </string-name>
          (
          <year>2000</year>
          ).
          <article-title>Collective teacher efficacy: Its meaning, measure, and impact on student achievement</article-title>
          .
          <source>American Educational Research Journal</source>
          ,
          <volume>37</volume>
          (
          <issue>2</issue>
          ),
          <fpage>479</fpage>
          -
          <lpage>507</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Hallinger</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Heck</surname>
            ,
            <given-names>R. H.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Murphy</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2014</year>
          ).
          <article-title>Teacher evaluation and school improvement: An analysis of the evidence</article-title>
          .
          <source>Educational Assessment, Evaluation and Accountability</source>
          ,
          <volume>26</volume>
          (
          <issue>1</issue>
          ),
          <fpage>5</fpage>
          -
          <lpage>28</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Taylor</surname>
          </string-name>
          , E. S. and
          <string-name>
            <surname>Tyler</surname>
            ,
            <given-names>J. H.</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>The effect of evaluation on teacher performance</article-title>
          .
          <source>American Economic Review</source>
          ,
          <volume>102</volume>
          (
          <issue>7</issue>
          ),
          <fpage>3628</fpage>
          -
          <lpage>51</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Fullan</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>1995</year>
          ).
          <article-title>The school as a learning organization: Distant dreams</article-title>
          .
          <source>Theory into practice</source>
          ,
          <volume>34</volume>
          (
          <issue>4</issue>
          ),
          <fpage>230</fpage>
          -
          <lpage>235</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Stoll</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bolam</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McMahon</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wallace</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Thomas</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>Professional learning communities: A review of the literature</article-title>
          .
          <source>Journal of educational change</source>
          ,
          <volume>7</volume>
          (
          <issue>4</issue>
          ),
          <fpage>221</fpage>
          -
          <lpage>258</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Butkevica</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zandbergs</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Namsone</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Brike</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2018</year>
          ).
          <article-title>Exploring the input of competence assessment to goal-setting in various types of organizations</article-title>
          .
          <source>SOCIETY. INTEGRATION. EDUCATION. Proceedings of the International Scientific Conference</source>
          ,
          <year>2018</year>
          , Rezekne, Latvia.
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Namsone</surname>
            <given-names>D.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Cakane</surname>
            <given-names>L.</given-names>
          </string-name>
          (
          <year>2018</year>
          ).
          <article-title>A Collaborative classroom-based teacher professional learning model</article-title>
          . In: Yeo J.,
          <string-name>
            <surname>Teo</surname>
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tang</surname>
            <given-names>KS</given-names>
          </string-name>
          . (eds) Science
          <source>Education Research and Practice in Asia-Pacific and Beyond</source>
          (pp.
          <fpage>177</fpage>
          -
          <lpage>195</lpage>
          ). Springer, Singapore. DOI: https://doi.org/10.1007/
          <fpage>978</fpage>
          -981-10-5149-4_
          <fpage>13</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Namsone</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          , Cakane, France, I., and
          <string-name>
            <surname>Butkevica</surname>
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2016</year>
          ).
          <article-title>Lesson-based professional development as a way to help primary teachers teach 21st century skills</article-title>
          .
          <source>Proceedings of the ICERI2016</source>
          , Seville, Spain. p.
          <fpage>14</fpage>
          .-
          <lpage>16</lpage>
          .
          <fpage>11</fpage>
          .
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Argyris</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Schön</surname>
            ,
            <given-names>D. A.</given-names>
          </string-name>
          (
          <year>1978</year>
          ).
          <article-title>Organizational Learning: A Theory of Action Perspective</article-title>
          . Addison-Wesley Publishing.
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Stoll</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bolam</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Collarbone</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>2002</year>
          ).
          <article-title>Leading for change: Building capacity for learning</article-title>
          .
          <source>In Second international handbook of educational leadership and administration</source>
          (pp.
          <fpage>41</fpage>
          -
          <lpage>73</lpage>
          ). Springer, Dordrecht.
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Schein</surname>
            ,
            <given-names>E. H.</given-names>
          </string-name>
          (
          <year>2010</year>
          ).
          <article-title>Organizational Culture and Leadership (4th Ed)</article-title>
          . John Wiley &amp; Sons.
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Hubackova</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Semradova</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          (
          <volume>2104</volume>
          ).
          <article-title>Research study on motivation in adult education</article-title>
          ,
          <source>Procedia - Social and Behavioral Sciences</source>
          ,
          <volume>159</volume>
          ,
          <fpage>396</fpage>
          -
          <lpage>400</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Merriam</surname>
            ,
            <given-names>S. B.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Brockett</surname>
            ,
            <given-names>R. G.</given-names>
          </string-name>
          (
          <year>2011</year>
          ).
          <article-title>The Profession and Practice of Adult Education: An Introduction</article-title>
          . John Wiley &amp; Sons.
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>Bowl</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2017</year>
          ).
          <article-title>Adult Education in Neoliberal Times</article-title>
          . Springer International Publishing.
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28.
          <string-name>
            <surname>Lopez-Lorca</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Beydoun</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Martinez-Bejar</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Tootell</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          (
          <year>2011</year>
          ).
          <article-title>Supporting developers in complex systems modelling</article-title>
          .
          <source>Proceedings of the Australasian Conference on Information Systems ACIS 2011 - "Identifying the Information Systems Discipline" Australia: AISeL.</source>
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29.
          <string-name>
            <surname>Sterling</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Taveter</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          (
          <year>2009</year>
          ).
          <article-title>The Art of Agent-Oriented Modeling</article-title>
          . MIT Press.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>