<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Towards a Data Driven Competency Management Platform for Industry 4.0</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Kadri-Liis Kusmin</string-name>
          <email>kusmin@tlu.ee</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Tobias Ley</string-name>
          <email>tley@tlu.ee</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Peeter Normak</string-name>
          <email>pnormak@tlu.ee</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Tallinn University</institution>
          ,
          <addr-line>Narva mnt. 25, Tallinn, Estonia, +372 529 8776</addr-line>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Tallinn University</institution>
          ,
          <addr-line>Narva mnt. 25, Tallinn, Estonia, +372 5684 0534</addr-line>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Tallinn University</institution>
          ,
          <addr-line>Narva mnt. 25, Tallinn, Estonia, +372 640 9423</addr-line>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2017</year>
      </pub-date>
      <abstract>
        <p>Technological and social advancements have brought us to the brink of the 4th industrial revolution. With the rapid expanse of automation and intelligent machines, the workplace as we know it is changing. This could lead to greater inequality and massive recruitment challenges as societies are simultaneously facing an increase in unemployment as well as growth of talent shortage. The development of a unified competency management platform is proposed that serves as a communication layer between the stakeholders interested in retraining and upskilling of the workforce in light of these challenges. To provide the basis for companies to employ this platform and implement a competency framework, an instrument for the initial competency gap mapping was created and a case study is presented where the instrument was used to gain insight into stakeholder perceptions about and interactions around competency definition and management in the context of an ICT company.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Applied computing ➝ Education ➝ Learning management
systems
Industry 4.0; competency management; lifelong learning</p>
    </sec>
    <sec id="sec-2">
      <title>1. INTRODUCTION</title>
      <p>
        At the brink of the 4th industrial revolution, Intelligent machines are
getting smarter and cheaper, enabling the human workforce to
focus on less repetitive and more challenging tasks [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. This shift
will introduce new risks and demands by triggering changes in the
core competencies of certain professions [
        <xref ref-type="bibr" rid="ref1 ref3 ref4 ref5">1, 2, 3, 4, 5</xref>
        ]. The shelf
life of these employees' skill sets is rapidly decreasing which leads
to massive recruitment challenges: societies are simultaneously
facing an increase in unemployment as well as growth of talent
shortage [
        <xref ref-type="bibr" rid="ref1 ref6">1, 6</xref>
        ]. Preventing a labor force crisis requires decisive
steps to be taken regarding the education, including retraining and
upskilling, of the workforce and restructuring education systems [
        <xref ref-type="bibr" rid="ref1 ref5">1,
5</xref>
        ]. To support the continuous education of the workers, the
development of new standards for assessing formal and informal
learning is critical [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. If the concurrent high skills instability is not
dealt with in time, industries will be led to massive recruitment
challenges and talent shortage, already happening now and
expanding rapidly over the next five years [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
      <p>
        Summarizing from the above, it means that the education system
needs to shift from preparing students for a job to preparing them
for a career [2] and their development should cover the full
lifecycle from professional onboarding until retirement [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. This can
be achieved by establishing an organization and cooperation culture
that supports innovation through inclusion of workers into
workplace development processes [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. Looking at the realities
today, it is clear that we are still far away from this vision. The
inclusion of all stakeholders into the shaping of Industry 4.0 is not
a reality today. Particularly, inclusion of workers into their personal
and wider workplace development is not the usual case in
companies today. It seems digitization is rather seen as a threat to
workers, putting pressure on them to adapt to new demands of the
labor market. The responsibility for upskilling and “lifelong
learning” appears to be shifting more and more from educational
institutions and companies to individual workers.
      </p>
      <p>In this paper, we would like to make one step into this visionary
future. We present a case study of an Estonian ICT company
(Proekspert) in which some of the ideas of worker inclusion into
workplace development have already been realized. We use the
case study to explore, how in such a setting workers can be included
into the future planning process. We use the definition of
competencies needed in the context of Industry 4.0 as a case to
examine how such planning could be conducted. In the long run,
experiences gained in this and other case studies should inform the
design and development of a unified platform for competency
definition and planning around which a fruitful dialogue of all
stakeholders can happen.</p>
      <p>The paper is structured in the following way. First, the background
of the research is provided, including an overview of the social
challenges brought about by the new industrial era, previous studies
on competencies in Industry 4.0, and existing approaches and
technologies for novel competency management methods. Based
on the background information, a common platform is proposed for
new-age competency management. The second part of the paper
gives an overview of a case study carried out in an ICT company
with the objective to prototype an instrument to map the perceived
competency gap in the context of an organization and thus help
companies to initialize a competency framework. Finally, findings
from the case study are provided and the limitations of the current
study and plans for further studies are discussed.</p>
    </sec>
    <sec id="sec-3">
      <title>2. BACKGROUND</title>
      <p>
        The corresponding term “technological unemployment” dates back
to the First Industrial Revolution in the 19th century. Regardless of
the fears at the time, economies have adapted to these massive
changes in labor markets. For the current changes, it is near
impossible to predict the long-term impacts but it is clear that policy
makers are facing a race between technology and education. To win
this race, it is important to encourage the necessary retraining and
upskilling of the workforce. [2]
This requires the continuous cooperation of all stakeholders:
individuals, employers, governments, policy makers, education and
training providers, and unions [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. Schools and companies need to
collaborate to devise and implement new formal and non-formal
programs, and also promote informal learning [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. In order for this
process to be sustainable, it is important to keep the qualification
profiles of occupations up-to-date with new emerging
requirements. For this, business organizations can provide valuable
input, such as requirements forecasts and labor force evaluation
feedback. Besides helping develop curricula, this gives
opportunities to create additional projects for upskilling existing
workforce to meet the new requirements. Meanwhile, it is the
governments’ and policy makers’ task to establish a supporting and
enabling environment [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ].
      </p>
    </sec>
    <sec id="sec-4">
      <title>2.1 Studies on Competencies for Industry 4.0</title>
      <p>
        The term Industry 4.0 (Industrie 4.0) was initially introduced at the
Hannover Fair in April 2011 and thus the research regarding
Industry 4.0 is at its very early stage, and the scientific resources
rather scarce. Although even scarcer, the existing research on
competencies in Industry 4.0 provides a solid basis for further
development.
[
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] is one of the first reports to estimate the changes to
competencies and worker development in light of the industrial
advancements. The report is based on a large-scale survey that was
carried out with the aim of getting a deeper understanding of the
expectations regarding future jobs, work and skills to provide
guidance to businesses, governments and civil society
organizations, including education providers. Over the course of
the first half of 2015, the survey was responded to by 371 individual
companies, with the sample representing over 13 million
employees across nine industry sectors. [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]
[2] emphasizes the role of digital skills in new-age competency
development and proposes changes to the core principles of today’s
education. They argue that educational organizations should focus
on building foundational cognitive and socioemotional skills and
ensuring that the students acquire basic ICT literacy and
problemsolving skills, as opposed to learning certain skills required for a
job. As labour markets are changing rapidly, the latter risk
becoming obsolete. The skills students learn should provide a
strong basis for continuing learning while already employed. [2]
A study carried out by the European Parliament states that Industry
4.0 workers would most possibly be graduates from a STEM
(Science, Technology, Engineering, Mathematics) background but
in addition to strong domain-specific competencies they will also
be required to excel in general competencies, such as managerial
skills, understanding of the specific industries and the
interrelatedness of different industries across value chains, supply
chains, and processes. There will also be a higher demand for
excellent communication skills to promote team work and customer
relations. All these new competency requirements advocate the
development of entirely new qualifications that comply with the
interdisciplinary nature of the work. This means that new learning
content and didactic methods need to be established and included
into professional education and lifelong learning. To support the
continuous education of the workers, the development of new
standards for assessing formal and informal learning is critical. [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]
To help stakeholders meet the arising challenges, authors in [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]
have carried out an extensive literature overview and used the
PESTEL framework to analyse the macro-environmental
challenges and considered their political, economic, social,
technical, environmental, and legal factors. Based on this analysis,
they developed a holistic Industry 4.0 competence model with 4
major categories: personal, social, methodological, and technical
competencies.
As can be seen in the table, many competencies required in the
context of Industry 4.0, are not technical skills usually found in the
curricula of vocational schools or universities. In addition, each
competency in the table could have a different notion in different
companies that may itself change in time. For example, in one
company coding skills may mean proficiency in the C++
programming language while in another it may be the ability to
compose instruction sets for a particular device. Thus, the
competencies in the table serve as abstract groups that can have
multiple values. Another, easier example can be drawn with natural
languages instead of programming languages: one company may
require fluency in Estonian while another in English, but both of
these belong under language skills. Such general frameworks are
helpful because they can guide competency definitions for Industry
4.0, but they are not sufficiently detailed to help stakeholder
inclusion into the process. However, they can be used as the initial
basis to define an organization’s competency requirements and map
the existing competencies in more detail.
[
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] analyzed employee competencies for employees with higher
education in Industry 4.0 and created an Industry 4.0 competency
model based on the SHL Universal Competency Framework
(UCF). They argue that for a successful transformation towards
Industry 4.0, the needed competencies need to be clearly defined,
and the job profiles for engineering, information technology and
information systems employees need to be adjusted and updated
[
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. The final competency model comprises of 64 competencies
and differentiates between Information Systems, Computer Science
and Engineering curricula graduates. Some competencies were
seen important for only a specific group of graduates, however,
many competencies were seen as interdisciplinary, including but
not limited to decision making, leadership skills, teamwork,
problem solving and creativity.
      </p>
      <p>
        To establish a common language for ICT competences, skills and
proficiency levels across Europe, the European Commission has
developed the European e-Competence Framework (e-CF)
classifies 40 competences for ICT professionals. The most recent
version, e-CF 3.0 was finalized in 2014 and consists of 40
competencies that are allocated into five ICT areas: plan, build, run,
enable, and manage. [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] Although thorough, the framework only
focuses on technical competencies and the “soft” competencies
identified through Industry 4.0 research are not in the scope of
eCF. Another aspect to consider is that the framework was released
in 2014, only 3 years after the first introduction of the term
“Industry 4.0” and thus it is reasonable to assume that the term was
not widespread during the research and development phases of the
framework.
      </p>
      <p>
        The current study is based on the competency model by [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] due to
its focus on Industry 4.0 and compact scope. Although [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] also
provide a strong basis for further work, the number of the
competencies in the model exceeds the capacity of the current
study. Another reason is that the model focuses on three specific
ICT curricula: Information Systems, Computer Science and
Engineering. Our study, however, focuses on competency
development that takes place during employment and includes
employees with less specific academic background: in addition to
engineers we are also interested in the competency requirements for
designers, user experience specialists and other novel professions
in ICT.
      </p>
      <p>Due to rapid changes in the core competencies triggered by recent
technological and social advancements, labour market competency
gap is growing ever faster. This can only be relieved through the
cooperation between all stakeholders. It is critical that academic
organizations, training providers and entities responsible for
professional standards receive constant and up-to-date input from
business organizations. This way the competency development of
workers can be supported throughout their careers by multiple
stakeholders in an integral manner.</p>
    </sec>
    <sec id="sec-5">
      <title>2.2 Technologies and Approaches for</title>
    </sec>
    <sec id="sec-6">
      <title>Competency Management</title>
      <p>
        Industry 4.0 is causing a shift from traditional industrial
engineering methods to data-driven functions and cyber-physical
systems [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Based on this principle, also the human resource
management in Industry 4.0 context could adapt their methods to
introducing novel or implementing new technologies for
connecting learning more directly with job demands [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Some
companies have already adopted this approach and through
cooperation with universities they have built and implemented
novel technologies to support worker learning and knowledge
management.
      </p>
      <p>
        For example, IntelLEO, an ICT research project was initiated with
the aim of developing intelligent technologies that support learning
and knowledge-building (LKB) activities in Intelligent Learning
Extended Organization (IntelLEO). The main objective of the
project was to enhance motivation of learners by employing
technological tools that utilize the synergy between services for
efficient management of collaborative LKB activities and access to
and supply of shared content, and harmonization of individual and
organizational objectives [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. Motivation is one of the primary
factors that affect an individual’s engagement in learning and
knowledge sharing [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] and thus it is important to align the
competency development objectives of the individual and her/his
organization. Another important aspect of IntelLEO is its structure
that combines different business and educational communities and
organizational cultures: industrial, research and educational [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ].
This means that in an IntelLEO, several stakeholders are included
at the same time, advancing and strengthening their communication
eDidaktikum is an environment initially intended only for teacher
education with the objective of facilitating the exchange and
collection of didactic information within and across universities.
The main aspects of achieving this are the systematization of
information, cooperation and social learning, and personal
development and evaluation.
eDidaktikum is not bound to any university or school. This means
that even after receiving her or his qualification, the user can
continue using the system and participate in courses. This is an
example of true lifelong learning that prepares one for a career, not
a job. Another interesting aspect of eDidaktikum is that it is tied to
national qualifications. The teacher competency model used for
pilot is distributed into logical sub-sections and based on that,
teachers and students can mark down, which competencies a
learning activity or evidence covers. [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] Thus, eDidaktikum
provides opportunities for continuous development towards the
competency aspirations of an individual.
      </p>
      <p>
        The Learning Layers Project is directed toward developing
technologies that support informal learning in the workplace with
the focus on Small and Medium sized Enterprises (SMEs). Drawing
on a large-scale stakeholder-driven co-design approach [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] within
Regional Innovation Clusters, they have developed modular and
flexible technological layers for supporting workplace practices
that induce and facilitate mass collaboration within and across these
enterprises. The concepts and technologies developed help to
bridge the gap between scaling and adaptation to personal needs.
[
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] The tools that Learning Layers provide encourage and
facilitate the development of many worker competencies, not just
technological, but also the “soft” competencies, including but not
limited to communication, teamwork, knowledge transfer, problem
solving.
      </p>
      <p>
        APOSDLE, Advanced Process-Oriented Self-Directed Learning, is
a project focused on work-integrated learning (WIL) in which case
learning is an intentional or unintentional by-product of the time
spent at the workplace performing work tasks [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. APOSDLE
focuses on empowering workers to learn while carrying out their
work-related tasks, through task learning, task execution and
domain-related support, and competency-gap based support [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ].
The resulting APOSDLE environment provides learning guidance
through its components. For example, it uses smart algorithms to
help users find resources relevant to their work and previous
experience, including potential other users who might have
advanced knowledge in the area the current user is working in [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ].
When looking at these four examples in a unified system, IntelLEO
would provide the basis for planning and organizing the
competency development of workers while considering the
objectives of both the individual and the employer. IntelLEO also
includes other important stakeholders, such as the academic
organization which promotes communication between the
interested parties. APOSDLE environment and the underlying
theoretical principles can be used to model competency gap directly
connected to worker task execution, and promote work-integrated
learning through semi-automated tools. Learning Layers and
eDidaktikum would provide the tools for informal and formal
learning respectively. In addition, eDidaktikum provides the
functionality to map employee competencies against competency
models. If used in combination, the different systems and principles
would provide a good basis for a more holistic competency
development.
      </p>
    </sec>
    <sec id="sec-7">
      <title>2.3 Towards a Competency Management</title>
    </sec>
    <sec id="sec-8">
      <title>Platform for Industry 4.0</title>
      <p>To advance a data-driven approach to learning and competencies
the existing systems could be integrated through a common
communication layer and supplemented with additional
functionalities. This would result in an integral and unified
competency management platform that would serve as a central
service for all the stakeholders involved in competency
development processes. The platform would provide a standard
human and computer readable list of categorized, grouped and
versioned competencies for stakeholders to use in their competency
management systems. They would be provided with a toolset to
assess whether them or their employees possess certain
competencies to help map their competency gaps. Based on this
data it would be possible to visualize labor market competency gap.
For example, business organizations could have a clear overview
of available (existing) competencies mapped against needed or
aspired competencies. In addition, the data gathered from
recruitment portals would give a clear overview of the needed
competencies and trends. Academic and training organizations
could supplement this data to visualize future competency
availability estimations and trends. Based on their personal
competency aspirations, the competency gap of the stakeholders,
and the labor market need, stakeholders would be given suggestions
on their personal development. All this helps to plan future
activities. For example, smaller companies can cooperate when
developing niche competencies: order joint trainings, and organize
workshops and seminars. Governments can identify which
competencies they should support through their initiatives.
Therefore, the competency management platform can be
considered as a hub connecting through different services various
stakeholders and communicating with other relevant information
systems as depicted on the following Figure 1.
When compared to the examples drawn in the previous chapter, a
number of the elements that would constitute the platform have
already been conceived. The main challenge, however, will be to
conceptualize it as a “central” platform that all stakeholders agree
to use, and around which stakeholder dialogues and negotiations
can happen. We have conducted a case study in which these
stakeholder interactions around competency definition and
management have been studied. In this case study, we concentrate
on the Workers and the Business Organizations as a first set of
stakeholders. In subsequent studies, we will address other
stakeholder groups as well.</p>
    </sec>
    <sec id="sec-9">
      <title>3. CASE STUDY: COMPETENCY</title>
    </sec>
    <sec id="sec-10">
      <title>DEVELOPMENT IN PROEKSPERT</title>
    </sec>
    <sec id="sec-11">
      <title>3.1 Selection of the Case</title>
      <p>
        We carried out the first case study in Proekspert, a software design
and development company. Being founded in 1993, only two years
after the Estonian independence was re-established, Proekspert is
one of the oldest software development companies in Estonia. The
company focuses on multiple areas, one of them being future
manufacturing. The key characteristic of Proekspert is its
hierarchical flat structure – there are no managers or departments
in this company but instead the company is divided into
selfgoverning teams (Figure 2). Each team serves their own customer
and is in many aspects autonomous. In terms of Industry 4.0, such
flat structure increases the employee participation and the speed of
communication, thus contributing into innovation processes and
worker learning [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ].
      </p>
      <p>
        Proekspert was selected as a suitable case because it is an ICT
company that has prior knowledge about Industry 4.0 and thus the
employees have already formed a partial understanding of the
changes that it will trigger. Another reason for choosing Proekspert
is its innovative attitude towards the workplace. For example, the
company does not have a managerial level. Additionally, the
company has adopted a holistic view on employees’ lives: it is a
common belief at Proekspert that employees perform the best when
their work and personal lives are in balance. In this sense, the
company fits very well our focus on worker inclusion.
We interviewed the workers to get a deeper understanding of how
they perceive the competencies identified by [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] and the gap
between a competency’s importance and availability. This is vital
input when choosing or creating methods for identifying the
competency levels of workers and finding out the gap in the market
or an organization.
      </p>
    </sec>
    <sec id="sec-12">
      <title>3.2 Methodology of the Case Study</title>
      <p>The participants of this study were a convenience sample of
employees from the company. The group consisted of nine people
of different age and professions. While the exact age of participants
was not asked, their ages fell in the range of 21-40. From the gender
perspective, participants were almost equally balanced with four
female participants. When asked for how long the participants had
been working in their area of expertise, most of them selected the
range of 2-5 years. There were also participants who had been
working for 1-2 years and those with experience for 10-20 years.
The participants were either developers, designers, analysts or
product owners, or engineering excellence specialists. The
researcher responsible for data collection is employed at
Proekspert.</p>
      <p>The data was analyzed using both qualitative and quantitative
methods. For qualitative data, content analysis was carried out
where keywords were drawn from the free text entered by the
participants and notes written down by the researcher. The
keywords were collected using Annotations software by Balcony
Production. Based on keywords, themes were composed to help
interpret quantitative results. Quantitative analysis was done using
IBM SPSS Statistics software. While multiple methods were used
to gain insight into the data, the findings provided in the current
article are based on means comparison through T-tests.</p>
    </sec>
    <sec id="sec-13">
      <title>3.3 Conducting the Case Study</title>
      <sec id="sec-13-1">
        <title>3.3.1 Analyzing the Context of the Case</title>
        <p>
          Each Proekspert employee is provided with a training budget that
is mostly used for professional training, but there have been cases
where employees have taken courses not directly related to their
professions. The philosophy of the human resources team regarding
worker development is that promoting competences that the worker
needs in non-professional life will go a long way to improve the
person’s contentment with both her/himself and the employer.
Emotional intelligence development is promoted, to increase a
person’s ability to identify, assess and manage the emotions of
one’s self [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ]. This will, in Proekspert’s philosophy, result in a
more motivated worker who is enthusiastic and willing to
contribute to the company culture and community. Albeit
Proekspert strives to be a company of engineering excellence, the
“soft" competencies of workers are not neglected. The company
provides various trainings for social empowerment and emotional
intelligence empowerment, encourages self-development and
mentoring other workers. Employees are viewed as the most
valuable resource of the company and thus they are included in the
core processes of the company strategy.
        </p>
        <p>For example, employees are encouraged to participate in long-term
strategy planning. When planning the strategy for 2020, a series of
workshops was held that focused on the strategic factors that would
help towards the next level in company development, and
employees were invited to nominate, prioritize and describe these
factors.
Another example of inclusion is the recruiting culture of
Proekspert. When a team finds they need additional resources, they
contact the human resources specialist who will find out whether
there are any available employees in-house who could join the
team. When there are no available resources, the HR specialist finds
potential new recruits who are then interviewed with at least one
team member present. Although there are many parties included in
the process, it is usually the team that makes the final decision.
Proekspert has developed several internal tools to create
transparency regarding employee competencies and the skill sets
needed for existing and potential new projects. For technical
competency mapping, Proekspert has developed the internal
product Pulse that provides the functionality to enlist oneself for
new challenges, and spread information about potential new
projects. In a way, the tool acts as an in-house recruitment portal
where users can specify their competencies and past experience.
Project leads can then filter employees with the required skill-sets
and invite them to participate in new projects. At the same time,
employees can search through the projects and apply for the team
if they find it interesting. The ultimate goal for developing internal
HR tools is to provide a better overview of worker competencies,
existing projects and resource allocation, which in turn improve the
sales process, financial estimations, and provide a better basis for
developing organization strategy [21]. If integrated with the
proposed platform, Pulse could be used to collect data to visualize
the real-time technical competency gap in Proekspert.
For “soft” competencies, Proekspert uses another internal tool
HappyMe that allows users to assess their own and their team
members’ competencies, set goals and give feedback. These data
are compared and visualized to users. This tool is also used to
gather data about employee satisfaction towards the company and
the overall values of the employees. This data is used to align the
company strategy to the overall culture of its employees. Similarly
to Pulse, HappyMe could be used to gather real-time competency
data to the central competency management platform. Statistics of
this information may prove valuable for companies who are
actively recruiting as it gives a good insight into what workers
mostly value in their employers. These are but a few examples of
novel internal tools that are used in Proekspert to advance the
competencies and overall work life of the organization. Thanks to
its openness and interest in continuous improvement, Proekspert
makes an engaging case for studying and propagating a new-age
organization culture.</p>
      </sec>
      <sec id="sec-13-2">
        <title>3.3.2 Application of the Competency mapping instrument</title>
        <p>An interactive instrument based on Poll Everywhere software was
created to map Proekspert’s competency gap. The mapping takes
place in a seminar format where participants are asked to bring their
own devices: laptops, tablets or mobile phones. The questions are
displayed on a large screen together with real-time results.
Discussion is encouraged and in case of participant consent,
sessions are recorded on audio.</p>
        <p>
          There were 5 types of questions: multiple choice questions, Likert
scale questions, freeform questions, rank order questions, and
clickable image questions. The questions were divided into five
logical categories. The first category of questions was used for
warm-up. As the Poll Everywhere environment was new to all
participants, it was decided to practice different question types. For
example, to practice clickable image questions, the participants
were asked to click the circle that represented their mood in the
following Figure 3.
The second category comprised of personal questions. Participants
were asked about their profession, gender, age and track record in
the field of ICT. The third questions category focused on how
participants perceived competency development. This included
questions about the frequency of having to learn new competencies;
different difficulty levels of developing “soft” and “hard”
competencies; stakeholders of competency development; the
competency gap of the organization and labour market. The
questions from the last two categories were asked alternately: the
first one was a freeform question where participants were asked to
elaborate on what indicates that a person has the respective
competency. Again, discussion was encouraged and in some cases
the corresponding competency description from [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ] was read to
clarify the term. The second question was a clickable image
question where participants were asked to map the importance and
their self-assessed level of a competency. The image depicted a 3x3
grid matrix that can be seen in Figure 4.
        </p>
        <p>Although there were nine distinct areas mapped onto the image, the
location of clicks was tracked in pixels and percentages. This
feature in the software was quite useful as the scale of the grid
proved to be too small: in some cases, the click was deliberately
made in a very extreme corner of the corresponding area to show
strong conviction. This was taken into consideration when
interpreting data. It is also important to point out that during
quantitative analysis the scale of these types of questions was from
“low” to “high” (1...3) and that there was no option for the
respondents to mark that they lacked the competency entirely. This
was due to the belief of the researchers that everyone possesses
some low-level proficiency in every competency.</p>
      </sec>
      <sec id="sec-13-3">
        <title>3.3.3 Results and feedback</title>
        <p>The participants were asked whether they feel that their employer
supports the development of their competencies. Out of 9
participants 4 agreed and 5 said that they agree in most part. When
asked about the benefits that the employer gets from worker
competency development, one of the main keywords was
efficiency, but some softer aspects were also considered. For
example, it was suggested that through competency development
the employer will have a worker who is in a better place with her/his
life and through this will be a stronger contributor to the company
culture. According to participants, the additional entities that
benefit from their competencies include themselves, their families,
friends and colleagues, and hopefully the future. On a professional
level the beneficiaries include the clients of the employer, the
society, local municipalities and the government.</p>
        <p>The highest competency priority for the participants was problem
solving, which was unanimously evaluated to the highest
importance level (3.0). It was also one of the cases where
participants clicked in an extreme area of the grid: three participants
had placed their markers in the high top border of the area. The
interpretations followed four major themes: understanding the
problem, finding suitable solutions, creativity and persistence.
While perceiving problem solving as the most important
competency, the participants also evaluated their own problem
solving level as the highest, along with teamwork skills – both
competencies were evaluated to an average level of 2,6. Thus, the
competency gap of problem solving is 0,5. The reasoning of such
high prioritization and self-assessment of problem solving skills
may lie in the nature of day-to-day work in ICT domain. The issues
that ICT workers tackle on a daily basis are not limited to only
coding and computer issues. As the company focuses mainly on
client projects, the employees are working to solve problems
inherent to the domains of their clients which in itself raises several
other issues, for example finding a common language between
business and technical people.</p>
        <p>The high self-assessment of teamwork skills amongst participants
can be explained with the company hierarchy described earlier:
self-governing teams as central units of the company. When
analysing the interpretations of teamwork skills, it became evident
that most participants had their own unique understanding of
teamwork, for example cooperation, understanding the objectives,
motivating people, honesty, leadership, cooperation, knowledge
sharing, taking responsibility, and empathy. These interpretations
indicate that for the participants, teamwork skills incorporate
several other competencies. The competency gap of teamwork was
0,2 as the average perceived importance was 2,8.</p>
        <p>The lowest priority for the participants were intercultural skills with
the importance assessment of 1.8. While the interpretations of this
competency were unanimous with the themes being awareness and
empathy, there are two explanations to this this low assessment.
First, the sample only consisted of Estonians who have not met
intercultural issues. On the other hand, the working language of the
company is English, which helps avoid language and
communication barriers. The self-assessed level of intercultural
skills was 2.0, making the competency gap -0.2. It was one of the
three competencies where the perceived level was higher than
importance, the other two being process understanding and
efficiency orientation.</p>
        <p>The competency with the lowest self-assessed level was
networking with an average level of 1.5, while its importance was
deemed medium, with a score of 2.2. The highest competency gap
between average importance and average level was understanding
IT security with a gap of 1.1. Only one participant assessed her/his
IT-security understanding skills to be high. The interpretations of
understanding IT-security were closely tied to the three
fundamental aspects of cyber security: availability, confidentiality
of integrity. The average importance levels and self-assessments of
competencies can be seen in the following radar chart (Figure 5).
As can be seen in the figure, all categories have competencies of
different priority levels. The category with the highest average
competency priorities is the methodological category that also has
the highest cumulative competency gap. This kind of visualization
could be beneficial for the organization when planning new
trainings or deciding between potential recruits. Coming back to
the competency management platform, these visualizations could
be used for generic competency gap as was presented in the current
study, but also to visualize the gap in very specific competency
areas. If enough organizations would provide their data, it would be
possible to visualize future trends and plan how to mitigate
potential competency shortage issues. It would also give
individuals good indications on which competencies to develop to
be more valuable in the labor market.</p>
      </sec>
      <sec id="sec-13-4">
        <title>3.3.4 Results feedback</title>
        <p>The participants and additional stakeholders from Proekspert were
shown the compiled competency importance and self-assessment
levels diagram shown in Figure 5. The participants’ feedback
revolved mainly around recruiting and composing the teams: based
on the competency priorities and levels it would be easier to
determine whether a person is suitable for a team or not. It would
also provide both the individual and the team with information of
what is expected from them – in reality they may possess these
competencies but it may very well be that they are not aware that
they need to employ them in the new context. Another aspect that
was suggested was to draw correlations between the competency
priorities and levels, and personality types, for example the
MyersBriggs Types.</p>
        <p>Participants also suggested integrating the functionality of the
instrument with the existing internal tools, Pulse or HappyMe. A
concern was brought up in regard to automating the data
collection: it is important to ensure that the data is frequently
updated, and therefore the data collection process must be as
convenient as possible. To fully employ these data, role profiles
should be created that reflect, which competencies are important in
which context. These requirements may differ across professions
and are different, for example, for designers and developers. At the
same time, it also depends on the context of the project. For
example, it may not be necessary to be very innovative in a
maintenance project whereas in an R&amp;D project innovative mindset
is crucial.</p>
        <p>The board members that were provided with the results focused on
the company strategy. They deemed it helpful if it were possible to
similarly visualize the competencies derived from strategic
objectives and compare them against the importance, self-assessed
level, and also the competency aspirations of employees. This
would help in several ways. First, employees would have a clear
visualization of the company’s competency need concerning
existing and potential projects. This is valuable information when
planning self-development and aligning one’s interests with the
ones of the company. It would also help prepare for future sales and
deciding on which leads to follow. Finally, the board would have a
better understanding on how the importance of competencies is
seen by the board itself, employees specifically working on
strategic planning, and all other employees. In order for the
company strategy to work, its values must be aligned with those of
the employees. Based on this visualization, Proekspert could align
its strategy to conform more to the common values of the
employees, or recruit new people that already share the values
derived from the strategy.</p>
      </sec>
    </sec>
    <sec id="sec-14">
      <title>3.4 Results and Implications from the Case</title>
      <p>
        Two concerns were found regarding the instrument. First, the
competency list based on [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] proved to be too exhausting for the
participants. Due to a large number of questions, the seminars
lasted over three hours and the participants felt tired at the end. To
alleviate this, similar future seminars could be divided between
multiple sessions. The seminars were held at the end of work days,
so another solution would be to ask the employer to allow
employees to participate during working hours. The second
concern is related to the interpretations of competencies. While
most competencies were interpreted very similarly, some
competencies struck a different note in the participants. To help
overcome these “translation” issues, similar instruments in the
future should include some pre-written indicators or guidelines to
explain the competency. One option would be to provide some
examples of activities carried out by proficient employees, before
asking for participants to provide their interpretations.
The resulting data and visualizations were mostly deemed helpful
by the participants and other stakeholders of competency
development. First, this information would help compose
wellbalanced teams where members know which competencies are
needed from them. Secondly, it would help the company plan the
competency development strategy to be aligned with the needs of
current projects and future leads, while considering the competency
aspirations of employees. This would simultaneously mean that
individuals can plan their competency development to be more
valuable for the company. Finally, all competency development
stakeholders would have an overview of the overlap of the strategic
and actual competency priorities and levels, to ensure that the same
values are shared by those responsible for company strategy, and
other employees. It was pointed out by many people that the
instrument could be integrated with one or several of the existing
internal tools of Proekspert.
      </p>
    </sec>
    <sec id="sec-15">
      <title>4. FUTURE WORK</title>
      <p>While the findings of this study may prove a good basis for
developing an instrument to help Proekspert implement a
competency framework, many additional aspects still need to be
considered. The instrument created for the study will be improved
based feedback from participants and other stakeholders, and the
study will be repeated on a larger scale with the improved
instrument. For the large-scale study, a more detailed
Proekspertspecific competency model needs to be developed based on the
current study, to describe the competencies on a far more specific
level.</p>
      <p>Future work will also include similar case studies in other ICT or
Industry 4.0 companies. As every company has their own nuances,
competency modelling is different in the context of each company.
This means that the instruments created for this purpose need to be
adaptable to different circumstances. After establishing the
foundational base for implementing a competency modelling
framework in ICT companies, the research will shift to the design
and development of the common competency management
platform.</p>
    </sec>
    <sec id="sec-16">
      <title>5. CONCLUSION</title>
      <p>Industry 4.0 is bringing along a shift in the core competencies
needed in workers. To prevent a labor force crisis, all stakeholders
must participate in the retraining and upskilling of the workforce.
To promote cooperation and fast movement of competency-related
information, the development of a common, data-driven
competency management platform was proposed. The platform
would serve as a communication layer between stakeholder
competency management systems while including several existing
systems that provide functionalities for data-driven competency
management.</p>
      <p>To conceptualize it as a “central” platform that all stakeholders
agree to use, the stakeholders have to be provided with instruments
to properly initialize the competency framework in their specific
context. A series of studies will be carried out to understand the
different nuances of stakeholders’ perception and assessment of the
importance of these competencies in their own contexts. As the first
study, we have conducted a case study in the context of Proekspert,
a software design and development company. The study focused on
an instrument to map the perceived competency gap in Proekspert
by mapping the major themes that become evident when workers
are asked to explain the indicators of a person’s proficiency in a
competency. These themes were used to interpret the numerical
importance and self-assessed level of the corresponding
competencies which in turn were be aggregated into the perceived
competency gap in the context of the organization.</p>
      <p>Some weaknesses were discovered when testing the instrument
developed for Proekspert. For example, the competency list,
although chosen for its small size, proved to be too exhausting for
one session. Another issue arose when interpreting competencies –
while some competencies were understood unanimously, some
were seen very differently by participants.</p>
      <p>When combined with data collected from internal tools, such as the
aforementioned Pulse and HappyMe, the visualized competency
gap can be used to plan future trainings across all employees or
different profession groups. Integrating the tools with the proposed
competency management platform and collecting similar data from
other ICT companies would help provide insight into the current
state of the labor market. This could be done through visualization
of the overall competency gap across profession groups, overview
of the existing and aspired competencies of workers, and
information about future trends regarding competency needs. To
continue implementing a competency framework in Proekspert, a
subsequent study using an improved version of the developed
instrument needs to be carried out to include more employees.
Similar case studies will be carried out in other ICT companies to
study how to adapt the developed instruments in different contexts,
such as different managerial hierarches. When the base for
implementing a competency modelling framework in an ICT
company is established, the research will continue towards the
design and development of the common competency management
platform.</p>
    </sec>
    <sec id="sec-17">
      <title>WORKS CITED</title>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1] [2]
          <string-name>
            <given-names>World</given-names>
            <surname>Economic</surname>
          </string-name>
          <string-name>
            <surname>Forum</surname>
          </string-name>
          ,
          <article-title>"The Future of Jobs: Employment, Skills and Workforce Strategy for the Fourth Industrial Revolution,"</article-title>
          <source>World Economic Forum, Geneva</source>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <source>World Bank, "World Development Report 2016: Digital Dividends," Washington</source>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>F.</given-names>
            <surname>Hecklau</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Galeitzke</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Flachs</surname>
          </string-name>
          and
          <string-name>
            <given-names>H.</given-names>
            <surname>Kohl</surname>
          </string-name>
          ,
          <article-title>"Holistic approach for human resource management in Industry 4.0," in 6th CLF -</article-title>
          6th
          <source>CIRP Conference on Learning Factories</source>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>J.</given-names>
            <surname>Smit</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Kreutzer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Moeller</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Carlberg</surname>
          </string-name>
          ,
          <source>"Industry 4.0," 15 02</source>
          <year>2016</year>
          . [Online]. Available: http://www.europarl.europa.eu/RegData/etudes/STUD/
          <year>2016</year>
          /570007/IPOL_STU(
          <year>2016</year>
          )
          <article-title>570007_EN</article-title>
          .pdf.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>S.</given-names>
            <surname>Sackey</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Bester</surname>
          </string-name>
          ,
          <article-title>"Industrial Engineering Curriculum in Industry 4.0 in a South African Context,"</article-title>
          <source>South African Journal of Industrial Engineering</source>
          , vol.
          <volume>27</volume>
          , no.
          <issue>4</issue>
          , pp.
          <fpage>101</fpage>
          -
          <lpage>114</lpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>B.</given-names>
            <surname>De Waal</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F. van Outvorst and P.</given-names>
            <surname>Ravesteyn</surname>
          </string-name>
          ,
          <article-title>"Digital Leadership: The Objective-Subjective Dichotomy of Technology Revisited,"</article-title>
          <source>in Proceedings of the 12th European Conference on Management, Leadership and Governance ECMLG</source>
          , Bucharest,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>S. L.</given-names>
            <surname>Müller</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Willicks</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Stiehm</surname>
          </string-name>
          and
          <string-name>
            <given-names>S.</given-names>
            <surname>Jeschke</surname>
          </string-name>
          ,
          <article-title>"Demography Management in Industry 4.0: First Results of a Qualitative Study,"</article-title>
          <source>in Proceedings of the 12th European Conference on Management, Leadership and Governance ECMLG</source>
          , Bucharest,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>D.</given-names>
            <surname>Buhr</surname>
          </string-name>
          ,
          <article-title>"Social Innovation Policy for Industry 4.0," Division for Social and Economic Policies</article-title>
          , Friedrich-EbertStiftung, Bonn,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>L.</given-names>
            <surname>Ilie</surname>
          </string-name>
          and
          <string-name>
            <surname>I. Bondrea</surname>
          </string-name>
          ,
          <article-title>"Changing Labour Market Needs and the Challenges for Academic Leadership,"</article-title>
          <source>in Proceedings of the 12th European Conference on Management, Leadership and Governance ECMLG</source>
          , Bucharest,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>L.</given-names>
            <surname>Prifti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Knigge</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Kienegger</surname>
          </string-name>
          and
          <string-name>
            <given-names>H.</given-names>
            <surname>Krcmar</surname>
          </string-name>
          ,
          <article-title>"A Competency Model for “Industrie 4.0” Employees," in Wirtschaftsinformatik (WI), St</article-title>
          . Gallen,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>European</surname>
            <given-names>Commission</given-names>
          </string-name>
          ,
          <article-title>"</article-title>
          <source>The European e-Competence Framework 3</source>
          .
          <fpage>0</fpage>
          ,"
          <year>2014</year>
          . [Online]. Available: http://www.ecompetences.eu/.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>IntelLEO</given-names>
            <surname>Consortium</surname>
          </string-name>
          ,
          <article-title>"IntelLEO,"</article-title>
          Available: https://intelleo.eu.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>B.</given-names>
            <surname>Kieslinger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Pata</surname>
          </string-name>
          and
          <string-name>
            <surname>C. M. Fabian</surname>
          </string-name>
          ,
          <article-title>"Participatory design methods for learning and knowledge sharing activities in networked organizations,"</article-title>
          <source>in ICELW</source>
          , New York,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <source>[14] eDidaktikum, "eDidaktikum,</source>
          "
          <year>2016</year>
          . [Online]. Available: http://edidaktikum.ee/.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>T.</given-names>
            <surname>Ley</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Cook</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Dennerlein</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Kravcik</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Kunzmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Pata</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Purma</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Sandars</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Santos</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Schmidt</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.</surname>
          </string-name>
          <article-title>AlSmadi and C. Trattner, "Scaling informal learning at the workplace: a model and four designs from a large-scale design-based research effort,"</article-title>
          <source>British Journal of Educational Technology</source>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>Learning</given-names>
            <surname>Layers Project</surname>
          </string-name>
          ,
          <article-title>"Learning Layers,"</article-title>
          <year>2012</year>
          . [Online]. Available: http://learning-layers.eu/.
          <source>[Accessed</source>
          <year>2016</year>
          ].
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>S.</given-names>
            <surname>Lindstaedt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Kump</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Beham</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Pammer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Ley</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Dotan and R. de Hoog</surname>
          </string-name>
          ,
          <article-title>"Providing Varying Degrees of Guidance for Work-Integrated Learning," in Sustaining TEL: From Innovation to Learning and</article-title>
          <source>Practice - 5th European Conference on Technology Enhanced Learning, EC-TEL</source>
          <year>2010</year>
          , Barcelona,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>T.</given-names>
            <surname>Ley</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Ulbrich</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Scheir</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. N.</given-names>
            <surname>Lindstaedt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Kump</surname>
          </string-name>
          and
          <string-name>
            <given-names>D.</given-names>
            <surname>Albert</surname>
          </string-name>
          ,
          <article-title>"Modeling competencies for supporting workintegrated learning in knowledge work,"</article-title>
          <source>Journal of Knowledge Management</source>
          , vol.
          <volume>12</volume>
          , no.
          <issue>6</issue>
          , pp.
          <fpage>31</fpage>
          -
          <lpage>47</lpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>S.</given-names>
            <surname>Shamim</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Cang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Hongnian</surname>
          </string-name>
          and
          <string-name>
            <given-names>L.</given-names>
            <surname>Yun</surname>
          </string-name>
          ,
          <article-title>"Management approaches for Industry 4.0: A human resource management perspective," in 2016 IEEE Congress on Evolutionary Computation (CEC</article-title>
          ), Vancouver,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>O.</given-names>
            <surname>Serrat</surname>
          </string-name>
          ,
          <article-title>"Understanding and Developing Emotional Intelligence,"</article-title>
          <source>in Knowledge Solutions</source>
          , Springer Singapore,
          <year>2017</year>
          , pp.
          <fpage>329</fpage>
          -
          <lpage>339</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>