<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>On the architecture scheduling problem of Industry 4.0</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Guido Guizzi</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Silvestro Vespoli</string-name>
          <email>si.vespoli@studenti.unina.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Dipartimento di Ingegneria Chimica, dei MAteriali e della Produzione Industriale (DICMAPI) Università di Napoli “Federico II” P.zzale Tecchio</institution>
          ,
          <addr-line>80 - 80125 - Napoli</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Dipartimento di Ingegneria Elettrica e Tecnologie dell'Informazione (DIETI) Università di Napoli “Federico II” P.zzale Tecchio</institution>
          ,
          <addr-line>80 - 80125 - Napoli</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>-The recently emerged Fourth Industrial Revolution (Industry 4.0) is characterised by the introduction of the new Cyber-Physical System (CPS) concepts and the Internet of Things (IoT) paradigm. These new collaborating computational entities offer a broad range of opportunity to consider with a different perspective. One of the perennial problems of the manufacturing operation is the scheduling problem of typical job-shop manufacturing systems. Starting from a comparison with the typical architecture of an operating systems scheduler module, we introduce a new manufacturing scheduling architecture. Overcoming the typical Full-Hierarchical configuration defined in the ANSI/ISA 95 in favour of a SemiHeterarchical one, the introduced scheduling architecture leads to a mixture of proactive and reactive approach to the Job-shop Scheduling Problem (JSP), taking advantage from both the common decentralised and the centralised methodology.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Keywords— Industry 4.0; Cyber-Physical System (CPS);
JobShop Scheduling Problem; Manufacturing System; System of
Systems.</p>
    </sec>
    <sec id="sec-2">
      <title>I. INTRODUCTION</title>
      <p>
        The previous industrial revolutions were principally
characterised by advanced in the technology field. The recently
emerged Fourth Industrial Revolution (Industry 4.0), instead, is
characterised by the presence of new technologies which,
thanks to their interconnection ability and the following
combination of the physical and digital world, allow an
evolution in productive logics and architectures. As well as
every past industrial revolution introduced a new enabling
technology, the Fourth Industrial Revolution is characterised
by the introduction of the Cyber-Physical Systems (CPS) and
Internet of Things (IoT) paradigm [
        <xref ref-type="bibr" rid="ref3">1</xref>
        ]–[4].
      </p>
      <p>The CPSs are systems in which the “cyber” part, sum of
computational and communication capabilities, and the
physical part are tightly integrated either as project that as
operations. Said differently, the CPS term refers to a
mechatronic system that interacts continuously with a system
composed of physical elements, each with its computation
capacity. This brings to a collaborative system of
computational elements linked in an inter-networking of
physical and embedded devices, known as Internet of Things.
In the manufacturing paradigm, the current state of the
hierarchical plant organisation is defined in ANSI/ISA 95 [Fig.
1]. In particular, four different main component of this
hierarchical domain are distinguished: Enterprise Resource
Planning systems (ERP), Manufacturing Execution System
(MES), PLC/SCADA systems demanded to the Process
Control activity and Device itself [5]. In this plant organisation,
the decisions taken in the upper levels are sent to lower level,
and each decision-making problem is solved separately and
independently. The decisions adopted at every level may have
different time horizon (long, medium or short periods),
complexity and objectives. In the ERP level, for example, the
supply chain configuration has a time horizon of weeks, while
in the Process Control level, the scheduling has a shorter time
horizon with a focus on the dynamic performance of the
process. However, the appointed ANSI/ISA 95 limits its
applicability to the definition of the different typology of
information exchanged between the described levels, without
any consideration of the communication standard to be used
[6]. In this sense, an important framework that covers these
specifications is the OPC Unified Architecture, whose purpose
is to create a communication platform between the MES and
the PLC/SCADA, independent from manufacturer vendors,
operating systems and programming languages used [7].</p>
      <p>
        Fig. 1 – The ANSI/ISA 95 Hierarchical Architecture
The scheduling and processes production control have a
particular influence on the performance of the manufacturing
system. In this perspective, with the application of the
hierarchical architecture proposed by ANSI/ISA 95 standard,
two different problems arise. Firstly, most real manufacturing
systems are too complex to be modelled and solved by the
major known solvers (because, also in the simplest case, it
represents an NP-hard problem) even if the algorithmic power
of these programs improve every day [
        <xref ref-type="bibr" rid="ref24">8</xref>
        ]. Secondly, the
breakdown between the ERP System (responsible for the
manufacturing planning) and the MES System (responsible for
the processes control on an operational level) create a situation
in which, also if the best mathematical optimization is found
in the ERP level, it may be not optimally performed for the
specific state of the shop floor (i.e., an unexpected delay
during the processing phase, a machine failure, etc.) [9]. In
common practice, this problem is solved performing only a
basic schedule at the ERP level, demanding the shop floor
control by straightforward and static dispatching rules at the
MES level. This practice allows a robust but not optimal
schedule of the production system [9]-[
        <xref ref-type="bibr" rid="ref27">11</xref>
        ].
      </p>
      <p>
        Clarifying, in the traditional vision, the ERP System solves the
production planning with a proactive approach, establishing
what and how to produce [
        <xref ref-type="bibr" rid="ref28">12</xref>
        ]. It solves the ample sequencing
and the scheduling problems, defining a plan with the exact
dates for the start and end of every operation. However, a
proactive approach allows a robust scheduling when the
uncertainty can be quantified in some way (e.g., by
introducing the “idle times” between jobs) [
        <xref ref-type="bibr" rid="ref9">13</xref>
        ]. This approach
may lead to a robust schedule but with the risk of a low
machine utilisation if, as an example, the idle times chosen are
too conservative [
        <xref ref-type="bibr" rid="ref10">14</xref>
        ].
      </p>
      <p>
        At this regard, the introduction of the CPSs systems and the
IoT infrastructure at the shop floor open to a broad range of
opportunity to consider with a different perspective:
taxonomy, design, maintenance, supply chain management,
operating rules and process planning [
        <xref ref-type="bibr" rid="ref11">15</xref>
        ], [
        <xref ref-type="bibr" rid="ref12">16</xref>
        ].
      </p>
      <p>
        In particular, in an entirely decentralised architecture, the
CPSs may be able to solve the production planning with a
reactive approach: every CPS may react to the actual
occurrence and situations with a decentralised and
autonomously decision. However, this problem results in an
additional optimisation problem (e.g., the choice of the best
rule for every decision) and may not represents the best
solution for the entire manufacturing plant [
        <xref ref-type="bibr" rid="ref13">17</xref>
        ], [
        <xref ref-type="bibr" rid="ref14">18</xref>
        ].
Instead, the aim of this paper is to overcome the full
Hierarchical structure of the above-mentioned ANSI/ISA 95 in
favour of a Semi-Heterarchical ones, in which the ERP system
is still present (for all the pro that its introduction in the plant
implies) and the MES evolves to a System of Interconnected
Systems (i.e., CPSs). This Semi-Heterarchical structure allows
solving the production planning with a mixture of proactive
and reactive approach, taking advantage from both
decentralised (represented from the autonomous CPSs) and the
centralised architecture (of full Hierarchical structure).
In the following Section, this architecture is introduced with a
parallel between the manufacturing job-shop scheduling
problem versus the Computer Processing Units scheduling,
due to similarities that the scheduling problem assumes in the
Fourth Industrial Revolution. In Section 3, instead, a real
implementation of this architecture is shown and discussed.
      </p>
      <p>II. THE NEW INDUSTRY 4.0 SCHEDULING ARCHITECTURE</p>
      <p>
        In the manufacturing and operative research, there is a wide
presence of paper and solution on how a scheduling problem
may be solved [
        <xref ref-type="bibr" rid="ref15">19</xref>
        ]. In according with Graves S., the
“production scheduling may be defined as the allocation of
available production resources over time to best satisfy some
set of criteria” [
        <xref ref-type="bibr" rid="ref16">20</xref>
        ]. More precisely, the scheduling problem
have to determine when and where to perform a set of
elementary job or tasks, making a trade-off between early and
late completion of a task and between building an extensive
inventory for an item with a frequent production changeover.
At this regard, different classifications for each type of
production systems can be provided. Ribas et al. [
        <xref ref-type="bibr" rid="ref17">21</xref>
        ] present
an extensive review of the papers about the Flow Shop
scheduling problems with particular attention to the Hybrid
Flow Shop systems. They categorised the problem into Parallel
Machine Scheduling, in which the scheduler algorithm is
responsible for allocating the job to identical machines, and
Flow Shop Scheduling in which the main responsibility of the
scheduler is to choose the production sequence of the jobs,
according to the technology constraints [
        <xref ref-type="bibr" rid="ref18">22</xref>
        ], [
        <xref ref-type="bibr" rid="ref19">23</xref>
        ].
      </p>
      <p>
        The Job-shop Scheduling Problem (JSP), instead, may be
divided into two categories: offline JSP, in which all the jobs to
schedule are concurrently known from the scheduler, and
online JSP, in which the jobs may arrive one by one, in
function of particular production needs [
        <xref ref-type="bibr" rid="ref20">24</xref>
        ]. A standard JSP is
composed of n jobs to be processed on m different machines.
Each job may consist of k elementary operation to be processed
by a given technological sequence (e.g., with a precedence
diagram). The pre-emption during the execution of an
elementary operation and the overlapping is not allowed, while
the goal is to minimise the makespan [
        <xref ref-type="bibr" rid="ref21">25</xref>
        ]. As known, the JSP
is NP combinatorial optimisation (NP-hard) problem and, in
the scientific literature, there is a wide number of research
focused on how to find the optimal solution of this problem
(through linear programming, genetic algorithm or other
heuristics) [
        <xref ref-type="bibr" rid="ref22">26</xref>
        ]. However, as said above, in an Industry 4.0
environment the scheduling should deal with a more
highdynamic environment which opens to a combination of
proactive and reactive scheduling approach. In this context, this
paper wants to introduce a new architectural approach,
overcoming a Full Hierarchical approach to Semi-Heterarchical
ones.
      </p>
      <p>For the similarities between the scheduling operations of a
JobShops Industry 4.0 high-dynamic environment and the
scheduling operations of an Operating Systems, we analysed
the experience gained from the Information Technology (IT)
field during the past years in order to inspire a new
architectural framework also for the industrial world.
i.</p>
      <sec id="sec-2-1">
        <title>Operative System Scheduling Architecture</title>
        <p>
          Inside operating systems, the scheduler represents a module or
a set of modules that choose and select the next jobs or tasks to
be processed by a particular Processing Unit. Usually, the
operating systems present up to three distinct scheduler
modules: a long-term scheduler (also known as admission
scheduler), a medium-term scheduler, and a short-term
scheduler [
          <xref ref-type="bibr" rid="ref23">27</xref>
          ]. The name of these scheduler modules suggests
the relative frequency wherewith their function is performed.
However, it should be not confused with the common industrial
acceptation of it, as it will be more clearly forward.
The Long-Term Scheduler module of the operating system, or
the admission scheduler, as suggested by the name, decides
which jobs or tasks may be added to the “ready queue”, the
main memory. In this sense, it dictates what jobs are to run on
the system, controlling the degree of multiprogramming. This
module is responsible for the typology equilibrium of the load
(e.g., it should create an optimum combination of processes
that are CPU-Bound or I/O-Bound). Instead, the medium-term
scheduler is able to temporarily switch out jobs and tasks,
which has not been active for a bit of time or with a low
priority, from the ready queue to a secondary memory (e.g., a
hard disk drive). In its operations, it tries to carry out a sort of
“local balancing” of the tasks, avoiding the processing unit
stuck on a particular job, swapping the process back in the
ready queue once more memory or processing capacity is
available. Lastly, the short-term scheduler is the latter phase of
the operating system scheduling module. It decides what is the
jobs or tasks in the ready queue to be executed by the
Processing Unit. This module can be preemptive which means
that it is able to forcibly remove working processes from the
Processing Unit, deciding to allocate this Unit to a different
jobs or tasks [
          <xref ref-type="bibr" rid="ref23">27</xref>
          ]. In [Fig. 2] the described Operating System
modules are schematized.
Summarizing, the operating system scheduler is organized in
three different level: a sort of admission level, in which the
jobs to be executed are selected but not sequenced, a mid-term
level, in which the jobs list is locally optimized, and a
shortterm one, that decided who is the next jobs to be executed and
on which Processing Unit.
        </p>
        <p>ii.</p>
      </sec>
      <sec id="sec-2-2">
        <title>The Manufacturing Semi-Heterarchical Scheduling Architecture</title>
        <p>In manufacturing system control there is a hierarchical
organisation, in which the ERP system define the Master
Production Schedule (MPS) and the Material Requirements
Planning (MRP), releasing the list of the orders to be produced
in the next plant shift work. These orders are typically
sequenced and scheduled, with a complete routing and
production sequence for each item and a machine loading plan
for each machine and workers in the plant. During the shift
work, the MES is responsible for executing the received
scheduled activities, loading the appropriate part-program on
the PLC/SCADA and collecting all the error, data and
resources check of the production processes. Only at the end of
the shift work and taking into account the production data
received from the MES System, the ERP is able to reschedule
all the not completed and not compliant order, maybe for a
particular machine failure or a missed raw material from the
logistic systems. In this traditional architecture, the actual
hierarchical architecture of a manufacturing plant shows its
rigidity. Its ability to react to a problem is limited only to some
predefined and basic rules that an advanced MES Systems may
have.</p>
        <p>The real innovation of the introduction of the CPSs and IoT
concepts inside the Shop Floor it is not only to collect and
analyse production data from the sensors but their
interconnection ability for instantly communicating between
them.</p>
        <p>In this context, a new architecture with a different approach to
the JSP of an Industry 4.0 environment is introduced [Fig. 3].
Like the above-described scheduling modules of operating
systems, we may identify three different frameworks also in the
manufacturing reality. Firstly, the advantages allowed from the
presence of an ERP System are relevant for the
competitiveness and the robustness of the actual manufacturing
industries. For this reason, the ERP System will still represent
the strategic vision of a manufacturing company. However, in
the new architecture, the ERP level is only responsible for the
MPS and MRP, just releasing all the order to be produced in
the next shift work. In this vision, the ERP will no longer
define the sequencing and the routing of a particular set of jobs.
It will only define and release to the subsequent level, a sort of
ready queue of jobs to be produced. Every job will have a
complete knowledge of its technological sequence (e.g., every
job knowns its technological precedence diagram) without a
defined machine loading plane.
At this stage, as the operating system scheduler, a ready queue
of all the jobs to be completed is built and transferred to the
next scheduling level. It should be noted that this architecture
allows to constantly update the ready queue of jobs to be
produced, avoiding to wait for the next shift work. At this
point, in the scheduler of the operating system, a mid-term
scheduler, with the purpose of local optimisation, is expected.
In an industrial context, instead, all the CPSs share the
knowledge of the jobs in the ready queue and locally cooperate
to schedule each task to every machine. This second
framework represents a novel MES System, a System of
Systems composed of all the interconnected CPSs. From the
ready queue, the CPSs cooperate in defining the production
sequences of all the jobs admitted in the manufacture systems.
The major advantage of this approach consists in the best
knowledge of the production status. The novel System of CPSs
know and estimate better than the ERP the production state and
may react faster to every problem that may occur during the
production. In addition, it is not bonded to a particular
production sequence. This new framework knows the
technological constraints of every job in the ready queue and,
depending on the actual production condition (i.e., the
machines saturation, machine health state, etc.), schedules a
particular task to a machine instead of another, using the
possible technological solution as a degree of freedom.</p>
        <p>Respect to the operating scheduling system modules, the
second framework in the manufacturing context is much more
important and essential. In the operating systems, in fact, it
may be present or not. In this architecture, instead, it represents
the system with the ability to select and allocate every job to a
machine. The reason is trivial: in the operating systems, the
scheduling is an easier problem because the processing units
are all able to complete the same set of tasks. They may only
show an overload problem, and the mid-term scheduler tries to
balance the workload locally. In a manufacturing environment,
instead, every machine is able to complete only a set of
possible tasks and cannot do every kind of operation (also if,
for the mechanic industry, the CNC machines are able to fulfil
a wide set of different tasks). This adds a degree of freedom to
the scheduling problem of this second framework: it can
establish not only the production sequence but also use a
different technology process for the same items, always
respecting any technology constraints (e.g., it is possible to
create a hole, not only on a drill but also with a milling
machine or with a lathe if the hole is axial symmetrical). Of
course, every operation will have a different cost and tolerance
if it will be produced on a machine instead of another. In this
sense, the System of CPSs may cooperate to find the
scheduling that better maximise an appropriate objective
function.</p>
        <p>Summarizing, the Systems of CPSs virtually represents the
second framework of the plant architecture, in which every job
in the ready queue is allocated to a selected machine. The last
level, instead, is represented by the CPS itself taken
individually. The CPS, in fact, it is not only able to
communicate with the other CPSs but has own computational
capability. At the machine level, the CPS is able to evaluate if
the selected task is appropriate for the machine it represents. As
a matter of fact, with the help of a prognostics algorithm, it
may estimate its health state before accepting the selected task,
deciding autonomously if the failure probability or the
estimated tolerance of the next scheduled workload is
acceptable. In this sense, the CPS knows the status of the
machine and has the responsibility to accept the assigned job
from the previous framework also by completing only some
tasks of it. As an example, in a mechanical production system,
every item to be produced own one or more processing card.
Each processing card represents one of the possible production
cycles, according to the technological constraints. As known
from the classical mechanical literature, a production cycle is
composed of different phases that represents a set of procedure
completed on a specific machine with or without disassembling
and repositioning the workpiece (e.g., turning phase, milling
phase, etc.). Consecutively, each phase may be decomposed in
several sub-phases that represent a set of elementary operation
completed on the same operating machine and with the same
positioning of the workpiece. In this sense, a sub-phase
represents the indivisible task to complete on the same
machine. As said, then, the CPS evaluates if the machine it
represents can fulfil the full job received from the second
framework or only with some sub-phases of it. In this way,
with a better knowledge of the machine state, the last
framework of the proposed architecture is able to decide and
schedule the sub-phases to be completed on the monitored
machine, eventually postponing to the upper level the
subphase that cannot be safely completed on the machine. The
complete proposed architecture scheduler system is
summarised in [Fig. 4].</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>III. A SYSTEM OF CPSS: THE NEW MES</title>
      <p>In the scheduling architecture introduced above, the most
relevant framework is represented by the Systems of CPSs (the
second framework). This framework allows overcoming the
full Hierarchical ANSI/95 architecture with Semi-Heterarchical
ones in which the MES and PLC/SCADA levels are
indistinguishable. The ensemble of CPSs cooperates to find the
best optimal solution in function of the predefined objective
function or behaviour.</p>
      <p>With the aim of showing the feasibility of this framework, a
prototype of a novel Cyber-Physical Logistic Systems (CPLS)
was built in order to simulate the material handling problem of
a typical job-shop plant [Fig. 5].</p>
      <p>It consists of four processing stations, three of them configured
as manual Assembling Stations and the other as an interchange
station within the warehouse. The item to be produced is a
personalised household product (a picture frame). The stations
are connected to an automatic conveyor belt with a carriage
release system, designed to handle various carriages with the
raw or work-in-progress (WIP) material. For our aim, the
precedence diagrams of the produced items are fixed, a priori
knew and composed of twelve phases, as showed in [Fig. 6].
In order to analyse the scheduling performance of the previous
Full Hierarchical architecture with the Semi-Heterarchical ones
introduced, the CPLS prototype is designed for operating under
two different decision-making logics:

</p>
    </sec>
    <sec id="sec-4">
      <title>Centralized Logistics System (CLS), in which the output of the ERP System is the complete Production Cycle with a detailed Scheduling and Routing of every machines and item to be produced;</title>
    </sec>
    <sec id="sec-5">
      <title>The New Introduced Scheduling Architecture, where</title>
      <p>the ERP System only release the Jobs to be produced,
demanding to the System of CPSs the definition of the
detailed Scheduling and Routing with a personal
decisional autonomy and compliant with the Industry
4.0 paradigm.</p>
      <p>Obviously, every Processing Station represents a
CyberPhysical Systems with its autonomous decision capability (for
the third framework) and a cooperation ability (for the second
framework). Instead, the ERP System is represented by an
individual framework in a Personal Computer with the
responsibility to release the jobs in the “Ready Queue” of the
System of CPSs. Every time the jobs reach this queue, the
CPSs starts to cooperate for scheduling the jobs, ensuring the
adaptively of the Production System. From an operating and
practical point of view, the action of the second scheduling
framework (System of CPSs) is triggered by a status change in
the system. In our context, we identified several situations that
trigger the scheduling activity of the second framework:
•
•
•
•
•
•</p>
    </sec>
    <sec id="sec-6">
      <title>The admission of a job in the ready queue from the ERP System (i.e., when the Fist Framework admit jobs in the Ready Queue);</title>
    </sec>
    <sec id="sec-7">
      <title>The completion of a job by a Processing Assembling machine (i.e., when the Third Framework of a CPS communicate the conclusion of an assigned task);</title>
    </sec>
    <sec id="sec-8">
      <title>A change in the Ready Queue subsequent to the job allocation to a particular CPS (i.e. when the Third Framework of a CPS communicate the complete acceptation of the received job);</title>
    </sec>
    <sec id="sec-9">
      <title>The completion of an item and the subsequent exit from the Ready Queue;</title>
    </sec>
    <sec id="sec-10">
      <title>A change in the system configuration, due to a not expected machine failure or due to the introduction of a repaired processing machine;</title>
    </sec>
    <sec id="sec-11">
      <title>A not compliant item to be reworked;</title>
      <p>In order to show the capabilities and the performance of the
introduced Scheduling Architecture, we conducted a real
simulation of the CPLS prototype under two different
decisionmaking logic, involving four different prototypes and four
different teams of workers. Each team was composed of seven
doctorates without any previous experience in these
manufacturing environments. The experiment was divided into
two phases: one is conducted with the CLS decision-making
logic while the other one with the introduced
SemiHeterarchical architecture. For every test, the quantity and the
typology of the released orders were fixed. However, in the
CLS round the ERP System released the detailed centrally
optimised Scheduling and Routing of every machine while, in
the Semi-Heterarchical round, the ERP released only the Jobs
to be produced in the Ready Queue, demanding to the System
of CPSs the definition of the detailed Scheduling and Routing
plan. To compare the performance of the experiments we
identified two parameters to be monitored: the lead time of
every job and the utilisation of every processing machines. In
our case, the lead time represents the time between the
introduction of the order in the ready queue and the exit
through the warehouse station. The machine utilisation,
instead, represents the fraction of time a workstation is not idle
for lack of parts. This includes the fraction of time the
workstation is working on parts and is unable to work on them
due to machine failure, setup or other detractors.</p>
      <p>Considering, in a first time, the lead time and, in a second time,
the machine utilisation as the response variable, we analysed
the appointed data through the ANalysis Of VAriance
(ANOVA) in order to show the significance of the architecture
choice on this parameters.</p>
      <p>Starting from the bottom of the ANOVA results for the
Production Lead Time response variable in [Fig. 7], the Error,
Iteration factor and the Experiment Iteration pass the null
hypothesis of the Fischer test, ensuring and confirming the
significance of the Industrial Architecture factor on the
Production Lead Time.
We may conclude, with a very high-level of confidence, that
the Semi-Heterarchical architecture decreases significantly
(about the 15 %) the Production Lead Time [Fig. 8].
Repeating the same ANOVA analysis for the Machine
Utilization response variable [Fig. 9], it is showed that the
significance of the Industrial Architecture factor is important
also for the Machine Utilization parameters.
Also in this case, the choice of a Semi-Heterarchical
architecture instead of a Full Hierarchical one shows a higher
Machine Utilization (about 20 %) of the processing machine,
independently of the machine typology [Fig. 10].</p>
      <p>The approach of the introduced architecture leads to a
mixture of proactive and reactive approach, taking advantage
of both the decentralised and the centralised approach. In this
sense, the resulting scheduling is more robust and resilient with
respect to the ones obtained with a full Hierarchical
architecture. The major contribution of the introduced
SemiHeterarchical structure is to be found in dividing the unique
scheduling problem of a typical job-shop into three simpler
scheduling problems, one for each introduced framework. In
this way, the ERP solves the first problem, with a universal but
approximate knowledge of the production system. Thanks to its
ability and feature, it is also able to interact with human
pursuing their strategic production vision, establishing the jobs
to be admitted in a sort of “Jobs Ready Queue” that will hold
all the order admitted to the production. The Sequencing and
the detailed Production Sequence, instead, is solved in a second
level, with the newly introduced System of CPSs: the new
integrated MES System of the plant. The major advantage of
this System of CPSs is the better knowing that every CPS has
of itself and of the production status. In fact, the rigidity of a
Full-Hierarchical architecture is represented by the limited
decision autonomy of the actual MES System (usually
consisting of simple rules to be executed and in a consumptive
role of the production progress). The last problem, instead, is
solved internally at the CPS and the machine itself. Only the
CPS knew the current state of a monitored machine, and it may
take the final decision on what tasks of the received jobs are
safe to be produced in tolerance by the machine. In the case it
may also reject only a sub-phase of the received jobs, putting
off to the “Jobs Ready Queue” the tasks it is not able to fulfil.
The introduced semi-Heterarchical architecture represents a
first attempt to face up to the NP-hard Job Shop Scheduling
Problem exploiting the opportunity of an Industry 4.0
environment. However, it represents only the framework
architecture without any practical algorithmic solution for the
different introduced framework. In this sense, it is necessary to
further investigate on this in order to establish the best heuristic
or rules to be applied in every framework. The research effort
must focus on the most important framework: the System of
CPSs in which a cooperation algorithm is needed. In this sense,
will be interesting to deepen the Cooperation Equilibrium
concepts of the Game-Theory, investigating in founding a
practical heuristic to solve the equilibrium problem. In the end,
also in the Third Framework (inside the CPS itself), a
prognostic algorithm is needed in order to estimate the current
and future state of the machine.</p>
      <p>Integration.”</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>M. Hermann</surname>
            , T. Pentek, and
            <given-names>B.</given-names>
          </string-name>
          <string-name>
            <surname>Otto</surname>
          </string-name>
          , “
          <article-title>Design principles for industrie 4.0 scenarios,”</article-title>
          <source>Proc. Annu. Hawaii Int. Conf. Syst. Sci.</source>
          , vol. 2016-March, no.
          <source>January</source>
          , pp.
          <fpage>3928</fpage>
          -
          <lpage>3937</lpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <given-names>M.</given-names>
            <surname>Riedl</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Zipper</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Meier</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Diedrich</surname>
          </string-name>
          , “
          <article-title>Cyber-physical systems alter automation architectures,”</article-title>
          <source>Annu. Rev. Control</source>
          , vol.
          <volume>38</volume>
          , no.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          1, pp.
          <fpage>123</fpage>
          -
          <lpage>133</lpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <given-names>A.</given-names>
            <surname>Cammardella</surname>
          </string-name>
          , G. Guizzi,
          <string-name>
            <given-names>S.</given-names>
            <surname>Vespoli</surname>
          </string-name>
          , and G. Visone, “
          <article-title>Man-CPS Interaction: an experimental assessment of the human behavior evolution,”</article-title>
          <source>in IEEE 3° Research and Technologies for Society and Industry</source>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <given-names>L.</given-names>
            <surname>Santillo</surname>
          </string-name>
          , G. Converso, and L. De Vito, “
          <article-title>The role of innovation in industrial development system. A simulation approach for sustainability of global supply chain network,” in 25th European Modeling and Simulation Symposium</article-title>
          ,
          <string-name>
            <surname>EMSS</surname>
          </string-name>
          <year>2013</year>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <source>“ANSI/ISA-95.00</source>
          .
          <fpage>06</fpage>
          -
          <lpage>2014</lpage>
          , Enterprise-Control
          <string-name>
            <surname>System</surname>
            <given-names>ANSI</given-names>
          </string-name>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <given-names>B.</given-names>
            <surname>Scholten</surname>
          </string-name>
          ,
          <article-title>The road to integration : a guide to applying the ISA-95 standard in manufacturing</article-title>
          .
          <source>ISA</source>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Ladenburg:</surname>
          </string-name>
          Springer-Verlag,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>S. L.</given-names>
            <surname>Janak</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            <surname>Lin</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C. A.</given-names>
            <surname>Floudas</surname>
          </string-name>
          , “
          <article-title>A new robust optimization approach for scheduling under uncertainty. II. Uncertainty with known probability distribution</article-title>
          ,
          <source>” Comput. Chem</source>
          . Eng., vol.
          <volume>31</volume>
          , no.
          <issue>3</issue>
          , pp.
          <fpage>171</fpage>
          -
          <lpage>195</lpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>S. V.</given-names>
            <surname>Mehta and R. M. Uzsoy</surname>
          </string-name>
          , “
          <article-title>Predictable scheduling of a job shop subject to breakdowns,”</article-title>
          <string-name>
            <given-names>Int. J.</given-names>
            <surname>Comput</surname>
          </string-name>
          . Integr. Manuf., vol.
          <volume>12</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>15</fpage>
          -
          <lpage>38</lpage>
          ,
          <year>1999</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>B.</given-names>
            <surname>Esmaeilian</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Behdad</surname>
          </string-name>
          , and
          <string-name>
            <given-names>B.</given-names>
            <surname>Wang</surname>
          </string-name>
          , “
          <article-title>The evolution and future of manufacturing: A review,”</article-title>
          <string-name>
            <given-names>J.</given-names>
            <surname>Manuf</surname>
          </string-name>
          . Syst., vol.
          <volume>39</volume>
          , pp.
          <fpage>79</fpage>
          -
          <lpage>100</lpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>R.</given-names>
            <surname>Revetria</surname>
          </string-name>
          , G. Guizzi, and
          <string-name>
            <given-names>P.</given-names>
            <surname>Giribone</surname>
          </string-name>
          , “
          <article-title>Renewable energy sources integrated with electric power supply in manufacturing companies: A management model</article-title>
          ,
          <source>” Int. J. Power Energy Syst.</source>
          , vol.
          <volume>35</volume>
          , no.
          <issue>4</issue>
          , pp.
          <fpage>161</fpage>
          -
          <lpage>166</lpage>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>E.</given-names>
            <surname>Romano</surname>
          </string-name>
          , G. Guizzi, and
          <string-name>
            <given-names>D.</given-names>
            <surname>Chiocca</surname>
          </string-name>
          , “
          <article-title>A decision support tool, implemented in a system dynamics model, to improve the effectiveness in the hospital emergency department,”</article-title>
          <string-name>
            <given-names>Int. J.</given-names>
            <surname>Procure</surname>
          </string-name>
          . Manag., vol.
          <volume>8</volume>
          , no.
          <issue>1</issue>
          /2, pp.
          <fpage>141</fpage>
          -
          <lpage>168</lpage>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>E.</given-names>
            <surname>Bottani</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Cammardella</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Murino</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Vespoli</surname>
          </string-name>
          , “
          <article-title>From the Cyber-Physical System to the Digital Twin: the process development for behaviour modelling of a Cyber Guided Vehicle in M2M logic,” in XXII Summer School</article-title>
          “Francesco Turco” - Industrial Systems Engineering,
          <year>2017</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>7</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>B.</given-names>
            <surname>Esmaeilian</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Behdad</surname>
          </string-name>
          , and
          <string-name>
            <given-names>B.</given-names>
            <surname>Wang</surname>
          </string-name>
          , “
          <article-title>The evolution and future of manufacturing: A review,”</article-title>
          <string-name>
            <given-names>J.</given-names>
            <surname>Manuf</surname>
          </string-name>
          . Syst., vol.
          <volume>39</volume>
          , pp.
          <fpage>79</fpage>
          -
          <lpage>100</lpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>S. C.</given-names>
            <surname>Graves</surname>
          </string-name>
          , “
          <article-title>A review of production scheduling: Theory and Practice</article-title>
          ,” Cambridge, Massachusetts,
          <year>1979</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [21]
          <string-name>
            <surname>I. Ribas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Leisten</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J. M.</given-names>
            <surname>Framiñan</surname>
          </string-name>
          , “
          <article-title>Review and classification of hybrid flow shop scheduling problems from a production system and a solutions procedure perspective</article-title>
          ,
          <source>” Comput. Oper. Res.</source>
          , vol.
          <volume>37</volume>
          , no.
          <issue>8</issue>
          , pp.
          <fpage>1439</fpage>
          -
          <lpage>1454</lpage>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>R.</given-names>
            <surname>Chiarvetto</surname>
          </string-name>
          et al.,
          <article-title>“An innovative approach for rolling mill and forge scheduling based on modified COTS algorithms</article-title>
          ,” in
          <source>Frontiers in Artificial Intelligence and Applications</source>
          ,
          <year>2017</year>
          , pp.
          <fpage>616</fpage>
          -
          <lpage>627</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>P.</given-names>
            <surname>Centobelli</surname>
          </string-name>
          , G. Converso,
          <string-name>
            <given-names>T.</given-names>
            <surname>Murino</surname>
          </string-name>
          , and
          <string-name>
            <given-names>L. C.</given-names>
            <surname>Santillo</surname>
          </string-name>
          , “
          <article-title>Flow shop scheduling algorithm to optimize warehouse activities</article-title>
          ,
          <source>” Int. J. Ind. Eng. Comput.</source>
          , vol.
          <volume>7</volume>
          , no.
          <issue>1</issue>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>S.</given-names>
            <surname>Albers</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Hellwig</surname>
          </string-name>
          , “
          <article-title>Semi-online scheduling revisited</article-title>
          ,
          <source>” Theor. Comput. Sci.</source>
          , vol.
          <volume>443</volume>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>9</lpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>J.</given-names>
            <surname>Kuhpfahl</surname>
          </string-name>
          and
          <string-name>
            <given-names>C.</given-names>
            <surname>Bierwirth</surname>
          </string-name>
          , “
          <article-title>A study on local search neighborhoods for the job shop scheduling problem with total weighted tardiness objective</article-title>
          ,
          <source>” Comput. Oper. Res.</source>
          , vol.
          <volume>66</volume>
          , pp.
          <fpage>44</fpage>
          -
          <lpage>57</lpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>J.</given-names>
            <surname>Zhang</surname>
          </string-name>
          , G. Ding,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Zou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Qin</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Fu</surname>
          </string-name>
          , “
          <article-title>Review of job shop scheduling research and its new perspectives under Industry 4</article-title>
          .0,
          <string-name>
            <surname>”</surname>
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Intell</surname>
          </string-name>
          . Manuf.,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>A.</given-names>
            <surname>Silberschatz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. B.</given-names>
            <surname>Galvin</surname>
          </string-name>
          , and
          <string-name>
            <surname>G.</surname>
          </string-name>
          <article-title>Gagne, Operating system concepts</article-title>
          .
          <source>J</source>
          . Wiley &amp; Sons,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [8]
          <string-name>
            <surname>I. Harjunkoski</surname>
          </string-name>
          and
          <string-name>
            <given-names>R.</given-names>
            <surname>Bauer</surname>
          </string-name>
          , “
          <article-title>Industrial scheduling solution based on flexible heuristics,”</article-title>
          <string-name>
            <surname>Comput. Chem. Eng.</surname>
          </string-name>
          , vol.
          <volume>106</volume>
          , pp.
          <fpage>883</fpage>
          -
          <lpage>891</lpage>
          , Nov.
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          2016
          <string-name>
            <given-names>Winter</given-names>
            <surname>Simul</surname>
          </string-name>
          . Conf., no.
          <source>December</source>
          <year>2016</year>
          , pp.
          <fpage>2820</fpage>
          -
          <lpage>2831</lpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>C.</given-names>
            <surname>Cerbaso</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Silvestri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. Di</given-names>
            <surname>Bona</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Forcina</surname>
          </string-name>
          and
          <string-name>
            <given-names>D.</given-names>
            <surname>Falcone</surname>
          </string-name>
          , “
          <article-title>Assembly line balancing, proposal of a new methodology: Integrated balacing method”</article-title>
          ,
          <source>International Journal of Services and Operations Management</source>
          , vol.
          <volume>27</volume>
          , no.
          <issue>3</issue>
          , pp.
          <fpage>408</fpage>
          -
          <lpage>437</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>D.</given-names>
            <surname>Falcone</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Silvestri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Cerbaso</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. Di</given-names>
            <surname>Bona</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Forcina</surname>
          </string-name>
          , “
          <article-title>An integrated approach for assembly line balancing problems”</article-title>
          ,
          <source>in Proceedings of the IASTED International Symposium on Software Engineering and Applications</source>
          ,
          <string-name>
            <surname>SEA</surname>
          </string-name>
          <year>2015</year>
          , pp.
          <fpage>70</fpage>
          -
          <lpage>77</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>E. J.</given-names>
            <surname>Umble</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. R.</given-names>
            <surname>Haft</surname>
          </string-name>
          , and
          <string-name>
            <surname>M. M. Umble</surname>
          </string-name>
          , “
          <article-title>Enterprise resource planning: Implementation procedures and critical success factors</article-title>
          ,
          <source>” Eur. J. Oper. Res.</source>
          , vol.
          <volume>146</volume>
          , pp.
          <fpage>241</fpage>
          -
          <lpage>257</lpage>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>