<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Influence of information technologies on the human factors in aviation</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Olena Kozhokhina</string-name>
          <email>kozhokhina@gmail.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Svitlana Pavlova</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Liudmyla Blahaia</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Olga Shcherbyna</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Svyatoslav Yutskevych</string-name>
          <email>yuts@gmail.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Viktor Luzhbin</string-name>
          <email>v.luzhbin@i.ua</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>National Aviation University</institution>
          ,
          <addr-line>Luibomyra Huzara ave., 1, Kyiv, 03058</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Human factors' role in aviation is crucial for ensuring the safe and efficient integration of technology with humans. This is of utmost importance, especially given the rapid development and widespread use of information technologies. Studies have revealed that detecting and addressing mistakes made by maintenance personnel can be particularly difficult and their effects may remain unnoticed, compared to other threats to aviation safety. The purpose of this paper is to investigate the impact of information technologies on human factors in aviation, particularly in the context of maintenance. After an analysis of literature and incident statistics, the distinct human factors concern in aviation maintenance has been brought to attention. The results indicate that one of the most critical criteria is a tight limitation of time and rush. On this basis, it is recommended to update current approaches and models for the reliability estimation of aviation staff or create new ones. Further research is needed to determine the most critical quality-relevant factors and the lasting influence of information technologies on aviation personnel.</p>
      </abstract>
      <kwd-group>
        <kwd>1 Informational technologies</kwd>
        <kwd>aviation safety and security</kwd>
        <kwd>human factors</kwd>
        <kwd>reliability</kwd>
        <kwd>maintenance</kwd>
        <kwd>errors</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>The primary goal of civil aviation is to guarantee the safety and consistency of aircraft operations.
Human factors and performance impact every aspect of safety. It is crucial to understand that addressing
human factors leads to safety enhancements across all safety-related concerns. With the rapid
advancement of information technology in aviation, this problem has become even more critical.
Information technology (IT) has spread faster than most other technologies in modern times, leading to
numerous human factors issues in aircraft operations that still require solutions.</p>
      <p>It should be noted that for decades, one of the most popular ideas in aviation reports and literature
is the idea that human factor means pilot errors. It's crucial to prioritize human performance for aviation
safety. This means taking an integrated approach that considers equipment and system design,
procedures, training, and competency, while also acknowledging the impact of rapidly advancing
technology.</p>
      <p>
        Ensuring proper maintenance is crucial for aviation safety. Unfortunately, aviation accidents and
incidents often occur due to improper maintenance, which can result from human errors. These may
include incorrectly installed parts, missing components, and neglected checks. While the exact numbers
are unknown, most maintenance errors are likely minor. However, a small percentage of these errors
can pose serious safety risks. Unlike other aviation safety threats, detecting maintenance personnel
mistakes can be difficult, and their effects can remain hidden, potentially compromising the safety of
aircraft for extended periods. [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]
      </p>
      <p>Sometimes, maintenance responsibilities can be overly detailed and not specific enough, which can
result in errors under certain circumstances. Aviation maintenance engineers often operate pressed on
time due to the importance of flight schedules. The carriers continuously increase the usage rate of
aircraft to cope with the economic difficulties in the aviation industry.</p>
      <p>So, the significant advancements in information technology are that they can unload aviation staff
and better manage their work. On the other hand, IT has its negative points as well. They can lead to a
loss of vigilance, and responsibility and a decrease in attention of staff during aircraft operation.</p>
      <p>A challenging problem that arises in this domain is that aircraft reliability and aviation safety are
based on the operational efficiency of aircraft maintenance engineers and their ability to perform
responsibility on time, error-free, and accurately.</p>
      <p>An analysis of current approaches and methods of human-operator reliability prediction and research
of operational aspects of aviation maintenance engineer tasks have detected a range of common factors
in engineer activities. Users can assess their dependability and identify the significant quality-related
aspects, along with the impact of information technologies on them.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Literature review</title>
      <p>Previous studies for a human-operator reliability estimation were traditionally related to the flight
crew activity and, to a lesser degree, to air traffic controller (ATC) activities.</p>
      <p>In the past, there has been a lot of confusion in written works about how trustworthy maintenance
engineers are. It is a significant deficiency since it is quite understandable that human error during the
maintenance of an aircraft is as critical to flight safety as well as mistakes of pilots or air traffic
controllers.</p>
      <p>
        Regrettably, the majority of current reliability prediction practices for human operators are primarily
associated with industries such as atomic energy or chemistry. Some of these practices include:
 A Technique for Human Error Rate Prediction (THERP) [34];
 Accident Sequence Evaluation Program (ASEP) [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ];
 Human Error Assessment and Reduction Technique (HEART) [
        <xref ref-type="bibr" rid="ref3 ref4 ref5 ref6">3, 4, 5, 6, 27</xref>
        ];
 A Technique for Human Event Analysis (ATHEANA) [
        <xref ref-type="bibr" rid="ref7 ref8">7, 8</xref>
        ];
 Cognitive Reliability and Error Analysis Method (CREAM) [
        <xref ref-type="bibr" rid="ref9">9, 26</xref>
        ];
 Absolute Probability Judgements (APJ) [
        <xref ref-type="bibr" rid="ref10 ref11">10, 11</xref>
        ];
 Human Reliability Management System (HRMS) [
        <xref ref-type="bibr" rid="ref12 ref13 ref14">12, 13, 14</xref>
        ];
 Conclusions from Occurrences by Descriptions of Actions (CODA) [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ].
      </p>
      <p>It's important to recognize that some practices related to aviation maintenance fail to consider the
unique aspects of the industry and the critical factors that impact maintenance personnel. However,
there have been efforts to update certain practices to better suit the aviation industry's needs, such as
the adaptation of Connectionism Assessment of Human Reliability (CAHR) for ATC tasks in
EUROCONTROL. In some instances, accidents in other industries, like the nuclear industry, have been
compared to aviation incidents.</p>
      <p>Furthermore, there are techniques that concentrate on investigating particular aspects of the human
operator in the aviation industry. The study of maintenance engineer reliability is a continuous process,
with earlier research serving as a basis for more comprehensive comprehension. In collaboration with
the International Air Transport Association (IATA), the Human Factors Research Project at the
University of Texas in Austin established the Threat and Error Management (TEM) framework. This
framework enables the evaluation of data from regular and anomalous operations (as demonstrated in
Fig. 1), with a primary emphasis on pilot behavior.</p>
      <p>However, Boeing Commercial Aviation Services has developed the Maintenance Error Decision
Aid (MEDA) process, which investigates events caused by maintenance technicians and inspector
performance. Recently, MEDA has been referred to as an "event" investigation process rather than an
"error" investigation process, as events can involve both errors and noncompliance with regulations,
policies, processes, and procedures.</p>
      <p>One effective approach to address maintenance tasks is through decomposition or structuring. An
example of this is the SLIM-MAUD Success likelihood index method, which utilizes multi-attribute
utility decomposition and can be tailored to specific maintenance needs [17].</p>
      <p>Moreover, other reliability models and practices used the techniques of structural decomposition of
operator activity [18, 19]. However, such an approach requires a detailed study and grouping of factors
having an impact on the reliability of maintenance engineers. Additional studies to understand more
completely the critical tenets of the reliability of maintenance engineers are required.</p>
    </sec>
    <sec id="sec-3">
      <title>3. Problem statement</title>
      <p>There is a growing awareness of the importance of taking into account the reliability of a human
operator in the maintenance and inspection of aviation systems. Statistical analysis performed by IATA
[33] shows that approximately 10% of all aviation accidents are caused by maintenance events (Fig. 3).</p>
      <p>Safety and efficiency of flights also become more directly related to the operating quality of people
who check and maintain aircraft fleets of airlines, remotely piloted aviation systems (RPAS), and others.</p>
      <p>The reliability estimation of aviation maintenance engineers can be a probabilistic estimate of the
successful completion of an operation or set of tasks at a given stage of system operation during a
specific time interval (Fig. 4).
Unfortunately, current practices, which is used in reliability, ergonomics, engineering psychology,
aviation psychology, aviation medicine, and other areas, do not make it possible in full evaluate the
efficiency and reliability of manned and remotely piloted aircraft systems maintenance engineer, as well
as his impact on the reliability of aviation systems and flight safety.</p>
      <p>The findings mentioned above, signal the need for additional studies to understand more about the
reliability prediction of aviation maintenance staff and its vital importance for fight safety, and
determine the problem statement, purpose, and objectives of the research.</p>
    </sec>
    <sec id="sec-4">
      <title>4. Approach for assessment of aircraft maintenance engineer errors or events</title>
      <p>The most critical factor that is emphasizing the necessity of the reliability prediction of an aircraft
maintenance engineer is that the simulation allows a better understanding of the causes of errors
occurring for various human operators in different conditions and the relationship between these causes.
In addition, to identify the most critical task for the aircraft maintenance engineer, which caused the
most significant flow of errors.</p>
      <p>The obtained results and data can be used for advanced professional training of aircraft maintenance
engineers. Reduce the probability of error, as well as for taking into account human error during
reliability prediction for any aviation systems.</p>
      <p>When evaluating the reliability of an operator, the probability of error-free operation is a crucial
factor, similar to how the probability of successful operation is vital in assessing technical systems'
reliability. The probability of error-free operation, represented by R(t), indicates the operator's
consistent performance during their duty cycle.</p>
      <p>  - t   2     t  (1)</p>
      <p>R(t)  Ф     t  - exp 2  Ф     t 
where α is the average time of operation of aviation engineer to the first error, β is the coefficient of
variation of aviation engineer to error, Ф(•) is an integral Laplace function.</p>
      <p>The reliability of an aircraft maintenance engineer refers to the likelihood of successfully completing
a task at a certain system operating step within a specified time interval [20]. To maintain reliable
operation, it is essential to maintain a predetermined level of accuracy in the engineer's activities over
an extended period. Therefore, the reliability of a human operator can be defined as their ability to
maintain necessary operating qualities even under challenging operational circumstances.</p>
      <p>Nowadays, it has become necessary to evaluate the reliability of human operators not just based on
the outcome of their tasks but also on their psychological and physiological indicators [21].</p>
      <p>Knowing the functional of operating procedure, regularity and mechanisms of the behaviour of a
human operator and state in special conditions allows not only to assess the level of reliability but also
to justify recommendations for keeping reliability at the required level. An error of a maintenance
engineer can occur in the following cases see Fig. 5 [22].</p>
    </sec>
    <sec id="sec-5">
      <title>5. Maintenance-related events</title>
      <p>Aviation maintenance employs two error-reducing systems - the Air Proactive Error Reduction
System (PERS) and the Maintenance Error Decision Aid (MEDA). MEDA is a byproduct of human
reliability analysis and is used to analyze maintenance incidents. The system identifies Performance
Shaping Factors (PSFs) that describe situational variables affecting error likelihood, such as insufficient
training or adverse weather conditions. These factors are based on common errors observed in
maintenance and are utilized to minimize such errors (refer to Fig. 6).</p>
      <p>According to IATA's report from 2014 to 2018, the primary causes of errors were related to Manual
Handling/Flight Controls, Standard Operating Procedures (SOPs) Adherence/Cross Verification, and
Callouts [33]. Maintenance operations suffered from various breakdowns due to non-compliance with
SOPs, operational instructions, company policies, regulations, and controls for evaluating compliance
with regulations and SOPs. These breakdowns include deficiencies in technical documentation,
unrecorded maintenance, and the use of unauthorized parts or modifications.</p>
      <p>In the realm of training systems, various factors were overlooked, such as inadequate language skills
of maintenance crews, deficient qualifications and experience, training cutbacks in response to
operational needs, and flaws in training assessment, including the quality of training manuals or CBT
devices. In a concerning 12% of accidents, maintenance events were identified as a contributing factor,
and tragically, one fatal incident occurred during 2014-2018. Specifically, a Boeing B737-800 lost
altitude shortly after take-off, ultimately crashing into the sea, resulting in the loss of the aircraft and
189 lives.</p>
      <p>The aforementioned statistics highlight incidents where there were deficiencies in maintenance
activities, checking and training, and standard operating procedures at an organizational level, also
known as latent conditions.</p>
      <p>Recent data [33] indicates that maintenance operations are a major cause of accidents. The study
found that SOPs and checking were responsible for 10% of all accidents and 14% of fatal accidents,
while training systems accounted for 2% of all accidents and 14% of fatal accidents. Moreover, aviation
authorities have reported several trends that suggest errors or events caused by maintenance staff can
be attributed to factors such as low staff qualifications, unsatisfactory operating procedures, adverse
working conditions, lack of incentives, high information overload, and poor physical condition. These
error causes can be classified into four types: functional, operational, information, and professional
[19].</p>
      <p>To undertake the analysis using the data collected above operational reliability of the aviation
maintenance engineer and its features was considered.</p>
    </sec>
    <sec id="sec-6">
      <title>6. The operational reliability of maintenance engineer of aircraft systems.</title>
    </sec>
    <sec id="sec-7">
      <title>Unique human factors issue in aviation maintenance</title>
      <p>Maintaining the working capacity under standard conditions in a specified period is referred to as
operational reliability. In the commercial airline industry, a maintenance error investigation process that
follows the performance contributing factor concept can be effective. However, implementing this
process requires a strong commitment from management.</p>
      <p>Maintenance technicians work in an inherently risky environment, making their job one of the most
hazardous in the labor force. They may work at great heights, in cramped spaces, and under extreme
temperatures. The job is physically demanding but also requires strong organizational skills and
attention to detail. It is common for maintenance technicians to spend more time preparing for a task
than actually performing it, as shown in Figure 7.</p>
      <p>In addition to such factors as climate and temperature, lighting, noise, and vapor, which have a direct
impact on the human operator, it is also necessary to identify some factors that to a considerable degree
hinder the operation process. Among them may be alcohol and drugs, which can lead to changes in the
behavior of the aircraft maintenance engineer.</p>
      <p>It should also be noted that medical drug intake might cause sleep mood or other changes and adverse
effects on aircraft maintenance engineer conditions. That is why it is not recommended to use new
medicines 24 hours before a shift.</p>
      <p>Among the factors that contribute to a significant decrease in the attention of aircraft maintenance
engineers should be highlighted overload and underload, along with sleep disturbance, fatigue, and
stress.</p>
      <p>Climate and temperature
affect productivity. Besides, at
low temperatures the sensitivity</p>
      <p>of fingers are decreases
Effluvium from fuels and
lubricants as well as paints,
solvents and combustible gas,
may cause poisoning by
inhalation and mucous
membrane irritation</p>
      <p>Fitness and health
need to be under normal
conditions to ensure the
efficiency of maintenance</p>
      <p>engineer</p>
      <p>A variable work schedules
can cause disturbances in sleep
patterns, loss of attention and</p>
      <p>concentration
A medical drug may cause
sleep mood or other changes
in the maintenance engineer
condition. Unknown drugs
should not be taken 24 hours
before a shift</p>
      <p>Stress can be physical,
psychological or social. May
cause a decrease in efficiency and
deterioration
of health
Operation
factors
acting on
maintenance</p>
      <p>engineer
Noise may result in missing
information as well as damage
hearing organ</p>
      <p>Overload and underload</p>
      <p>leads to a lapse of
concentration and task
skipping</p>
      <p>Lighting
should be sufficient to avoid
skips during maintenance
Rush and limitation of time</p>
      <p>leads to task skipping
Sleep disturbance and fatigue</p>
      <p>are reducing
working capacity</p>
      <p>Alcohol acts as a depressant
dulls the senses and increases the</p>
      <p>reaction time
Drugs affect the ability to</p>
      <p>concentrate, remember
information and make decision</p>
      <p>Climate and temperature
affect productivity. Besides, at
low temperature the sensitivity
of the fingers are decreases</p>
      <p>Nevertheless, one of the most critical criteria is still a tight limitation of time and rush. They are
especially critical due to IT spread usage increases. An aircraft maintenance engineer often needs to
decide quickly whether a particular defect or failure is vital, or whether the aircraft can fly with it. When
making such a decision, every minute is essential, since an idle aircraft cost the airline money.
Sometimes, external pressures can lead to mistakes and incorrect decisions. This can be particularly
risky in the aviation industry, where such errors can result in incidents or accidents.</p>
    </sec>
    <sec id="sec-8">
      <title>7. Safety culture</title>
      <p>The SHELL model is utilized by ICAO to depict the key elements of human factors. The SCHELL
model is an enhanced version of this, with the addition of component C that represents culture
encompassing the influence of organizational and national cultures on interactions.</p>
      <p>The safety culture of airlines is influenced by a combination of personal and collective values,
attitudes, perceptions, competencies, and behavior patterns. These factors can impact an organization's
level of dedication, approach, and effectiveness in maintaining a health and safety management system.
A research report by the UK Health and Safety Executive examined safety culture and climate literature
and found that there are three interconnected components to safety culture, as depicted in Figure 8.</p>
      <p>To exemplify the strong connection between safety culture and flight safety, it is fitting to quote
James Reason who stated that airlines operate under similar conditions, using almost identical types of
aircraft, and with flight crews, air traffic controllers, and aircraft maintenance engineers all trained and
licensed to comparable standards.</p>
      <p>However, in 1995, the risk to passengers, estimated as the probability of being involved in an
aviation accident with at least one fatal outcome and calculated for 42 airlines around the world, differed
many times: from 1 chance to 260 000 in the worst cases to 1 chance of 11 million in the best cases. Of
course, factors such as government resources or resources of a particular company play a certain role,
but there is no doubt that differences in safety culture contributed the lion’s share to this enormous
spread’ [30].</p>
      <p>That is why it is so essential to research the above listed (Fig. 7, Fig.8) and not only the impact
factors in each maintenance organization that will help identify problems systematically in the safety
culture of airlines that reduce the reliability of the aircraft maintenance engineer.</p>
      <p>There are two groups of expert assessments:
 Individual estimates are based on using the opinions of individual experts, independent of each
other.
 Collective assessments are based on the use of collective expert opinion.</p>
      <p>Joint opinion has higher accuracy than the individual view of each of the specialists. This method is
used to obtain quantitative estimates of the quality characteristics and properties.</p>
      <p>After studying the trends in required quality level reduction, it was determined that maintenance
technicians do not intentionally make mistakes. Rather, errors are often the result of multiple
contributing factors, many of which can be managed by management. This approach to understanding
errors could also be applied to investigating fabrication, assembly, and operational errors in other areas.</p>
    </sec>
    <sec id="sec-9">
      <title>8. Conclusion</title>
      <p>This article discusses the impact of information technologies on the human element in aviation. With
the rapid advancement of these technologies in all aspects of aviation, this issue has become
increasingly relevant. Proper implementation of these technologies can result in improved safety levels,
airline safety culture, and flight frequency. Conducted analysis of factors affecting the reliability of
maintenance personnel can be used to draw up a chart of the risks of human factors during aircraft
maintenance with taking into account IT effects. It should be pointed out that significant advancements
in IT are that they can unload aviation staff and better manage their work. On the other hand, IT has its
negative points as well. They can lead to a loss of vigilance, and responsibility and a decrease in
attention of staff during aircraft operation. Considering all, the research results can be used to create or
update the current methodological basis during the design and modernization of aircraft operating
systems and for keeping aviation safety and air-line safety culture at the required level.</p>
    </sec>
    <sec id="sec-10">
      <title>9. References</title>
      <p>[17] O. Sträter, The use of incidents for human reliability management, Safety &amp; Reliability 26(2)
(2996) 26–47.
[18] D. E. Embrey, P. Humphreys, E. A. Rosa, B. Kirwan, K. Rea, SLIM-MAUD: An approach to
assessing human error probabilities using structured expert judgment, Volume I: Overview of
SLIM-MAUD. NUREG/CR-3518. Prepared for the US NRC, 1984.
[19] O. Kozhokhina, V. Gribov, S. Rudas, Analytical model of air navigation system operator
reliability, in: Proceedings of the IEEE 3rd International Conference on Methods and System of
Navigation and Motion Control (MSNMC), Kyiv, 2014, pp. 170–174.
[20] O. Kozhokhina, V. Gribov, S. Rudas, Structural reliability of air traffic controllers, Proceedings of
the National Aviation University 4(61) (2014) 50–56.
[21] E. A. Alluisi, B. B. Morgan Jr, Engineering psychology and human performance, Annual review
of psychology 27(1) (1976) 305–330.
[22] O. V. Kozhokhina, S. V.Khodzytska, I. C. Porkhun, Assessment of the reliability of air traffic
controllers, in: Problems of development of the global system of communication, navigation,
observation and organization of air traffic CNS/ATM, Kyiv, 2012, p. 108.
[23] T. Shmelova, Y. Sikirda, N. Rizun, V. Lazorenko, V. Kharchenko, Machine learning and text
analysis in an artificial intelligent system for the training of air traffic controllers, Research
Anthology on Reliability and Safety in Aviation Systems, Spacecraft, and Air Transport (2021)
237–286.
[24] J. Bell, J. Holroyd, Review of human reliability assessment methods, Health and Safety Executive,
2009, pp. 1–90.
[25] M. Alvarenga, E. Frutuoso, R. Fonseca, A critical review of methods and models for evaluating
organizational factors in human reliability analysis, Prog Nucl Energy 75 (2014) 25–41.
[26] N. Mitomo, A. Hashimoto, K. Homma, An example of an accident analysis of aircrafts based on
human reliability analysis method, in: Proceedings of the 4-th International conference on
informatics, electronics and vision, 2005, pp.15–18.
[27] Y. Lin, X. Pan, C. He, Human reliability analysis in carrier-based aircraft recovery procedure based
on CREAM, in: Proceedings of International conference on reliability systems engineering, ICRSE
2015, pp. 1–6.
[28] R. Maguire, Validating a process for understanding human error probabilities in complex human
computer interfaces, in: Proceedings of the Workshop on complexity in design, 2005, pp. 81–89.
[29] W. Chen, S. Huang, Human reliability analysis for visual inspection in aviation maintenance by a</p>
      <p>Bayesian network approach, Transp Res Rec 2449 (2014) 105–113.
[30] A. Siddiqui, M. Ben-Daya, Reliability centered maintenance, Handbook of maintenance
management and engineering, Springer, London, 2009, pp. 397–415.
[31] J. Reason, Managing the Risks of Organizational Accidents, Routledge, 2016.
[32] Z. Avkurova, S. Gnatyuk, B. Abduraimova, S. Fedushko, Y. Syerov, and O. Trach, Models for
early web-attacks detection and intruders identification based on fuzzy logic. Procedia Computer
Science,198, 2022, 694–699. https://doi.org/10.1016/j.procs.2021.12.308.
[33] Safety Report 2018, 55th Edition, International Air Transport Association, 2019.
[34] A. D. Swain, H. E. Guttmann, A handbook of human reliability analysis with emphasis on nuclear
power plant applications, NUREG/CR-1278, USNRC, Washington DC, 1983.
[35] Maintenance Error Decision Aid (MEDA), Boeing Commercial Aviation Services, 2013.
[36] C. G. Drury, M. R. Murthy, C. L. Wenner, A proactive error reduction system, in: Proceedings of
the 11th Federal Aviation Administration Meeting on Human Factors Issues in Aircraft
Maintenance and Inspection: Human error in aviation maintenance, Washington, DC, 1997, pp.
91–103.
[37] W. L. Rankin, Maintenance Error Decision Aid: Progress report, in: Proceedings of the 11th
Federal Aviation Administration Meeting on Human Factors Issues in Aircraft Maintenance and
Inspection: Human error in aviation maintenance, Washington, DC, 1997, pp. 13–18.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>A.</given-names>
            <surname>Hobbs</surname>
          </string-name>
          ,
          <article-title>An overview of human factors in aviation maintenance</article-title>
          ,
          <source>ATSB Safty Report, Aviation Research and Analysis Report AR 55</source>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>A. D.</given-names>
            <surname>Swain</surname>
          </string-name>
          ,
          <article-title>Accident sequence evaluation program: Human reliability analysis procedure (No</article-title>
          . NUREG/CR-4772; SAND-86-
          <year>1996</year>
          ).
          <article-title>Sandia National Lab. (SNL-NM), Albuquerque</article-title>
          ,
          <string-name>
            <surname>NM</surname>
          </string-name>
          (United States); NRC, Washington, DC.
          <source>Office of Nuclear Regulatory Research</source>
          ,
          <year>1987</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>J. C.</given-names>
            <surname>Williams</surname>
          </string-name>
          ,
          <article-title>HEART - a proposed method for achieving high reliability in process operation by means of human factors engineering technology</article-title>
          ,
          <source>Safety and Reliability</source>
          <volume>35</volume>
          (
          <issue>3</issue>
          ) (
          <year>2015</year>
          )
          <fpage>5</fpage>
          -
          <lpage>25</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>J. C.</given-names>
            <surname>Williams</surname>
          </string-name>
          ,,
          <article-title>A proposed method for assessing and reducing human error</article-title>
          ,
          <source>in: Proceedings of the 9th Advances in Reliability Technology Symp, Univ. of Bradford</source>
          , Bradford,
          <year>1986</year>
          , pp.
          <fpage>B3</fpage>
          /R/1 -
          <lpage>B3</lpage>
          /R/13.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>J. C.</given-names>
            <surname>Williams</surname>
          </string-name>
          ,
          <article-title>A data-based method for assessing and reducing human error to improve operational performance</article-title>
          ,
          <source>in: Conference Record for IEEE Fourth Conference on Human Factors and Power Plants</source>
          ,
          <year>1988</year>
          , pp.
          <fpage>436</fpage>
          -
          <lpage>450</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>J. C.</given-names>
            <surname>Williams</surname>
          </string-name>
          ,
          <article-title>Validation of human reliability assessment techniques</article-title>
          ,
          <source>Reliability Engineering</source>
          <volume>11</volume>
          (
          <issue>3</issue>
          ) (
          <year>1985</year>
          )
          <fpage>149</fpage>
          -
          <lpage>162</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>J.</given-names>
            <surname>Williams</surname>
          </string-name>
          ,
          <article-title>Toward an improved evaluation analysis tool for users of HEART</article-title>
          . in: International Conference on Hazard Identification and
          <string-name>
            <given-names>Risk</given-names>
            <surname>Analysis</surname>
          </string-name>
          ,
          <source>Human Factors and Human Reliability in Process Safety</source>
          ,
          <year>1992</year>
          , pp.
          <fpage>261</fpage>
          -
          <lpage>280</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>A</given-names>
            <surname>Technique for Human Event Analysis (ATHEANA) - Technical Basis</surname>
          </string-name>
          and
          <string-name>
            <given-names>Methodological</given-names>
            <surname>Description</surname>
          </string-name>
          . NUREG/CR-6350. U.S. Nuclear Regulatory Commission, NY,
          <year>1996</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>Technical</given-names>
            <surname>Basis</surname>
          </string-name>
          and
          <article-title>Implementation Guidelines for a Technique for Human Event Analysis (ATHEANA)</article-title>
          .
          <source>NUREG-1624, Division of Risk Analysis and Applications. Office of Nuclear Regulatory Research</source>
          , US NRC,
          <string-name>
            <surname>Washington</surname>
            <given-names>DC</given-names>
          </string-name>
          ,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>E.</given-names>
            <surname>Hollnagel</surname>
          </string-name>
          ,
          <source>Human Reliability Analysis: Context and Control</source>
          ,
          <year>1993</year>
          , pp.
          <fpage>159</fpage>
          -
          <lpage>202</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>B.</given-names>
            <surname>Kirwan</surname>
          </string-name>
          ,
          <article-title>A comparative evaluation of five human reliability assessment techniques, in: Human Factors and Decision Making: Their influence on safety and reliability</article-title>
          , Elsevier, London,
          <year>1988</year>
          , pp.
          <fpage>87</fpage>
          -
          <lpage>109</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>D. E.</given-names>
            <surname>Embrey</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Kirwan</surname>
          </string-name>
          ,
          <article-title>A comparative evaluation of three subjective human reliability quantification techniques</article-title>
          ,
          <source>in: Annual Ergonomics Society Conference Proceedings, Taylor and Francis</source>
          , London,
          <year>1983</year>
          , pp.
          <fpage>137</fpage>
          -
          <lpage>142</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>B.</given-names>
            <surname>Kirwan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. J.</given-names>
            <surname>James</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A Human</given-names>
            <surname>Reliability Management System</surname>
          </string-name>
          ,
          <source>Reliability</source>
          <volume>89</volume>
          (
          <year>1989</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>B.</given-names>
            <surname>Kirwan</surname>
          </string-name>
          ,
          <article-title>A resources flexible approach to human reliability assessment for PRA</article-title>
          , in: Safety and
          <string-name>
            <given-names>Reliability</given-names>
            <surname>Symposium</surname>
          </string-name>
          , Elsevier Applied Sciences,
          <year>1990</year>
          , pp.
          <fpage>114</fpage>
          -
          <lpage>135</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>B.</given-names>
            <surname>Kirwan</surname>
          </string-name>
          ,
          <article-title>A guide to practical human reliability assessment</article-title>
          , Taylor &amp; Francis, London,
          <year>1994</year>
          ,
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>B.</given-names>
            <surname>Reer</surname>
          </string-name>
          ,
          <article-title>Conclusions from Occurrences by Descriptions of Actions (CODA), New Risk Frontiers, in: Annual Meeting of the Society for Risk Analysis-</article-title>
          <string-name>
            <surname>Europe</surname>
          </string-name>
          , Stockholm,
          <year>1997</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>