<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Control and Feedback to Reduce Mode Confusion in the Cockpit</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Romane Dubus</string-name>
          <email>romane.dubus@lisn.fr</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
          <xref ref-type="aff" rid="aff3">3</xref>
          <xref ref-type="aff" rid="aff4">4</xref>
          <xref ref-type="aff" rid="aff5">5</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Anke M. Brock</string-name>
          <email>anke.brock@enac.fr</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff3">3</xref>
          <xref ref-type="aff" rid="aff4">4</xref>
          <xref ref-type="aff" rid="aff5">5</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Wendy E. Mackay</string-name>
          <email>mackay@lri.fr</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
          <xref ref-type="aff" rid="aff3">3</xref>
          <xref ref-type="aff" rid="aff4">4</xref>
          <xref ref-type="aff" rid="aff5">5</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>AutomationXP23: Intervening</institution>
          ,
          <addr-line>Teaming, Delegating - Creating Engag-</addr-line>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>ENAC, Université Toulouse</institution>
          ,
          <addr-line>Toulouse</addr-line>
          ,
          <country country="FR">France</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>LISN, Université Paris-Saclay</institution>
          ,
          <addr-line>CNRS, Inria, Orsay</addr-line>
          ,
          <country country="FR">France</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Mode confusion, Mode Control, Flight Mode Annunciation</institution>
          ,
          <addr-line>Automation, Flight Deck Design, Aviation</addr-line>
        </aff>
        <aff id="aff4">
          <label>4</label>
          <institution>Workshop Proce dings</institution>
        </aff>
        <aff id="aff5">
          <label>5</label>
          <institution>ing Automation Experiences</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>Mode confusion and automation surprises in aviation raise questions about the design of flight deck interfaces. Prior research investigated the use of the current interfaces and how they can impact the pilot's awareness of modes, and proposed design solutions to reduce mode confusions by improving feedback and interaction with modes. This paper explores a novel design that brings together mode control and feedback in a single interface. The interface aims to reduce mode confusions. Moreover, the paper highlights 5 key dimensions that influenced the design. In the future, we intend to evaluate the proposed interface to validate its benefits.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>While the basic philosophy of the autoflight system in
aircraft has become more and more complex in the past
years, the way the modes are displayed to pilots has not
evolved much. This can make it more dificult for pilots
to interpret current flight modes and to be aware of the
behavior of the aircraft.
play presenting the modes used by the aircraft. Thus
it informs the pilot of the current behavior and state of
the autoflight system. The current design of the FMA
is a basic layout located at the top of the Primary Flight</p>
      <sec id="sec-1-1">
        <title>Display (PFD). It indicates ”active” modes (currently used</title>
        <p>by the system) and ”armed” modes (waiting to be
active when the requirements are met) through a table
divided into three columns for autothrottle and
autopilot modes. Mode changes are indicated by a white box
outline around the relevant mode for ten seconds.</p>
      </sec>
      <sec id="sec-1-2">
        <title>However, the poor and simple design of the FMA does</title>
      </sec>
      <sec id="sec-1-3">
        <title>First, the information on the FMA is not suficient to fully</title>
        <p>understand the state of the autoflight system [ 1, 2]. Pilots
use other interfaces of the flight deck to find information
they need to increase their situation awareness, and those
interfaces provide, in most cases, reliable information at
a lower cognitive cost than the FMA [3]. Palmer [1]</p>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>2. Related</title>
    </sec>
    <sec id="sec-3">
      <title>Work</title>
      <p>not allow the pilot to be fully aware of the system status. crew’s interpretation of the system state from the actual
© 2023 Copyright for this paper by its authors. Use permitted under Creative Commons License Over the years, accidents have allowed us to question
the design of the flight deck and to identify interface
problems. As flight deck interface issues have been
identified, a number of researchers have proposed
changes to various interfaces to reduce the mode
confusion of pilots. Those new designs aim at providing
better feedback for pilots both for input and output.</p>
      <sec id="sec-3-1">
        <title>A first possibility to address this, is to change the way</title>
        <p>modes are engaged in order to improve the feedback on
the control interface. Boorman et al. [17] developed an
interface design of the MCP in order to reduce confusion.
This new interface focuses on targets rather than modes
and gives a clear indication of targets and sources. It
was evaluated by 17 pilots [18, 19]. Participants were
asked to perform tasks and answered questions about
autoflight behavior. Results indicated that the ability
to assess the new interface to understand the system’s
objectives is better than the current interface, although
some issues emerged. Rouwhorst et al. [20] presented a
touch screen control panel to select targets and engage
advanced modes through novel interactions. Hutchins
[21] proposed the Integrated Mode Management
Interface (IMMI), an interface consisting of a vertical
mode manager and a lateral mode manager, which
replace the mode controller and provide feedback about
the modes of the system and its behavior. Li et al. [22]
explored automation feedback design and proposed to
move the FMA to the MCP’s position. Results showed
that moving the FMA next to the MCP could increase
pilots’ situation awareness.</p>
        <p>
          Another possibility to reduce mode confusion is to
augment the feedback by changing the way modes
are displayed and by providing better indications
about the behavior of the aircraft. The use of icons
to indicate autoflight modes and their behaviors has
been studied in the literature [21, 23]. Other studies
have focused on designing a new FMA format. For
example, Feary et al. [24] proposed new FMA labels that
indicate the purpose of the system rather than what
the aircraft controls. Horn et al. [
          <xref ref-type="bibr" rid="ref1">25</xref>
          ] examined a new
design which merges the FMA with raw flight data
on the PFD and embedded it in the natural scanning
pattern of a pilot. Nikolic and Sarter [4] compared the
current foveal feedback of the FMA and two diferent
implementations of peripheral visual feedback when
uncommanded changes occur. The two peripheral
visual feedback types signaled a transition in a more
luminous way than the current FMA feedback to capture
attention more efectively. Instead of indicating modes,
Mumaw [
          <xref ref-type="bibr" rid="ref2">26</xref>
          ] proposed to focus on the behavior of
the system with a “feedback-oriented” screen. This
interface aims to make it possible to interpret the states
of the autoflight system in a simpler and more intuitive
representation than that commonly used, by
showing what autoflight is doing now and what it will do next.
        </p>
      </sec>
      <sec id="sec-3-2">
        <title>In summary, several researchers have studied novel</title>
        <p>interfaces to reduce mode confusion. Focusing on the
presentation of feedback and engagement of modes seems a
promising venue to address issues of situational
awareness and mode confusion.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>3. Method</title>
      <sec id="sec-4-1">
        <title>In the current paper, we focus on the concern raised by</title>
        <p>Palmer [1] about the physical separation between the
MCP used to engage modes and the FMA by merging
the MCP and the FMA, i.e. making the FMA interactive,
and hence to provide feedback directly at the location
of the pilot’s action. To remedy the lack of awareness,
we applied a user-centered design process. First, we
conducted a series of activities such as interviews with pilots,
observation sessions, and focus groups with experts to
better understand pilots’ behavior in real flight contexts.
and SPD. The AUTO mode corresponds to a state where
We propose a new design that brings together two cur- the aircraft manages automatically the thrust. In the
rently separate interfaces in the cockpit, the MCP and the SPD mode, the aircraft is maintaining a speed target.
FMA: the Interactive Flight Mode Annunciator (IFMA).</p>
        <p>IFMA is a touch-screen interface allowing the pilots to A specific colour highlights the status of each mode
manage autoflight modes and providing feedback about (Fig. 1) :
the modes used by the system (Fig. 1). It allows pilots
to understand what the aircraft is doing, what the active
modes are, who has control of the targets and which
automation is engaged.
• Active: green box and label.
• Armed: white box and label.
• Inactive and engageable: light gray box and label.
• Inactive but not engageable: dark grey box and
label.</p>
        <sec id="sec-4-1-1">
          <title>4.1. Graphical elements - How to verify modes</title>
          <p>The philosophy of the FMA is kept in the IFMA which is
divided into four parts. From left to right (Fig. 1) : vertical
guidance, lateral guidance, speed guidance and the status
of the automation. As for the three columns of guidance,
the first row corresponds to the modes where the target is
managed by the system (following the flight plan) and the
second row corresponds to the modes where the target
is selected by the pilot (maintaining or tracking heading,
altitude, speed). The third difers across all columns.</p>
          <p>All modes are visible on the interface and represented
by a label associated with a box. Names of modes
differ depending on the manufacturer, so we decided to
standardize them in our interface:</p>
          <p>For example, Figure 1 indicates the modes ALT, HDG
and SPD are active, which means they are the modes
used by the autoflight system. LNAV is armed, which
means that the mode will become active once the
necessary conditions for its activation are met, and thus the
mode HDG will become inactive. VS and AUTO are
inactive and engageable : they will be active or armed if
the pilot decides to engage them. VNAV, APPR and LOC
are inactive but not engageable because some conditions
are not fulfilled (VNAV can only be engaged when LNAV
is active, and LOC and APPR will only be engageable
when the aircraft is close to the airport, thus avoiding
the capture of wrong signals).</p>
          <p>All modes with which the pilot can interact are
represented on the interface. This overview of modes with
color coding allows pilots to be aware of engaged modes
and those which are not, as well as which modes they
can engage and those they cannot engage.</p>
        </sec>
      </sec>
      <sec id="sec-4-2">
        <title>Then, we conducted a brainstorming session about new</title>
        <p>ways of interaction to control modes and new forms of
feedback for autoflight modes. We focused on two ideas
that were evaluated by pilots through an online survey.
The result allowed us to focus our approach on merging
the MCP with the FMA i.e. merging the action and the
verification in the same interface.</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>4. Interface Design</title>
      <p>Vertical guidance There are 3 main modes: VNAV for
the automatic vertical navigation ; ALT to maintain an
altitude target ; VS to climb or descent with a specific
vertical speed. Two additional modes (OP CLB and OP DES)
have a diferent design because they represent a specific 4.2. Interactions - How to control modes
behavior in transit to climb or descent by maintaining At the bottom of the panel, there are a thumb wheel and
a speed and those are modes implicitly triggered by the three knobs. These buttons allow the pilot to modify the
engagement of the ALT mode. They both are represented value of the vertical speed, altitude, heading and speed
by a solid green box on the left of the ALT mode (Fig. 2). targets (from left to right in Figure 1). The thumb wheel,
which allows managing the vertical speed target, is
difLateral guidance There are 4 modes: LNAV for the ferent from the other three knobs because they are not
automatic lateral navigation ; HDG to maintain a heading used in the same way. A knob can be turned and pushed
target ; LOC to follow the localizer and APPR to engage when the thumb wheel can only be turned. We chose this
LOC and GS, the mode to follow the glide slope. design since pilots do not need to hold a current vertical
speed because they choose the target before engaging
Speed/Thrust guidance We decided to highly the mode, contrary to the heading, the altitude and the
simplify the autothrust modes in only 2 modes : AUTO speed they may need to hold at a current value.
• Turn a knob: select the target of the parameter</p>
      <p>corresponding to the knob.
• Press a knob: maintain the current value of the</p>
      <p>parameter corresponding to the knob.
• Turn the thumb wheel: select the target of the</p>
      <p>vertical speed.
• Press a mode (or the status of automation):
en</p>
      <p>gage the mode or the status.</p>
      <sec id="sec-5-1">
        <title>The engagement of the HDG, ALT (associated with</title>
        <p>
          OP CLB and OP DES) and VS modes by pressing the
box must be preceded by the selection of a target. If the
pilot presses one of these modes without a preselected
target, a brief orange flash appears on the screen to
indicate to the pilot that the action has not led to a
result. This solution, inspired by ”Red Alert” [
          <xref ref-type="bibr" rid="ref3">27</xref>
          ], allows
the pilots to understand that there is a problem. This
lfash also appears when the pilot tries to engage a
non-engageabled mode.
        </p>
      </sec>
      <sec id="sec-5-2">
        <title>Selective The pilot can be aware of engaged modes at a glance by the color and position of modes, two selective variables as proposed by Bertin [29]. The pilot also knows which modes are not engageable thanks to the color.</title>
      </sec>
      <sec id="sec-5-3">
        <title>Uniformity The modes’ names are standardized between the manufacturers. This interface can be used in any aircraft.</title>
      </sec>
      <sec id="sec-5-4">
        <title>Proximity This is the main point of the novel design. The action and the feedback are in the same interface.</title>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>5. Perspectives</title>
      <sec id="sec-6-1">
        <title>4.3. Key points of the design</title>
        <sec id="sec-6-1-1">
          <title>This work in progress needs more improvements. First,</title>
          <p>Furthermore, if the pilot preselects a target, but the the autothrust modes have been simplified (only two in
associated mode is not engaged within 10 seconds, then the IFMA) and do not reflect modes related to thrust. This
the preselection will be cleared. This time has been aspect needs more thought. Moreover, there is no
possichosen arbitrarily and user studies should be conducted bility in the IFMA to switch between Heading and Track
to identify the ideal timing. We are aware that pilots modes or between Vertical Speed and Flight Path Angle
sometimes preselect targets and a more or less long time modes. We need to investigate how to add these two
is spent between the preselection of the target and the features while keeping the consistency of the interface.
engagement of the associated mode, but we have chosen This question is related to the scalability, which needd to
to make the ”unused” targets disappear to simplify be considered: is it possible to add new modeswhileby
as much as possible the reading of the IFMA by the pilots. keeping the current characteristics of the IFMA? Finally,
we are aware of the problems related to using touch</p>
          <p>
            To disengage a mode, the pilot will have to engage screens in a cockpit [
            <xref ref-type="bibr" rid="ref6 ref7">30, 31</xref>
            ]. Yet, touch screens
facilianother mode associated with the guidance (i.e. in the tate the evaluation and prototyping of ideas. We will
same column). For example, if the pilots wish to dis- consider augmenting this interface with physical
butengage the LNAV mode, then they will have to engage tons, knobs and thumb wheel to avoid the constraints of
for example the HDG mode. VNAV mode automatically touch-related issues in turbulent environments.
disengages when LNAV mode is disengaged (the system This paper proposes a novel design of a mode
conthen engages the ALT mode with the current altitude of troller with the goal to have better feedback of the modes
the aircraft as target). To disengage an automatism, it used by an autoflight system. The main objective of this
is suficient to press again the box associated with the design is to merge the mode control and the mode
anautomatism. nunciation in one single interface. A future evaluation
will determine if this type of interface does efectively
reduce mode confusion.
          </p>
        </sec>
        <sec id="sec-6-1-2">
          <title>We would like to highlight several points that we believe</title>
          <p>
            are beneficial in the IFMA compared to existing systems
(although this will need to be evaluated in a user study
with pilots). These points are listed below and some of
them are inspired by the cognitive dimensions of
Blackwell and Green [
            <xref ref-type="bibr" rid="ref4">28</xref>
            ].
          </p>
          <p>Visibility
interface.</p>
          <p>All modes are permanently visible on the</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-7">
      <title>Acknowledgments</title>
      <sec id="sec-7-1">
        <title>We thank the pilots who participated in the user-centered design, as well as the experts and colleagues at ENAC for their feedback.</title>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>A.</given-names>
            <surname>Horn</surname>
          </string-name>
          , W.-C. Li,
          <string-name>
            <surname>G.</surname>
          </string-name>
          <article-title>Braithwaite, Human-centered design of flight mode annunciation for instantaneous mode awareness</article-title>
          , in: International Conference on Engineering Psychology and Cognitive Ergonomics, Springer,
          <year>2018</year>
          , pp.
          <fpage>137</fpage>
          -
          <lpage>146</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>R. J.</given-names>
            <surname>Mumaw</surname>
          </string-name>
          ,
          <article-title>Plan b for eliminating mode confusion: An interpreter display</article-title>
          ,
          <source>International Journal of Human-Computer Interaction</source>
          <volume>37</volume>
          (
          <year>2021</year>
          )
          <fpage>693</fpage>
          -
          <lpage>702</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>J.</given-names>
            <surname>Saint-Lot</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.-P.</given-names>
            <surname>Imbert</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Dehais</surname>
          </string-name>
          ,
          <article-title>Red alert: a cognitive countermeasure to mitigate attentional tunneling</article-title>
          ,
          <source>in: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems</source>
          ,
          <year>2020</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>6</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [28]
          <string-name>
            <given-names>A.</given-names>
            <surname>Blackwell</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Green</surname>
          </string-name>
          ,
          <article-title>Notational systems-the cognitive dimensions of notations framework, HCI models, theories, and frameworks: toward an interdisciplinary science</article-title>
          . Morgan Kaufmann 234 (
          <year>2003</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [29]
          <string-name>
            <given-names>J.</given-names>
            <surname>Bertin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Barbut</surname>
          </string-name>
          ,
          <article-title>Sémiologie graphique: les diagrammes, les réseaux, les cartes</article-title>
          , De Gruyter Mouton,
          <year>1968</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [30]
          <string-name>
            <given-names>A.</given-names>
            <surname>Cockburn</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Gutwin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Palanque</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Deleris</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Trask</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Coveney</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Yung</surname>
          </string-name>
          ,
          <string-name>
            <surname>K.</surname>
          </string-name>
          <article-title>MacLean, Turbulent touch: Touchscreen input for cockpit lfight displays</article-title>
          , in: International Conference for Human-Computer
          <string-name>
            <surname>Interaction</surname>
          </string-name>
          (CHI
          <year>2017</year>
          ),
          <year>2017</year>
          , pp.
          <fpage>6742</fpage>
          -
          <lpage>6753</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [31]
          <string-name>
            <given-names>S.</given-names>
            <surname>Pauchet</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.-L.</given-names>
            <surname>Vinot</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Letondal</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Lemort</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Lavenir</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Lecomte</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Rey</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Becquet</surname>
          </string-name>
          ,
          <string-name>
            <surname>G.</surname>
          </string-name>
          <article-title>Crouzet, Multi-plié: A linear foldable and flattenable interactive display to support eficiency, safety and collaboration</article-title>
          ,
          <source>in: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems</source>
          ,
          <year>2019</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>13</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>