<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Independent Core Observer Model (ICOM) Theory of Consciousness as Implemented in the ICOM Cognitive Architecture and the Associated Consciousness Measures</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>David J Kelley</string-name>
          <email>David@ArtificialGeneralIntelligenceInc.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Dr. Mathew A. Twymon</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>AGI Laboratory -</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>AGI Laboratory -</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>This paper articulates the fundamental theory of consciousness used in the Independent Core Observer Model (ICOM) research program and the consciousness measures as applied to ICOM systems and their uses in context including defining of the basic assumptions for the ICOM Theory of Consciousness (ICOMTC) and associated related consciousness theories (CTM, IIT, GWT etc.) that the ICOMTC is built upon. The paper defines the contextual experience of ICOM based systems in terms of a given instances subjective experience as objectively measured and the qualitative measure of Qualia in ICOM based systems</p>
      </abstract>
      <kwd-group>
        <kwd>Theory of Consciousness</kwd>
        <kwd>GWT</kwd>
        <kwd>ICOM</kwd>
        <kwd>AGI</kwd>
        <kwd>Cognitive Architecture</kwd>
        <kwd>CTM</kwd>
        <kwd>IIT</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Designing an Artificial General Intelligence (AGI) System includes a number of
complex problems including defining elements that are not agreed upon to even have a
foundation to build such a design on in the first place. In the research program for the
cognitive architecture for AGI called the “Independent Core Observer Model” to be
able to frame tests and measures we needed to address definitions of consciousness
including baking out our own version of a theory of consciousness [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ] previous to
this work and the process of measuring that systems consciousness which is the
subject of this paper. Keep in mind these tests or measures are focused on measuring
‘consciousness’ not on hardware capacity or other technical measures.
The Independent Core Observer Model Theory of Consciousness is partially built on
the Computational Theory of Mind [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]where one of the core issues with research into
artificial general intelligence (AGI) is the absence of objective measurements as they
are ambiguous given the lack of agreed upon objective measures of consciousness [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]
To continue serious work in the field we need to be able to measure consciousness in
a consistent way that is not presupposing different theories of the nature of
consciousness [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] and further not dependent on various ways of measuring biological systems
[
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] but focused on the elements of a conscious mind in the abstract. With the more
nebulous Computational Theory of Mind, research into the human brain does show
some underlying evidence to the same.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Our Assumptions</title>
      <p>
        We made a number of assumptions to provide an experimental reference point
when designing AGI cognitive architecture [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ]. First, Qualia is the subjective
experience that can be measured external to the system if the mind in question is operating
under known parameters. [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]
      </p>
      <p>
        Humans are not able to make logical decisions. Looking at the neuroscience
behind decisions we already can prove that humans make decisions based on how they
feel [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] and not based on logic [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ][
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
      </p>
      <p>
        Subjective experience can be measured and understood. The traditional view that
the subjective nature of experience [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] is purely subjective is rejected as a matter of
principle in this paper. Consciousness, even by scientists in the field, frequently
consider it the realm of "ontology and therefore philosophy and religion" [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] our
assumption is that this is false.
      </p>
      <p>
        Consciousness can be measured. "Despite this enormous commitment to the study
of consciousness on the part of cognitive scientist covering philosophical,
psychological, neuroscientific and modelling approaches, as of now no stable models or
strategies for the adequate study of consciousness have emerged." [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] That is until now
with the ICOMTC. We also believe that we can measure consciousness regarding
task accuracy and awareness as a function of stimulus intensity [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] that applies to
brain neurochemistry as much as the subjective experience from the point of view of
systems like ICOM.
      </p>
      <p>We have a concrete definition of 'Subjective' as a concept. 'Subjective' then is
defined as the relative experience of a conscious point of view that can only be
measured objectively only from outside the system where the system in question
experiences things 'subjectively' as they relate to that systems internal emotional context.</p>
      <p>
        Consciousness is a system that exhibits the degrees or elements of the Porter
method for measuring consciousness regarding its internal subjective experience. [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] While
the dictionary might define consciousness subjectively in terms of being awake or
aware of one's surroundings [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] this is a subjective definition, and we need an
'objective' one to measure and thus the point we are assuming for the context of the ICOM
theory of mind and the ICOM research altogether.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Basis for Design of the ICOM Theory of Consciousness</title>
      <p>
        The ICOM or Independent Core Observer Model Theory of Consciousness
(ICOMTC) is based on the Computational Theory of Mind [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] which is de-fined as:
According to CCTM, the mind is a computational system similar in important
respects to a Turing machine, and core mental processes (e.g., reasoning,
decisionmaking, and problem-solving) are computations similar in important respects to
computations executed by a Turing machine [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] - which can have numerous
variations.
      </p>
      <p>
        . An instance of an ICOM system would be a variational instance of CCTM. In
addition to that, the ICOM Theory of Consciousness or ICOMTC also borrows from
the Integrated Information Theory [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. CCTM does not give us a complete basis for
developing ICOM systems and includes elements of Integrated Information Theory as
well as CCTM.
      </p>
      <p>
        Integrated information theory or IIT, approaches the relationship between
consciousness and its physical substrate by first identifying the fundamental proper-ties
of experience itself: existence, composition, information, integration, and exclusion.
IIT then postulates that the physical substrate of consciousness must satisfy three key
points or 'Axioms' [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ].
      </p>
      <p>
        ICOMTC also borrows from Global Workspace theory in that things move through
the system and only when things reach a certain point is that bit of 'thought' or
'context' raised to the level of the conscious mind. [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] CCTM, IIT and Global
Workspace all exist more or less in ICOMTC where ICOMTC based systems exhibit all the
elements of all of these theories to some degree but it is also substrate independent in
that ICOMTC is not an attempt to produce the same kind of system as the biological
substrate of the human brain or do anything that requires that kind of hardware nor is
it tied to current computer architecture either other than any Turing Machine [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ].
Any Turing Machine in theory would be able to run an ICOMTC based system given
enough processing time.
4
      </p>
    </sec>
    <sec id="sec-4">
      <title>The Independent Core Observer Model Theory of</title>
    </sec>
    <sec id="sec-5">
      <title>Consciousness (ICOMTC)</title>
      <p>
        At a very high level, ICOM as a cognitive architecture [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ] works by streaming
data and context processed by the underlying system (the observer) and based on
emotional needs and interests and other factors in the system, these are weeded out until
only a certain amount are processed, or 'experienced' in the 'core' (or global
workspace) which holds emotional models based on Plutchik's [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] work. These elements
of the core exist for both conscious and subconscious emotional landscapes of the
system where the context that is 'experienced' from the standpoint of the system is the
only 'experiences' that the conscious system is aware of. In this way, only the
differential experience matters and the system, for example, doesn't understand a word as
much as it feels the emotional context of the word as it relates to underlying context.
It is the emotional valences associated with things that the system then selects things
to think emotionally about. The system select's actions based on how they improve
the experiences of those emotional valences and in this way the system may choose to
do something logical based on how it feels about it, or it could just as easily pick
4
;
;
;
;
;
;
something else for no other reason than it feels a bit better about it. In this way, the
system does not have direct access to those emotional values nor is a direct function
of the algorithms, but it is an abstraction of the system created by the core that can be
considered emotionally conscious or self-aware being sapient and sentient in the
abstract.
5
      </p>
    </sec>
    <sec id="sec-6">
      <title>Subjective Experience in the ICOM Cognitive Architecture</title>
      <p>How do we then look at a system that experiences emotional, subjective experience
objectively? The following set notation shows us a simple logical implementation of
the last climb of "a thought" as it makes its rise from the depths of the system to the
awareness of the conscious, self-aware parts of the system.
,
,</p>
      <p>;
(NewContext,
;</p>
      <p>First, let us walk through the execution of this logic. Coming into the system we
already have context data decomposition, sensory input, also related data from
memory that may be of emotional interest but for the purposes of one 'thought' let's
say it's one bit of context meaning an emotionally related context tree related to
something that the system has sensed externally. This will be represented by 'Inputs.' At
this point, we have already passed the point of that 'context' being raised to the global
workspace. Figure 1 essentially is one cycle of the core considering what is in the
global workspace or 'core' of ICOM. In Figure 1 we first see that we have two sets or
collections of emotional models represented by the two sets defined in the first two
rows, then we have the input new context placed in the 'NewContext' set. We apply
the 'Needs' function that applies a matrix set of rules such as the technical
requirements of the system to other wants and needs based on the systems hierarchy of needs
and current environmental conditions. At this point, we look at how this thought
applies conscious emotional rules in the function 'ConsciousRules' and then how that
manipulates the current conscious emotional landscape. We say 'land-scape' because
it is not a single emotion but a complex set of almost infinite combi-nations
consciously and subconsciously that the system experiences.</p>
      <p>In like manner, the system applies subconscious rules to the subconscious states
and the subconscious rules to the conscious states and finally those states as they
apply to the new context where in all cases it is only in the abstract from this states that
the system experiences anything. Meaning the system is using the abstracted states to
represent that emotional landscape in how things affect all of those emotional states
and related context finally being passed to the observer for action if that 'NewContext'
contained an action. In this way, the system doesn't even deal with the complexity of
its actions as much as the system will do them if the system felt like it and knows
how; where as numerous cycles might have to execute in the core for it to perform a
new task, meaning it will have to think a lot more about something it doesn't know
how to do. After that context is posted back to the observer (the more complex part
of the system in ICOM), then it is placed back into context memory, and in this way,
we see the rich set of the emotional landscapes of the system can model and execute.</p>
      <p>Interestingly enough, in current ICOM research there are indications that this sort
of system is perfectly capable of becoming mentally ill and even forgetful if hardware
starts to limit operations, where as the only way to optimize for the execution
environment would be to place memory limits and based on the node map memory
models this would be the only way to continue optimal execution given certain limits.</p>
      <p>A better way to think of ICOMTC is that not a single element of the system is
conscious or self-aware to any level, it is the 'interactions' between the parts that together
those interactions become aware abstractly, and it is through the underlying process
articulated in Figure 1 that is then measured in terms of consciousness via the various
methods as well as direct instrumentation of the system to measure 'qualia' for
example.
,</p>
    </sec>
    <sec id="sec-7">
      <title>Measuring Qualia</title>
      <p>In ICOMTC qualia can be objectively measured through the differential between
the conscious emotional landscape of the system represented by a Plutchik model
along with the subconscious model and the model of the irreducible set of any given
con-text experienced by the system and the emotional model created that represents
that specific 'contextual' experience. In the ICOMTC the qualia is that differential
between the state and effective one emotional structure that represents that current
context and how the system applies choices is then based on that and the numerous
underlying factors that affect the construction and choices based on specific con-texts.
Now by its nature the system can't self-reflect directly on those values but is an
abstraction of that process in the global 'work space' that effectively is created by the
underlying operation. We can of course measure this 'qualia' of the system but the
system can't do it directly from its standpoint. In the research already done for ICOM
we can see that ICOMTC system doesn't really have free will but it would appear that
way from the systems standpoint and experience the illusion of free will much the
way humans do.</p>
      <p>As stated, qualia (in ICOM) then can be measured. Referring back to figure one
we can use two values or sets from that set of operations and preform a 'qualia'
measurement like this based on those values:
,
,
,</p>
      <p>In this case we are computing qualia by taking the sets that represent the cur-rent
emotional landscape of the system and a conscious and subconscious level and
computing the difference matching sets where a set is a Plutchik model with 8 floating
point values. We subtract the current state from the previous state giving us the
Plutchik representation of the subjective emotional differential experienced by the
system. This really gives you the numbers in terms of 'sets' that show how a specific
element of 'context' that managed to make it to the global work space is 'experienced'
or rather the effective of that experience. We actually have to calculate this after the
fact external to the system as it is not actually computed in the real process (noted in
figure 1) and there is not a 'direct' method in ICOM to surface an objective measure of
qualia to the system without a complete abstraction but we can compute it external
and use it for analysis.</p>
      <p>
        The Independent Core Observer Model Theory of Consciousness (ICOMTC)
addresses key issues with being able to measure physical and objective details as well as
the subjective experience of the system (known as qualia) including mapping complex
emotional structures, as seen in previously published research related to ICOM
cognitive architecture [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ]. It is in our ability to measure, that we have the ability to test
additional theories and make changes to the system as it currently operates. Slowly
we increasingly see a system that can make decisions that are illogical and
emotionally charged yet objectively measurable [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] and it is in this space that true artificial
general intelligence that will work 'logically' similar to the human mind that we hope
to see success. ICOMTC allows us to model objectively subjective experience in an
operating software system that is or can be made self-aware.
7
      </p>
    </sec>
    <sec id="sec-8">
      <title>Measuring Conscious Systems</title>
      <p>There are two types of test types that are considered for use in the ICOM program
designed around measuring and testing outside of the qualia analytics that are external
measures. Keep in mind qualia under the Yampolskiy method as noted below is a
different measure then the previous section. These tests us allow us to measure
somewhat more subjective tasks based on our behavior of the system to further bake
additional research. In both cases, these tests can be applied across various
potentialy ‘conscious’ systems and humans giving us a frame of reference for comparison
which we lack using the Qualia method form the previous sections. The two test
types are:
7.1</p>
      <sec id="sec-8-1">
        <title>Qualitative Intelligence Tests</title>
        <p>
          Intelligence Quotient (IQ) tests -. are tests designed to measure ‘intelligence’ in
humans [
          <xref ref-type="bibr" rid="ref24">24</xref>
          ] where we are using short versions to assess only relative trends or the
potential for further study, whereas given the expected sample size results will not be
statistically valid, nor accurate other than at a very general level, which is believed to
be enough to determine if the line of re-search is worth going down. Of these tests,
two types will be used in the study, one a derivative of the Raven Matrices Test [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ]
designed to be culturally agnostic, and the Wechsler Adult Intelligence Scale
(WAIC)[
          <xref ref-type="bibr" rid="ref23">23</xref>
          ] Test which is more traditional. Lastly falling into the category of WAIC
there is a baseline full Serebriakoff MENSA test that we can apply to compare and
contrast scores between the two base lines tests. [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ]
        </p>
        <p>
          Collective Intelligence (CI) Test. – we would like to use this test, however the
information for executing this test is not publicly accessible and reaching out to the
researchers that created this test has produced no response thus far. [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ]
        </p>
      </sec>
      <sec id="sec-8-2">
        <title>Extended Meta Data and Subjective Tests</title>
        <p>A number of tests or measures will be collected, more oriented towards analysis for
further study, primarily around correlative purposes. None of these tests may be used
outside of as possible illustrative examples, without being statistically valid given the
lack rigor or subjective nature of these measures.</p>
        <p>The Turing Test –. this test is not considered quantifiable and there is debate over
whether this measure tells us anything of value, however a test regimen for this has
been completed and can be used for subjective analysis only.</p>
        <p>
          The Porter Method –. This appears to be a qualitative test, but individual question
measures are entirely subjective and therefore the test lacks the level of
qualitativeness to be valid without a pool of historical values to measure against at the very least.
This test provides some value in meeting colloquial standards of consciousness and is
more comprehensive then some of the other tests albeit subjective it is at least the
attempt at being a comprehensive measure of consciousness. [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ]
        </p>
        <p>
          The Yampolskiy Qualia Test –. is a subjective measure of a subjective ‘thing’ and
therefore not a qualitative measure, however we have built a regimen based on this
when looking at qualia as measured in the previous examples. In theory this only tests
for presence of Qualia in human like subjects, passing this test does not mean that a
subject does not experience qualia in the sense of this paper, just that it was not
detected. This means that subjects may show signs of qualia, or not, but the test only
would show the presence of not the absence of qualia. [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ]
8
        </p>
      </sec>
    </sec>
    <sec id="sec-9">
      <title>Conclusions</title>
      <p>There are numerous potential methods for measure consciousness in ICOM or other
AGI systems but there is a lot of discord in terms of a foundation to build on. For
ICOM to move forward as a cognitive architecture it is important that we build that
foundation. The tests listed in this paper are the ones currently being used or being
considered. There are a few others including mental health states analysis tests for
example but these tests are more subjective and not helpful in the current research.
We have found that by building on the basis articulated here that we at least can move
the research forward for the time being.</p>
      <p>
        Conclusions based on the this work at least have a frame of reference even if later
proved false then we at least know that and can start over. Ideally this foundation
gives us a deeper more rigorous program moving forward in terms of AGI Cognitive
Architecture research into conscious systems with an eye towards safety [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ].
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Rescorla</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ; The Computational Theory of Mind; Stanford University 16 Oct 2016; http://plato.stanford.edu/entries/computational-mind/
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Seth</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ;
          <article-title>Theories and measures of consciousness develop together</article-title>
          ; Elvsevier/Science Direct; University of Sussex
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Dienes</surname>
            ,
            <given-names>Z</given-names>
          </string-name>
          ; Seth,
          <string-name>
            <surname>A.</surname>
          </string-name>
          ;
          <article-title>The conscious</article-title>
          and unconscious; University of Sussex;
          <year>2012</year>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Dienes</surname>
            ,
            <given-names>Z</given-names>
          </string-name>
          ; Seth,
          <string-name>
            <surname>A.</surname>
          </string-name>
          ;
          <article-title>Measuring any conscious content versus measuring the relevant conscious content: Comment on Sandberg et a</article-title>
          .; Elsevier/ScienceDirect; University of Sussex
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Porter</surname>
            <given-names>III</given-names>
          </string-name>
          , H.;
          <article-title>A Methodology for the Assessment of AI Consciousness;</article-title>
          Portland State University Portland
          <source>Or Proceedings of the 9th Conference on Artificial General Intelligence;</source>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Gregory</surname>
          </string-name>
          ;
          <article-title>"Qualia: What it is like to have an experience; NYU;</article-title>
          <year>2004</year>
          https://www.nyu.edu/gsas/dept/philo/faculty/block/papers/qualiagregory.pdf
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Camp</surname>
          </string-name>
          , Jim; Decisions Are Emotional, Not Logical:
          <article-title>The Neuroscience behind Decision Making; 2016 http://bigthink.com/experts-corner/decisions-are-emotional-not-logical-theneuroscience-behind-decision-making</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Leahu</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Schwenk</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ; Sengers,
          <string-name>
            <surname>P.</surname>
          </string-name>
          ; Subjective Objectivity: Negotiating Emotional Meaning; Cornell University; http://www.cs.cornell.edu/~lleahu/DISBIO.pdf
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Kurzweil</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ;
          <source>The Law of Accelerating Returns; Mar</source>
          <year>2001</year>
          ; http://www.kurzweilai.net/thelaw-of-accelerating-returns
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Overgaard</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ;
          <article-title>Measuring Consciousness - Bridging the mind-brain gap; Hammel Neurocenter Research Unit; 2010</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Sandberg</surname>
            ,
            <given-names>K</given-names>
          </string-name>
          ; Bibby,
          <string-name>
            <given-names>B</given-names>
            ;
            <surname>Timmermans</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B</given-names>
            ;
            <surname>Cleeremans</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ;
            <surname>Overgaard</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ; Consciousness and
            <surname>Cognition - Measuring Consciousness</surname>
          </string-name>
          :
          <article-title>Task accuracy and awareness as sigmoid functions of stimulus duration; Else-vier/ScienceDirect</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Merriam-Webster -</surname>
          </string-name>
          Definition of Consciousness by Merriam-Webster - https://www.merriam-webster.com/dictionary/consciousness
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13. Wikipedia Foundation; Turing Machine;
          <year>2017</year>
          ; https://en.wikipedia.org/wiki/Turing_machine
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Tononi</surname>
          </string-name>
          , G.;
          <string-name>
            <surname>Albantakis</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Masafumi</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ;
          <article-title>From the Phenomenology to the Mechanisms of Consciousness: Integrated Information Theory 3</article-title>
          .0; 8 MAY 14; Computational Biology http://journals.plos.org/ploscompbiol/article?id=
          <volume>10</volume>
          .1371/journal.pcbi.1003588
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Baars</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Katherine</surname>
            ,
            <given-names>M</given-names>
          </string-name>
          ; Global Workspace;
          <volume>28 NOV</volume>
          <year>2016</year>
          ; UCLA http://cogweb.ucla.edu/CogSci/GWorkspace.html
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Chalmers</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ;
          <article-title>Facing Up to the Problem of Conscious-ness; University of Arizona 1995</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Serebriakoff</surname>
          </string-name>
          , V; “
          <string-name>
            <surname>Self-Scoring</surname>
            <given-names>IQ</given-names>
          </string-name>
          Tests;” Sterling/London;
          <year>1968</year>
          ,
          <year>1988</year>
          ,
          <source>1996; ISBN 978- 0-7607-0164-5</source>
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Norwood</surname>
          </string-name>
          , G.;
          <article-title>Deeper Mind 9</article-title>
          . Emotions - The Plutchik Model of Emotions; http://www.deepermind.
          <source>com/02clarty.htm 403</source>
          (
          <issue>2</issue>
          /20/02016)
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Kelley</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ;
          <source>Critical Nature of Emotions in Artificial General Intelligence; IEET</source>
          <year>2016</year>
          ; https://ieet.org/index.php/IEET2/more/Kelley20160923
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Kelley</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <article-title>; “The Independent Core Observer Model Computational Theory of Consciousness and Mathematical model for Subjective Experience”; ITSC 2018</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Engel</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Woolley</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Chabris</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Takahashi</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Aggarwal</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ; Nemoto,
          <string-name>
            <given-names>K.</given-names>
            ;
            <surname>Kaiser</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            ;
            <surname>Kim</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            ;
            <surname>Malone</surname>
          </string-name>
          , T.;
          <article-title>“Collective Intelligence in Computer-Mediated Collaboration Emerges in Different Contexts</article-title>
          and Cultures;”
          <source>Bridging Communications; CHI</source>
          <year>2015</year>
          ; Seoul Korea
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Wikipedia</surname>
          </string-name>
          <article-title>Foundation (WF); “Raven's Progressive Matrices;</article-title>
          ”
          <source>Oct</source>
          <year>2018</year>
          ; https://en.wikipedia.org/wiki/Raven%27s_Progressive_Matrices
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Wikipedia</surname>
          </string-name>
          <article-title>Foundation (WF);</article-title>
          “Wechsler Adult Intelligence Scale;”
          <source>Oct</source>
          <year>2018</year>
          ; https://en.wikipedia.org/wiki/Wechsler_Adult_Intelligence_Scale
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Wikipedia</surname>
          </string-name>
          <article-title>Foundation (WF);</article-title>
          “Intelligence Quotient”;
          <source>Oct</source>
          <year>2018</year>
          ; https://en.wikipedia.org/wiki/Intelligence_quotient
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Yampolskiy</surname>
          </string-name>
          , R.;
          <source>“Artificial Intelligence Safety</source>
          and Security;” CRC Press, London/New York;
          <year>2019</year>
          ; ISBN:
          <fpage>978</fpage>
          -0-
          <fpage>8153</fpage>
          -6982-0
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Yampolskiy</surname>
          </string-name>
          , R.; “Detecting Qualia in Natural and Artificial Agents;” University of Louisville,
          <year>2018</year>
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>Siong</surname>
          </string-name>
          , Ch.,
          <string-name>
            <surname>Brass</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Heinze</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Haynes</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ;
          <article-title>Unconscious Determinants of Free Decisions in the Human Brain; Nature Neuroscience; 13 Apr 2008; http://exploringthemind.com/the-mind/brain-scans-can-reveal-your-decisions-7-secondsbefore-you-</article-title>
          <string-name>
            <surname>decideAuthor</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Author</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Author</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Book title</article-title>
          .
          <source>2nd edn. Publisher</source>
          ,
          <string-name>
            <surname>Location</surname>
          </string-name>
          (
          <year>1999</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>