Using Tononi Phi to Measure Consciousness of a Cognitive System While Reading and Conversing ?

Abstract

We conducted computational experiments estimating Giulio Tononi's Phi coe cient to measure the integrated information within the OpenCog cognitive architecture on two types of tasks: Reading (i.e. parsing and semantically analyzing) short documents, and guiding the Sophia humanoid robot in carrying out a dialogue-based interaction. The data used to calculate Phi comprises time-series of Short Term Importance (STI) values corresponding to Atoms (nodes and links) in OpenCog's Attentional Focus. To make these computations feasible, we preprocessed our data using Independent Component Analysis. We fed the reduced set of time series into software that applies known methods for approximating Phi. Qualitatively (and preliminarily), comparison of the variation of Phi with cognitive system behavior over time reveals sensible patterns.

Keywords

• Integrated Information Theory
• Tononi Phi
• Attention
• Allocation
• System Connectedness
• Neural Correlate of Consciousness
• Machine Consciousness
• Humanoid Robotics

-

Measurement and analysis of overall system states over time of complex cognitive AI systems is a signi cant problem. Analyzing detailed log les rapidly becomes overwhelming, and it is also necessary to have overall, holistic measurements of system states. Facing this situation with our OpenCog AI system as it reads texts and works within the Hanson AI framework to guide the dialogue of the Sophia humanoid robot 1, we turned to Giulio Tononi's Phi coe cient as a tool for measuring the overall level of \integrated information" in the OpenCog system. Phi has been posited by Tononi and others as a fundamental measure of the \level of consciousness" in a system [ 15 ]. One of the authors has presented an alternate view in which Phi is one way of approximating one among many aspects of consciousness in certain classes of cognitive systems [ 5 ]. Here, it is su cient to consider Phi as one interesting measure of a consciousness-related property (holistic information integration) of a complex cognitive system.

We conducted two experiments: one with OpenCog parsing and semantically analyzing short documents, and the other with OpenCog controlling the Sophia humanoid robot while leading a person through a structured meditation session. In both experiments we logged the STI values for the Atoms in the system's Attentional Focus, and estimated Phi from the time-series thus obtained.

A core practical tool was Matlab code from Kitazona and Oizumi [ 7 ] for estimating Phi from coupled time series. We found this code to be best for analyzing a small number of dense time series, as opposed to the large number of sparse time series presented via exportation of STI time series from the Attentional Focus. Thus we adopted a novel methodology of rst applying Independent Component Analysis (ICA) to reduce the original set of sparse time series to a smaller number of dense time series, and then applying the Phi measure. The common foundation of ICA and Phi in the mathematics of mutual information provides some consilience here. In both experiments, we compared the Phi value time-series obtained with the time-series of events in the external situation and behavior of the OpenCog system. Qualitatively, we found correspondences between changes in Phi and changes in the situation and behavior of the cognitive system, providing preliminary validation for the methodology pursued. 2

The OpenCog Cognitive Architecture and the Hanson Robotics Sophia Robot OpenCog is a complex, integrative cognitive AGI architecture currently used in a variety of practical applications, including natural language processing and humanoid robot control [ 16 ]. The architecture combines multiple AI paradigms such as uncertain logic, computational linguistics, evolutionary program learning, and connectionist attention allocation in a uni ed architecture. Cognitive processes embodying these di erent paradigms interoperate on a common neuralsymbolic knowledge store called the Atomspace (a weighted labeled hypergraph whose nodes and links are called \Atoms"). This interaction is designed to encourage the self-organizing emergence of high-level network structures in the Atomspace.

One of OpenCog's core cognitive algorithms is the Economic Attention Networks (ECAN) neural-network based module for system resource management [ 2 ]. ECAN views the Atomspace as a graph of untyped nodes, and considers links of type HebbianLink, and other links with assumed HebbianLink semantics. Each Atom in ECAN is weighted with two numbers, STI (short-term importance) and LTI (long-term importance.) A system of equations spread importance among atoms based upon the importance of their roles in performing actions related to the system's current goals. An important concept within ECAN is the Attentional Focus, consisting of those Atoms currently deemed most important by the system in terms of achieving its goals. OpenCog has recently been integrated with the Hanson AI framework, that is used to control the Sophia humanoid robot [ 6 ]. Sophia's high degree of human likeness coupled with her array of complex emotional expressions make her an ideal platform for cognitive robotics experimentation. 3

Integrated Information Theory and the Phi Measure

Created by University of Wisconsin psychiatrist and

neuroscientist Giulio Tononi in 2004 [ 15 ], Integrated Information Theory (IIT) is an evolving system and calculus for studying and quantifying consciousness.

It is strikingly Cartesian [ 9 ] in how it approaches the problem: Rather than investigating consciousness by looking at neurons and neurological networks rst, as Fig. 1. Image of Sophia most e orts have [ 10 ], it begins by examining lived and a human conversation experience of what it is to be conscious. It then builds partner during a \Lov- an understanding of what consciousness must require ing AI" robot-meditation- neurologically from there. guide trial conducted in The IIT that emerges is a detailed, complex frameCalifornia in 2018. In this work describing how consciousness behaves and is ortrial, Sophia was running ganized. Its centerpiece is Phi, Tononi's [ 15 ] maththe same OpenCog-based ematical quanti er for consciousness. Based on the control code as in Experi- number and quality of interconnections a given entity ment 2 reported here. has between bits of information, Phi is hypothesized by Tononi and colleagues to correspond to how conscious it is [ 12, 14 ]. Some of the authors incline toward a nuanced view in which Phi is viewed as an estimator of one among many interesting properties of consciousness in roughly human-like cognitive systems [ 5 ]. However, practical estimation of Phi in cognitive systems has value regardless of debates over foundational interpretation. 3.1

Procedure for Calculating Phi In calculating Phi values, three major issues arise: As Max Tegmark [ 13 ] points out, there are at least 420 choices one can make in calculating the measure; Determination of the \Minimum Information Partition" (MIP) of the causal graph structure grows super-exponentially with the number of nodes; and the size of the probability distribution vectors required to determine Phi also increases superexponentially with the number of nodes. We have chosen to handle these issues as follows: Two \good" methods for calculating Phi are , an approximate measure of Phi, and Phi 3.0, both introduced by Oizumi [ 13 ]. We have chosen to implement Phi 3.0, calculating probability distributions according to the procedure described in [ 8 ]. Oizumi has empirically demonstrated that Queyranne's Algorithm provides a good approximation of the MIP in O N 3 time. We based our Python code upon the Matlab code from Kitazono and Oizumi [ 7 ] which integrates Queyranne's Algorithm with the Phi calculation to nd the MIP. We stored the (often sparse) probability distributions using Python dictionaries instead of arrays.

In our second experiment we possessed thousands of sparse time series, so we adopted a novel approach, in which we rst applied Independent Component Analysis (ICA) to reduce the problem dimensionality; and then calculated Phi from the dimensionally-reduced time series. Since it was unclear how many independent dimensions we should reduce to, we also calculated the sum of the squares of the residuals (SSR) for each dimension, and chose the dimension giving minimum total SSR. This aspect of the methodology will merit from further experimentation and re nement. 4

Measuring OpenCog's Attentional Dynamics During Reading and Dialogue We now describe two experiments in which we measured Phi values for the STI values obtained from OpenCog's Attentional Focus while carrying out practical tasks. 4.1

Experiment 1: Reading Documents About Insects and Poison For Experiment 1, we built upon an earlier experiment created to study attentional dynamics during OpenCog-based language comprehension [ 4 ]. We rst fed the OpenCog Atomspace with prior knowledge about relations between English words, based on the Wordnet and Conceptnet4 databases, and with SimilarityLinks between words with weights calculated using the Adagram neural network [ 3 ]. We started the ECAN system and the NLP pipeline, and loaded articles into the Atomspace, beginning with articles regarding insects and shifting to articles regarding poisons. As the system ingests each sentence, WordNodes corresponding to each word are stimulated with STI, thus triggering attentional focus dynamics correlated with the reading process. One goal of the study was to observe whether, after reading documents regarding insects and then poisons, attention would spread to concepts related to insecticide. This phenomenon did occur, as shown in Figure 2.

We calculated Phi values based upon the ConceptNodes \insect", \poison", and \insecticide." As Figure 3 shows, there was an interesting jump in the Phi value when \insecticide" rst became important, suggesting that the Phi increase was correlated with an increased complexity of attentional spreading within the Atomspace.

In Experiment 2 we used OpenCog and

the Ghost dialogue-control framework [ 1 ] of the Hanson AI system to control the Sophia robot. The Ghost script enabled Sophia to conduct part of a guided meditation session [ 11 ]. We found thousands of Atoms passing through the Attentional Focus, and thus leveraged the ICA-based methodology described above, using an optimal embedding dimension of 3. The Phi time series obtained are shown in Figure 4. A comparison of system log les with the Phi time series indicated that Phi was higher soon after the start of more intense verbal interaction and was lower while Sophia was watching her subject meditate or breathe deeply, etc. 5

Conclusion and Future Work Our experiments appear to demonstrate connections between sensible behavior and higher Phi values, providing preliminary validation of our methodology. One next step is to conduct signi cantly more extensive experimentation including during reasoning and pattern learning and discovery, as well as involving external environmental stimuli. We plan to further elaborate the theoretical properties of the \ICA plus Phi" pipeline. Finally, we are interested in improving our entire software pipeline to enable real-time calculation of Phi during system operation, and using those Phi values as targets for adaptive optimization of ECAN and other system parameters.

References

1. (November 2018 ), https://github.com/opencog/opencog/tree/master//opencog/ghost

2. B. , G., Hitzler , P. , Hutter , M. (eds.): Economic Attention Networks: Associative Memory and Resource Allocation for General Intelligence , vol. 171 . IOS Press ( 2008 ). https://doi.org/10.2991/agi. 2009 .19

3. Bartunov , S. , Kondrashkin , D. , Osokin , A. , Vetrov , D.P. : Breaking sticks and ambiguities with adaptive skip-gram . CoRR abs/1502 .07257 ( 2015 ), http://arxiv.org/abs/1502.07257

4. Belachew , M. , Goertzel , G. , Ikle , M. , Hanson , D.: Measuring integrated information from the decoding perspective . Biologically Inspired Cognitive Architectures 25 , 130 { 134 ( August 2018 ). https://doi.org/10.1016/j.bica. 2018 . 07 .005

5. Goertzel , B. : Characterizing human-like consciousness: An integrative approach . Procedia Computer Science 41 , 152 { 157 ( 2014 ). https://doi.org/10.1016/j.procs. 2014 . 11 .098

6. Goertzel , B. , Mossbridge , J. , Monroe , E. , Hanson , D. , Yu , G. : Humanoid robots as agents of human consciousness expansion ( 2017 ), https://arxiv.org/pdf/1709.07791

7. Kitazono , J. , Oizumi , M. : Practical PHI Toolbox (9 2018 ). https://doi.org/10.6084/m9. gshare. 3203326 .v10, https:// gshare.com/articles/phi toolbox zip/3203326

8. Krohn , S. , Ostwald , D. : Computing integrated information . Neuroscience of Consciousness 2017 ( 1), nix017 ( 2017 ). https://doi.org/10.1093/nc/nix017, http://dx.doi.org/10.1093/nc/nix017

9. Le er, T.: The hard problem of consciousness: A mathematical approach . arXiv: 1704 . 01148v2 [q-bio . NC] ( 2017 )

10. Massimini , M. , Tononi , G.: Sizing up Consciousness: Towards an objective measure of the capacity for experience . Oxford University Press ( 2018 )

11. Mossbridge , J. , Goertzel , B. , Mayet , R. , Monroe , E. , Nehat , G. , Hanson , D. , Yu , G. : Emotionally-sensitive ai-driven android interactions improve social welfare through helping people access self-transcendent states . vol. AI for Social Good Workshop at Neural Information Processing Systems 2018 Conference ( 2018 )

12. P., M.W.G. , Marshall , W. , Albantakis , L. , Findlay , G. , Marchman , R. , Tononi , G.: Pyphi: A toolbox for integrated information theory . PLoS Comput Biol ( 2018 ). https://doi.org/10.1371/journal.pcbi.1006343

13. Tegmark , M. : Improved measures of integrated information . PLOS Computational Biology 12 ( 11 ), 1 { 34 (11 2016 ). https://doi.org/10.1371/journal.pcbi. 1005123 , https://doi.org/10.1371/journal.pcbi.1005123

14. Tononi , G.: Consciousness as integrated information: a provisional manifesto . The Biological Bulletin 215 ( 3 ), 216 { 242 ( December 2008 )

15. Tononi , G. : An information integration theory of consciousness . BMC Neuroscience 5 ( 1 ), 42 ( 2004 ). https://doi.org/10.1186/ 1471 -2202-5-42, http://www.biomedcentral.com/1471-2202/5/42

16. Wang , P. , Goertzel , B. , Franklin , S. (eds.): OpenCog: A Software Framework for Integrative Arti cial General Intelligence , vol. 171 . IOS Press ( 2008 )