<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Human-AI Co-Creativity under Human Control: Framing, Reframing, Brainstorming, and Future Challenges (workshop keynote)</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>IBM Research</string-name>
          <email>muller@us.ibm.com</email>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Cambridge MA USA</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>HCAI (Human Centered AI)</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Generative AI</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>LLMs (Large Language Models)</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Conversational AI</string-name>
        </contrib>
      </contrib-group>
      <abstract>
        <p>Generative AI is increasingly important in many human activities. In this keynote, I describe a series of experiments in generative AI, using a highly-conversational user interface (UI) to large language models (LLMs). I specify multiple strategies through which the conversational paradigm can be used to achieve ethical outcomes that promote AI humility, AI brevity, human control, and co-creativity among human Generative AI has the potential to support human creativity. Over the past 60 years, scholars in Human Centered AI (HCAI) have proposed diverse models of how systems for humancomputer co-creativity can be designed. In 1961, Rhodes proposed a “4Ps” model in which “A Person engages in a computerized Process to make a Product in an environment (Press)” [1]. In this early view, the computer was primarily a tool. Almost 60 years later, Kantosalo and Takala made the most recent update in their “5Cs” model: “A Collective (a Human and an AI) Collaborate to make a Contribution for a Community in a Context” [2].</p>
      </abstract>
      <kwd-group>
        <kwd>creativity</kwd>
        <kwd>Distributed creativity</kwd>
        <kwd>Ethical AI practices</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>https://research.ibm.com/people/michael-muller (M. Muller)</p>
      <p>© 2023 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).
the conversation developed, and which aspects of the conversation would be preserved in an
analogy-based design.</p>
      <p>In our fith, unpublished experiment, we moved from specialist methods to the more
generallyadopted processes of brainstorming. A human was able to guide the UI+LLM in exercises based
on divergent-thinking, convergent-thinking, summarization, and structured
organization/reorganization of outcomes. The user structured the activity, and the AI provided content. The
user could question, critique, and reject certain content, and the AI could (when requested)
provide alternatives to that content. The user could also tell the AI to re-organize its proposed
higher-level structuring of content.</p>
      <p>
        While these initial experiments were successful, we were only able to implement a dialog
between one human and one AI. Our next projects will use a specialized environment in
which multiple humans can interact with the UI+LLM configuration, with preservation of each
human’s identity, thus adding aspects of Mutual Theory of Mind [
        <xref ref-type="bibr" rid="ref14 ref15 ref16">14, 15, 16</xref>
        ] to the co-creative
exercises. Based on the Library of Mixed-Initiative Creative Interfaces [
        <xref ref-type="bibr" rid="ref17 ref18">17, 18</xref>
        ], we are applying
mixed-initiative models [19] to human-AI dialogs. After that, we hope to revisit multi-agent
symbiotic cognitive computing architectures for a richer configuration of multiple humans and
multiple AI agents [20].
      </p>
      <p>Throughout this work, we have focused on principles of IBM’s Augmented Human
Intelligence, in which AI is used to support and extend the work of humans – not to replace humans
[21]. Following a recent debate [22], we label all AI conversational turns with an “AI” or “APP”
marker – i.e., we explicitly avoid any so-called Turing test confusions about who or what is
speaking or acting. We maintain human control of both process and outcomes.</p>
      <p>As we showed in a recent CHIWORK paper [23], these are design choices. It is possible to
create interactive AI solutions that channel and control the work of humans [24]. Recent work
by many researchers have documented the potential and actual harms of such systems (e.g.,
[25, 26, 27]). We make a diferent choice: We design for AI applications that support, educate,
and enable human abilities and human agency.</p>
      <p>Michael Muller works at IBM Research in the role of Senior Research Scientist. His work
takes place at the intersection of human-computer interaction, AI, and social justice. Michael is
known for early work in participatory design, and for co-proposing and co-leading the CHI
conference program subcommittee on Critical and Sustainable Computing and Social Justice.
His more recent work has explored possible futures for human interactions with generative
AI applications. Michael has led and participated in mentorship programs for students and
early-career scholars at multiple ACM SIGCHI conferences, including the CHI Early Career
Symposium and the CSCW Student Reviewer Mentoring program. ACM recognizes Michael as a
Distinguished Scientist. Michael co-chairs the SIGCHI CARES committee, and is a member of the
SIGCHI Research Ethics committee. He holds membership in Fempower.tech and AccessSIGCHI,
and has begun a term of service for the US National Academies of Science, Engineering and
Medicine on the Board on Human-Systems Integration (BOHSI).
//mici.codingconduct.cc/.
[19] E. Horvitz, Principles of mixed-initiative user interfaces, in: Proceedings of the SIGCHI
conference on Human Factors in Computing Systems, 1999, pp. 159–166.
[20] R. Farrell, J. Lenchner, J. Kephart, A. Webb, M. Muller, T. Erickson, D. Melville, R. Bellamy,</p>
      <p>D. Gruen, J. Connell, et al., Symbiotic cognitive computing, ai Magazine 37 (2016) 81–93.
[21] R. Mariani, F. Rossi, R. Cucchiara, M. Pavone, B. Simkin, A. Koene, J. Papenbrock,
Trustworthy ai—part 1, Computer 56 (2023) 14–18.
[22] B. Shneiderman, M. Muller, On AI anthropomorphism. Medium 4 April (2023). URL:
https://medium.com/human-centered-ai/on-ai-anthropomorphism-abff4cecc5ae.
[23] M. Muller, J. Weisz, Frameworks for collaborating humans and ais: Sequence and sociality
in organizational applications, in: CHIWORK, 2022.
[24] M. Muller, J. He, J. D. Weisz, The trouble with ai-based workflows (2023). URL:
https://www.researchgate.net/profile/Michael-Muller-12/publication/368242833_
The_Trouble_with_AI-Based_Workflows/links/63dd67fc62d2a24f92f5a04d/
The-Trouble-with-AI-Based-Workflows.pdf.
[25] N. Holten Møller, G. Nef, J. G. Simonsen, J. C. Villumsen, P. Bjørn, Can workplace tracking
ever empower? collective sensemaking for the responsible use of sensor data at work,
Proceedings of the ACM on human-computer interaction 5 (2021) 1–21.
[26] C. Lin, S. Margot Lindtner, Techniques of use: Confronting value systems of productivity,
progress, and usefulness in computing and design, in: Proceedings of the 2021 CHI
Conference on Human Factors in Computing Systems, 2021, pp. 1–16.
[27] R. Shelby, S. Rismani, K. Henne, A. Moon, N. Rostamzadeh, P. Nicholas, Y.-A. N’MAH,
J. Gallegos, A. Smart, G. VIRK, Identifying sociotechnical harms of algorithmic systems:
Scoping a taxonomy for harm reduction, arXiv preprint arXiv:2210.05791 (2022).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>M.</given-names>
            <surname>Rhodes</surname>
          </string-name>
          ,
          <article-title>An analysis of creativity</article-title>
          ,
          <source>The Phi Delta Kappan</source>
          <volume>42</volume>
          (
          <year>1961</year>
          )
          <fpage>305</fpage>
          -
          <lpage>310</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>A.</given-names>
            <surname>Kantosalo</surname>
          </string-name>
          , T. Takala,
          <article-title>Five C's for human-computer co-creativity-an update on classical creativity perspectives</article-title>
          ., in: ICCC,
          <year>2020</year>
          , pp.
          <fpage>17</fpage>
          -
          <lpage>24</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>V. P.</given-names>
            <surname>Glăveanu</surname>
          </string-name>
          , Distributed creativity: What is it?, Springer,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>S. I.</given-names>
            <surname>Ross</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Martinez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Houde</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Muller</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. D.</given-names>
            <surname>Weisz</surname>
          </string-name>
          ,
          <article-title>The programmer's assistant: Conversational interaction with a large language model for software development</article-title>
          ,
          <source>in: Proceedings of the 28th International Conference on Intelligent User Interfaces</source>
          ,
          <year>2023</year>
          , pp.
          <fpage>491</fpage>
          -
          <lpage>514</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>S. I.</given-names>
            <surname>Ross</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Muller</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Martinez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Houde</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. D.</given-names>
            <surname>Weisz</surname>
          </string-name>
          ,
          <article-title>A case study in engineering a conversational programming assistant's persona</article-title>
          ,
          <source>arXiv preprint arXiv:2301.10016</source>
          (
          <year>2023</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>M.</given-names>
            <surname>Mose Biskjaer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Dalsgaard</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Halskov</surname>
          </string-name>
          ,
          <article-title>Understanding creativity methods in design</article-title>
          ,
          <source>in: Proceedings of the 2017 conference on designing interactive systems</source>
          ,
          <year>2017</year>
          , pp.
          <fpage>839</fpage>
          -
          <lpage>851</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>J.</given-names>
            <surname>Schleith</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Norkute</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Mikhail</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Tsar</surname>
          </string-name>
          ,
          <article-title>Cognitive strategy prompts: Creativity triggers for human centered ai opportunity detection</article-title>
          ,
          <source>in: Creativity and Cognition</source>
          ,
          <year>2022</year>
          , pp.
          <fpage>29</fpage>
          -
          <lpage>37</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>Z.</given-names>
            <surname>Wu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Ji</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Yu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            <surname>Zeng</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Wu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Shidujaman</surname>
          </string-name>
          ,
          <article-title>Ai creativity and the human-ai cocreation model, in: Human-Computer Interaction</article-title>
          . Theory, Methods and Tools: Thematic Area,
          <string-name>
            <surname>HCI</surname>
          </string-name>
          <year>2021</year>
          ,
          <article-title>Held as Part of the 23rd HCI International Conference</article-title>
          , HCII 2021,
          <string-name>
            <given-names>Virtual</given-names>
            <surname>Event</surname>
          </string-name>
          ,
          <source>July 24-29</source>
          ,
          <year>2021</year>
          , Proceedings,
          <source>Part I 23</source>
          , Springer,
          <year>2021</year>
          , pp.
          <fpage>171</fpage>
          -
          <lpage>190</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>M.</given-names>
            <surname>Muller</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Candello</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Weisz</surname>
          </string-name>
          ,
          <article-title>Interactional co-creativity of human and ai in analogybased design</article-title>
          ,
          <source>in: International Conference on Computational Creativity</source>
          ,
          <year>2023</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>A.</given-names>
            <surname>Liapis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. N.</given-names>
            <surname>Yannakakis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Alexopoulos</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Lopes</surname>
          </string-name>
          ,
          <article-title>Can computers foster human users' creativity? theory and praxis of mixed-initiative co-creativity (</article-title>
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>C.</given-names>
            <surname>Walsh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Chappell</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Craft</surname>
          </string-name>
          ,
          <article-title>A co-creativity theoretical framework to foster and evaluate the presence of wise humanising creativity in virtual learning environments (vles</article-title>
          ),
          <source>Thinking skills and creativity 24</source>
          (
          <year>2017</year>
          )
          <fpage>228</fpage>
          -
          <lpage>241</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>N.</given-names>
            <surname>Kelly</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. S.</given-names>
            <surname>Gero</surname>
          </string-name>
          ,
          <source>Creative systems that generate and explore</source>
          ,
          <year>2015</year>
          . URL: https://api. semanticscholar.org/CorpusID:55272279.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>M.</given-names>
            <surname>Muller</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Weisz</surname>
          </string-name>
          ,
          <article-title>Analogies-based design using a generative ai application: A play in three acts</article-title>
          ,
          <year>2023</year>
          . URL: https://www.researchgate.net/publication/372060579_
          <article-title>Analogies-based_Design_using_a_Generative_AI_Application_A_Play_in_Three_Acts.</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>F.</given-names>
            <surname>Cuzzolin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Morelli</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Cirstea</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B. J.</given-names>
            <surname>Sahakian</surname>
          </string-name>
          ,
          <article-title>Knowing me, knowing you: theory of mind in ai</article-title>
          ,
          <source>Psychological medicine 50</source>
          (
          <year>2020</year>
          )
          <fpage>1057</fpage>
          -
          <lpage>1061</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>Q.</given-names>
            <surname>Wang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Saha</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Gregori</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Joyner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Goel</surname>
          </string-name>
          ,
          <article-title>Towards mutual theory of mind in humanai interaction: How language reflects what students perceive about a virtual teaching assistant</article-title>
          ,
          <source>in: Proceedings of the 2021 CHI conference on human factors in computing systems</source>
          ,
          <year>2021</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>14</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>A. F.</given-names>
            <surname>Winfield</surname>
          </string-name>
          ,
          <article-title>Experiments in artificial theory of mind: From safety to story-telling</article-title>
          ,
          <source>Frontiers in Robotics and AI</source>
          <volume>5</volume>
          (
          <year>2018</year>
          )
          <fpage>75</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>S.</given-names>
            <surname>Deterding</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Hook</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Fiebrink</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Gillies</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Gow</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Akten</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Smith</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Liapis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Compton</surname>
          </string-name>
          ,
          <article-title>Mixed-initiative creative interfaces</article-title>
          ,
          <source>in: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems</source>
          ,
          <year>2017</year>
          , pp.
          <fpage>628</fpage>
          -
          <lpage>635</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>A.</given-names>
            <surname>Spoto</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Oleynik</surname>
          </string-name>
          ,
          <article-title>Library of mixed-initiative creative interfaces</article-title>
          ,
          <year>2017</year>
          . URL: http:
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>