<?xml version="1.0" encoding="UTF-8"?>
<TEI xml:space="preserve" xmlns="http://www.tei-c.org/ns/1.0" 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" 
xsi:schemaLocation="http://www.tei-c.org/ns/1.0 https://raw.githubusercontent.com/kermitt2/grobid/master/grobid-home/schemas/xsd/Grobid.xsd"
 xmlns:xlink="http://www.w3.org/1999/xlink">
	<teiHeader xml:lang="en">
		<fileDesc>
			<titleStmt>
				<title level="a" type="main">Why try to build try to build a co-creative poetry system that makes people feel that they have &quot;creative superpowers&quot;? ⋆</title>
			</titleStmt>
			<publicationStmt>
				<publisher/>
				<availability status="unknown"><licence/></availability>
			</publicationStmt>
			<sourceDesc>
				<biblStruct>
					<analytic>
						<author role="corresp">
							<persName><forename type="first">Ibukun</forename><surname>Olatunji</surname></persName>
							<email>2030349@swansea.ac.uk</email>
							<affiliation key="aff0">
								<orgName type="department">Computational Foundry</orgName>
								<orgName type="institution">Swansea University</orgName>
								<address>
									<addrLine>Crymlyn Burrows</addrLine>
									<postCode>SA1 8EN</postCode>
									<settlement>Skewen</settlement>
									<region>Swansea</region>
									<country key="GB">United Kingdom</country>
								</address>
							</affiliation>
						</author>
						<title level="a" type="main">Why try to build try to build a co-creative poetry system that makes people feel that they have &quot;creative superpowers&quot;? ⋆</title>
					</analytic>
					<monogr>
						<idno type="ISSN">1613-0073</idno>
					</monogr>
					<idno type="MD5">ACA45895D69BAC5347B287DE2ED1C11D</idno>
				</biblStruct>
			</sourceDesc>
		</fileDesc>
		<encodingDesc>
			<appInfo>
				<application version="0.7.2" ident="GROBID" when="2023-03-23T22:57+0000">
					<desc>GROBID - A machine learning software for extracting information from scholarly documents</desc>
					<ref target="https://github.com/kermitt2/grobid"/>
				</application>
			</appInfo>
		</encodingDesc>
		<profileDesc>
			<textClass>
				<keywords>
					<term>Creativity</term>
					<term>poetry</term>
					<term>co-creativity</term>
					<term>natural language processing</term>
					<term>language models</term>
					<term>writing support tools</term>
					<term>data sets</term>
				</keywords>
			</textClass>
			<abstract>
<div xmlns="http://www.tei-c.org/ns/1.0"><p>The paper examines co-creative writing systems, and argues that existing Large Language Models could potentially reduce human capacity. Furthermore, existing sociocultural inequalities might be exacerbated by the widespread adoption of such generative systems. The paper instead suggests a custom approach, using co-creative poetry writing as an example. The system has architectural changes from typical language models to better support poetry. It also uses rap lyrics as part of the training data in order to help reduce sociocultural bias. A high level system implementation is proposed along with some evaluation methods. Evaluation is based on expert judgement on final outputs, and user performance on language tasks associated with human creativity. The final section of the paper explores how and why alternatives to existing co-creative systems could benefit individual users as well as wider society.</p></div>
			</abstract>
		</profileDesc>
	</teiHeader>
	<text xml:lang="en">
		<body>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="1.">Introduction</head><p>This paper examines co-creative systems using poetry writing as an example. Within the paper 'poetry' includes song lyrics. Section one of the paper explores poetry in terms of human creativity. Poetry is chosen as it is a creative task that non-expert humans can outperform machines on vs creative outputs such as image generation. After introducing the case for poetry, there is an exploration of recent work in generative computational systems. As well as being the technical state of the art, these systems provide a conceptual framework to explore sociocultural issues such as bias and inclusion. Section one then explores a range of poetry-specific systems and ends with a more detailed case study. The case study examines a system that combines elements of more powerful general models and custom architectural features specific to poetry writing. Section two details the evaluation issues and methods that might be employed for the proposed co-creative system. The emphasis on this section is on how to evaluate human improvement over time. Section three explores a high level implementation of the system. It builds on the evaluation to propose both an architecture and a method to testing if the proposed system has, in principal, any benefits over and above those described in section one. Section four is a</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="1.1.">Human Creativity</head><p>Human creativity is the ability to come up with ideas or artefacts that are new, surprising, and valuable. Rather than a solitary act, it results from the interaction of social elements; a culture that contains symbolic rules, a person who brings novelty into the symbolic domain, and people who recognise and validate the innovation. <ref type="bibr" target="#b0">[1,</ref><ref type="bibr" target="#b1">2,</ref><ref type="bibr" target="#b2">3]</ref>. Boden makes a further distinction between psychological and historical creativity (P-creativity and H-creativity). P-creativity involves coming up with an idea that's new to the person who comes up with it. H-creativity means that (so far as we know) no-one else has had it before: it has arisen for the first time in human history <ref type="bibr" target="#b1">[2,</ref><ref type="bibr" target="#b3">4]</ref>. Machine learning models have the potential to support human creativity <ref type="bibr" target="#b4">[5,</ref><ref type="bibr" target="#b5">6,</ref><ref type="bibr" target="#b6">7]</ref>. However, questions remain on their design and influence in augmenting human capacity as opposed to reducing it <ref type="bibr" target="#b7">[8,</ref><ref type="bibr" target="#b8">9,</ref><ref type="bibr" target="#b9">10]</ref>. Shneiderman suggests that "researchers' goals shape the questions they raise, collaborators they choose, methods they use, and outcomes of their work. " <ref type="bibr" target="#b10">[11]</ref>. This leads to the question: how can designers of programming interfaces, interactive tools, and rich social environments enable more people to be more creative more often? <ref type="bibr" target="#b11">[12]</ref> Language Model Characteristics </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="1.2.">Computational Systems</head><p>In computational terms, automated systems are now capable of writing poetry approaching human levels <ref type="bibr" target="#b12">[13,</ref><ref type="bibr" target="#b13">14,</ref><ref type="bibr" target="#b14">15]</ref>. Karimi et al consider three three main strategies by which the role of humans in creative systems can be characterized: fully autonomous systems, creativity support tools, and co-creative systems <ref type="bibr" target="#b15">[16]</ref>. Although the paper is primarily concerned with co-creative systems, it will to blend the categories where necessary. The reasoning for this is that the human users do not make the same distinctions; also, the features and usage are often blended in the real-world, e.g an autonomous system that is used by a creator as an input and thus becomes a support tool and/or co-creative system <ref type="bibr" target="#b9">[10]</ref>. The next section briefly outlines the state of the art in computational writing systems. Language models (LMs) refer to systems that are trained on string prediction tasks: predicting the likelihood of a token (character, word or string) given either the preceding context or its surrounding context. Such systems are unsupervised and when deployed, take text as input, and output scores or string predictions <ref type="bibr" target="#b16">[17]</ref>. Large Language Models (LLMs) trained on sufficiently large and diverse data sets are able to perform well across domains and there is a correlation between model performance and size <ref type="bibr" target="#b17">[18]</ref>. State-of-the-art models are able to generate text that approach or surpasses that of some humans <ref type="bibr" target="#b12">[13,</ref><ref type="bibr" target="#b13">14,</ref><ref type="bibr" target="#b14">15,</ref><ref type="bibr" target="#b18">19]</ref>. The emphasis on some humans is an important with respect to user characteristics; in broad terms, humans co-creating poetry can be considered as either inexperienced or advanced users. Research on creative tasks such as improvisation suggests that users vary in cognitive processing based in part on their experience and skills levels <ref type="bibr" target="#b19">[20,</ref><ref type="bibr" target="#b20">21]</ref>. A well-designed cocreative system should therefore take differences in user support needs into account <ref type="bibr" target="#b7">[8,</ref><ref type="bibr" target="#b8">9,</ref><ref type="bibr" target="#b21">22]</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="1.3.">General Purpose Language Generation</head><p>LLMs are trained to predict the next word, or series of words, in a a text sequence. They model text corpora as probability distributions. Users write a short text prompts to tell the system what to generate. Depending on how many examples are provided in the text prompt, the system is referred to as zero-, one-, and few-shot learning <ref type="bibr" target="#b12">[13,</ref><ref type="bibr" target="#b14">15,</ref><ref type="bibr" target="#b16">17]</ref>. Pretrained language models have become a cornerstone of modern natural language processing (NLP) pipelines because they often produce better performance from smaller quantities of labeled data <ref type="bibr" target="#b22">[23]</ref>. Within general LLMs, the transformer has established itself as best performing on benchmark language processing tests <ref type="bibr" target="#b12">[13,</ref><ref type="bibr" target="#b14">15,</ref><ref type="bibr" target="#b23">24]</ref>. As well as being able to perform tasks such as text summarising and question answering, LLMs have the potential to support creative writing <ref type="bibr" target="#b5">[6,</ref><ref type="bibr" target="#b7">8,</ref><ref type="bibr" target="#b8">9]</ref>  <ref type="table" target="#tab_0">1</ref>) and, (e) most LLMs are primarily trained on English-language text that contains data biases <ref type="bibr" target="#b12">[13]</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="1.4.">Poetry Specific Language Generation</head><p>Creating poetry is creative skill that requires extensive vocabulary, phonemic awareness to produce complex rhyme patterns, and general knowledge of enough subjects about the world to be able to tell interesting stories about a range of topics <ref type="bibr" target="#b19">[20,</ref><ref type="bibr" target="#b24">25,</ref><ref type="bibr" target="#b25">26,</ref><ref type="bibr" target="#b26">27]</ref>. </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Poetry Creation Systems</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="1.5.">Overview of Poetry Support Tools</head><p>Historically, poetry creation systems tended to built on the model of the an AI writing a full poem by itself, thus writing in a closed system <ref type="bibr" target="#b27">[28,</ref><ref type="bibr" target="#b28">29,</ref><ref type="bibr" target="#b29">30,</ref><ref type="bibr" target="#b30">31]</ref>. Early systems tended to be rule-based <ref type="bibr" target="#b31">[32]</ref>. More recently, some approaches have started to explore human interaction when composing poems <ref type="bibr" target="#b32">[33,</ref><ref type="bibr" target="#b33">34]</ref>. Table <ref type="table" target="#tab_2">2</ref> provides a broad summary of selected systems including autonomous, support tools and co-creative as defined by Karimi et al <ref type="bibr" target="#b15">[16]</ref>.</p><p>The category distinction helps frame a range of (human) creative processes and (technology) interactions. It is also a useful way to consider ways in which the proposed system is different to those that currently exist; and as importantly, ways in which it is similar. At a high level, the autonomous systems are designed to be able to create finished works (sometimes called 'products' or 'artefacts'). The support tools are used as part of the creative workflow. For instance, RhymZone or Rhymer help a user find words that sound similar to those they might use in a poem <ref type="bibr" target="#b34">[35,</ref><ref type="bibr" target="#b35">36]</ref>. Co-creative systems facilitate humans and computational systems to make shared products. That said, the distinction is not fixed. For example, Rytr, contains text editing, display and other features that allow it to operate as both a co-creative and autonomous system <ref type="bibr" target="#b36">[37]</ref>. Having looked at the computational systems, it is instructive to briefly consider poetry writing from a human perspective. It will help inform the design of a new poetry writing system. Writing poetry requires a range of general creative skills that can be framed in terms of divergent and convergent thinking; these are used in varying ways throughout a multi-stage writing process. For simplicity, the stages include (a) exploration which is characterised by divergent thinking <ref type="bibr" target="#b20">[21,</ref><ref type="bibr" target="#b37">38,</ref><ref type="bibr" target="#b38">39,</ref><ref type="bibr" target="#b39">40]</ref>; (b) focused work is uses convergent thinking <ref type="bibr" target="#b20">[21,</ref><ref type="bibr" target="#b40">41]</ref> and, (c) re-drafting. It is useful in the stages to distinguish between internal and external co-creation system activities. Internal is when the user interacts with the system in real-time, e.g writing or redrafting text; external is when the user participates in activities such as browsing, reading or other things that do not not use the system. The framing of internal and external system activities is based on the reasoning that; (a) skill: inexperienced users are unlikely to possess the improvisational skill required to create full poems in real-time due to cognitive processing constraints <ref type="bibr" target="#b19">[20,</ref><ref type="bibr" target="#b41">42]</ref>; (b) speed: users might choose to write poems over mul-tiple sessions, in this case external system stimuli could have supported the writing; (c) knowledge: advanced writers are usually familiar with a body of existing that informs their work <ref type="bibr" target="#b0">[1]</ref> and, (d) process: reflecting and redrafting is an important part of writing . The reflecting stage often takes place separately to the creation of the work itself <ref type="bibr" target="#b0">[1,</ref><ref type="bibr" target="#b9">10]</ref>. </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="1.6.">Case Study: Verse by Verse</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Screenshot from Verse by Verse application by Google</head><p>Google Research Verse by Verse is relevant case study as it is arguably the most technically advanced poetryspecific generative system. As well as using transformer model architecture, it also uses informational retrieval, and considers bias within its design. Verse by Verse augments user poetry composition by offering suggestions to a user as they compose a poem. The authors of the system argue that relative to a creating full poems, "this is a much more challenging task, as one needs be able to offer suggestions with minimal latency while meeting constraints of the poem structure and handle the challenges of user input <ref type="bibr" target="#b33">[34]</ref>. Figure <ref type="figure" target="#fig_0">1</ref> shows part of the system's user interface (for PC). From a user's point of view, the experience is as follows (a) the user selects poet(s) to inform the suggestions; (b) the user designs poem structure as illustrated in figure <ref type="figure" target="#fig_1">2;</ref> (c) the user writes the first line of text and, (d) the system offers suggestions in the style of the poet(s) the user selected earlier. The user can then work with, modify or have the system create new verses. The Verse by Verse design has an external system context that, in general , LLMs do not. To some extent, the system helps poetry writers become better readers. In his work on creativity it was suggested to Csikszentmihalyi that "the only way you become a poet...is because you've read a poem...poetry depends on the whole poetic tradition of the past...you have to decide...out of all that previous poetry, what is most interesting to me?" <ref type="bibr" target="#b0">[1]</ref> Verse by Verse, by making users aware of the work of other poets, helps users become readers in order to inform their own poetic development.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2.">Experiment Design</head><p>Verse by Verse ran comparative evaluations of the system against poems written by classic poets. Although the system was intended to be used as an interactive co-creator for the human writing a poem, the author's stated it was still worth evaluating how the system could perform on its own in writing a poem given a first line of verse <ref type="bibr" target="#b33">[34]</ref>. This approach has been adopted within the proposed system experimental design, implementation and evaluation. The next subsection explores evaluation prior to looking at implementation. The rationale is that the evaluation is perhaps a harder problem as it involves an intersection of multiple disciplines (e.g. computational sciences, arts, linguistics, and pedagogy). Implementation can mostly be restricted to computational science domains.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2.1.">Evaluation Overview</head><p>Evaluating co-creative systems is still an open research question and there is no standard metric for measuring computational co-creativity <ref type="bibr" target="#b15">[16,</ref><ref type="bibr" target="#b42">43]</ref>. Karimi et al describe the limited research investigating how co-creative systems can be evaluated. They present four questions as a way to compare how (existing) co-creative systems evaluate creativity: who is evaluating the creativity, what is being evaluated, when does evaluation occur ,and how the evaluation is performed <ref type="bibr" target="#b15">[16]</ref>. Calderwood et al point out that "writers engaged with co-creative systems are looking for creative insight, something not measured by perplexity or by a language model's ability to solve the canonical downstream NLP tasks <ref type="bibr" target="#b4">[5]</ref>. For the evaluation of the system proposed to be effective it is insightful to restate its goals in more detail. The co-creative poetry system's goal is "making people feel that they have "creative superpowers"? To achieve this, the system supports users to create better poetry than they might otherwise have done without the system. The terms supports and better will be further explored as they form the basis of evaluation.</p><p>Augmenting human users is central to HCAI and a contrast to a closed model that creates on behalf of the user <ref type="bibr" target="#b7">[8,</ref><ref type="bibr" target="#b33">34,</ref><ref type="bibr" target="#b43">44]</ref>. This point is made in recent work that refers to pitfalls when designing human-AI co-creative systems, as well as other work which asserts that generative models can help writers without writing for them <ref type="bibr" target="#b4">[5,</ref><ref type="bibr" target="#b8">9,</ref><ref type="bibr" target="#b21">22]</ref>. The arguments these, and similar work, make is that too much automated creation can be at the expense of human users <ref type="bibr" target="#b8">[9,</ref><ref type="bibr" target="#b21">22]</ref>. Adopting this thinking, it is useful to evaluate the system and its users independently, as well as in combination. This in theory allows (system) internal and (human) internal and external measurement.</p><p>The end goal here is that human users develops their capacity; this could be external to the system, whereby the system as acted as a creative prompt. A description of how this could work in principle follows. A later section describes system implementation.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2.2.">Process and Objectives</head><p>The system would run a number of experiments with the purpose of establishing which system components most support users to write "better" poetry; in goal terms, better is evaluated (a) subjectively by users via a Likert scale <ref type="bibr" target="#b44">[45]</ref> and (b) by performance on related tasks such as the Divergent Action Task, Bridge-the-Associative-Gap Task, or rhyme creation and identification <ref type="bibr" target="#b45">[46,</ref><ref type="bibr" target="#b46">47]</ref> The tasks would be completed external to the system. The goals of the evaluation are to measure to what extent users are actually improving their poetry writing abilities, and the degree to which any improvement is as a result of internal system features. For a user, improvement is concerned with "the writer's goals or their desire to have an individual voice" <ref type="bibr" target="#b8">[9]</ref>. With this as a basis, the evaluation process takes the form of a number of hypotheses and related experiments, the purpose of which is to explore; (a) how well general vs poetry specific language models can write full poems; (b) if poetry specific language models can better represent individual users style than generalised language models; and, (c) the extent to which users benefit when writing poems from system recommendations. The hypotheses and experiments are concerned with poetic text style which describes the ways (an author) uses language, including prosody, word choice, sentence structure and use of figurative language <ref type="bibr" target="#b47">[48,</ref><ref type="bibr" target="#b48">49]</ref>.</p><p>A central challenge for the proposed system is that the development and attainment of an individual poetic voice is highly subjective. Beyond subjectivity, poetry is from a societal perspective often a question of cultural value which over time may well change. In reference to Kendrick Lamar's 2018 Pulitzer Prize, a first for a rap album, their administrator of prizes said, "..this is not a genre we've seen celebrated before, so that in that sense it's historical. " <ref type="bibr" target="#b49">[50]</ref> Furthermore, as Boden states, "...even in science, values are often elusive and sometimes changeable...because values are highly variable, it follows that many arguments about creativity are rooted in disagreements about value. This applies to human activities no less than to computer performance. " <ref type="bibr" target="#b1">[2]</ref> 1. Hypothesis-A that poetry specific language generation could outperform general language generation with respect to creating poems.</p><p>Experiment A: each system-state generates complete poetic texts. The prompts would also be given to users (inexperienced and advanced ) with the same constraints as the system in terms of keywords, topics, character limits etc. The evaluation for experiment A is by humans who judge the quality of the poems (which are anonymous) by a Likert scale and free text summary.</p><p>2. Hypothesis-B that poetry specific language generation customised for a given user could outperform vanilla poetry specific generation with respect to creating poems. Experiment B: each system state generates complete poetic text but some states are pretrained to customise characteristics with respect to given users and their poetic styles. The evaluation for experiment B is by humans who judge the quality of the poems by a Likert scale and free text summary.</p><p>The evaluation is focused on how well the poems represent the given users' individual style.</p><p>3. Hypothesis-C that external recommendations, full or part poems, based on given user characteristics are supportive with respect to users writing their poems. Experiment C: for given users generated poetic text inputs, the system state generates (external to system) poetic text recommendations that the user reads and reflects on before completing their poem. The evaluation for experiment C is by humans who judge how well the poem recommendations helped them write poems in the theme, topic or style they were attempting to achieve.</p><p>The approach described provides a sense of how user activities (internal and external) with respect to the system can be evaluated. In practice, more fine-grained evaluation criteria would be required based on further research and operational or implementation design; as far as possible, a complete system would have an awareness of all relevant evaluation data including for instance, external system reading of poems. At this stage, the evaluation proposed is limited to the extent necessary in order to support the explanation of how and why the system might work. A later section (Limitations and Future Work) will the explore the limitations as suggest possible remedies.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.">Proposed Implementation</head><p>The system would have a number of states that range from full automation to text prompts acting as a starting point for the user. The support states envisaged are:</p><p>1. State-A: general language system implemented as standard.</p><p>2. State-B: general language system implemented with modified architecture to include user generated content within training set and/or network architecture preferences. 3. State-C: poetry specific system implemented with standard architecture. 4. State-D: poetry specific system implemented with modified architecture to include user generated content within training set and/or network architecture preferences.</p><p>The LLM component of the system would use publicly available APIs an, where possible, modify network architecture directly where possible <ref type="bibr" target="#b50">[51,</ref><ref type="bibr" target="#b51">52,</ref><ref type="bibr" target="#b52">53]</ref>. In most cases (table <ref type="table" target="#tab_0">1</ref>) LLM are closed black box systems as illustrated in (figure <ref type="figure">3</ref>). In part for this reason, ideally a custom poetry and lyric language model would be implemented; aside from practicalities (which will be discussed) there is a a technical challenge in that a poetry and lyric LM would be far smaller than a general LLM. Given the research on LLM size and performance, a custom poetry and lyric LM would in theory therefore under perform against state-of-the-art LLMs <ref type="bibr" target="#b17">[18,</ref><ref type="bibr" target="#b53">54,</ref><ref type="bibr" target="#b14">15]</ref>. In line with a recent study, which experimented with user experiences of language models, the system could be implemented with a combination of JavaScript, React, Python and Flask <ref type="bibr" target="#b7">[8]</ref>. The system would then be deployed as a web application for mobile phones. Mobile is preferred to PC on the basis of its greater reach as a device for both reading and creating contemporary poetry <ref type="bibr" target="#b54">[55,</ref><ref type="bibr" target="#b55">56]</ref>. </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.1.">Sparse And Dense Network Model</head><p>The system (figure <ref type="figure" target="#fig_1">2</ref>) operates as a Sparse And Dense Network (SPAD). The name refers to the system being sparse with respect to user input tokens as compared to tokens contained in the LM/LLMs. Against this, the system is dense in terms of leveraging transformer models and their associated attention layers (table <ref type="table" target="#tab_0">1</ref>). The intuition is to use a small amount of personalised user text to attempt to customise the output of powerful LMs/LLMs. This differs from existing approaches in the following ways.</p><p>• State-of-the-Art LLMs form part of the SPAD in order to help improve the SPADs performance; in other words, the LLMs are source of input training data and as such multiple LLMs could in theory be included in the SPAD architectural design. • A poetry specific LLM (GPT-NeoX) forms part of the design; poetry specific refers to adaptations to the underlying model architecture in order that token processing and output is more optimal with respect to poetry than prose. An example of this might be applying additional linguistic layers within the network to favour text strings with syllable frequencies found more regularly in poems than say news articles or web pages.</p><p>Although architecture is referred to, much of any benefit at this stage might come from modifying the training data and associated recipes. The poetry specific LLM would also leverage data from the general LLM (for simplicity any interaction between the two elements is not included in figure <ref type="figure" target="#fig_1">2</ref>). • Poetry and lyric LM is a custom model whose network architecture and training data is specific to poetry. In practical terms it is not a LLM as the available training data is not likely to be sufficiently extensive vs the current state of the art.</p><p>As well as providing a data contrast to the LLMs, this part of the network will also act as a style transfer layer in so far as it identifies and tries to modify input text to create poetic styles. These styles will be mapped onto user styles upstream within the system.</p><p>The result of the models described above, is a system that contains information on generalized poetic style as well as individual style preference(s) unique for each user. This allows the system to support users with specific co-writing tasks (e.g text generation) as well as offer personalised recommendations further reading of relevant poems and/or poets. In user experience terms, this might be delivered via an interface that allows the user to switch between (a) writing text; (b) editing generated text; and (c) reading and reflecting on specific poetic recommendations made by the system.</p><p>At this stage, the proposed mode is high-level. There are open questions relating to issues such as real world implementation, customisation of user text, acquisition of training data and other areas. The penultimate section will revisit some of the open design questions and attempt to provide answers. The next section explores the soical significance of poetry and how the a system design could use this to enhance cultural inclusiveness.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4.">Discussion</head><p>An important goal for poetry is for each writer to discover or develop their own unique style, or artistic voice. Part of a writers development will a result of what poetry they have previously been exposed to. Robert Graves stated that, "only a poet of experience...can hope to put himself in the shoes of his predecessors, or contemporaries, and judge their poems by recreating technical or emotional dilemmas which they faced while at work on them. " <ref type="bibr" target="#b56">[57]</ref> It can be argued that this statement is, in contemporary terms, biased in gender terms given the assumption of 'poet' being male. Graves's central argument about experience however is echoed in recent studies on language models. A study by Cheng and Uthus made the point that "as creative works are often shaped by the lived experiences and timely issues of the creator's life, a poetry composition system trained on poems from different authors of different eras may reflect a variety of societal biases. " <ref type="bibr" target="#b57">[58]</ref> Within computer science, social bias is a subject gathering more research attention <ref type="bibr" target="#b16">[17,</ref><ref type="bibr" target="#b58">59,</ref><ref type="bibr" target="#b59">60]</ref> However, as well as attempting to mitigate negative impacts for disadvantaged groups, considering bias also offers possibility of designing systems that leverage cultural, poetic and linguistic resources that would otherwise be missed. This can benefit all user groups. The next section provides a more concrete example.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4.1.">Bias in Language Models</head><p>It has been recognised and accepted in recent years that LLM used for text generation contain bias <ref type="bibr" target="#b16">[17,</ref><ref type="bibr" target="#b59">60]</ref> A study by Uthus suggests that "biases in creative language applications are under explored"; it goes on to say it is important to examine biases in these applications because they intended for contexts such as self-expression, collective social enjoyment, and education <ref type="bibr" target="#b57">[58]</ref>. One of the key sources of bias in LLM is in the training data sets. LLM retains the biases of the data they have been trained on <ref type="bibr" target="#b14">[15]</ref>. Typically the model's pick up on, or reflect, biases and overtly abusive language patterns in training data. This can lead to harms for some users such as encountering derogatory language or discriminatory language (e.g. racist, sexist or ableist) <ref type="bibr" target="#b16">[17]</ref>. Studies have how that harms can also exist because of (a) exclusionary social norms in language within language. For example, 'family' is often defined as a basic social unit consisting of a married woman, man and their children; language models internalizing such social norms could be highly discriminatory towards people outside this definition <ref type="bibr" target="#b59">[60]</ref>; (b) greater propensity to label of language of marginalized or underrepresented groups as toxic in hate speech detection (e.g. the 'angry black woman' stereotype) <ref type="bibr" target="#b59">[60]</ref>; and (c) over representation of certain groups such as white males 18-34 within widely used training data (e.g Reddit posts) <ref type="bibr" target="#b16">[17]</ref>. Bender et al assert that, "in the case of US and UK English...white supremacist and misogynistic, ageist, etc. views are over represented in the training data, not only exceeding their prevalence in the general population. " <ref type="bibr" target="#b16">[17]</ref>. The authors go on to say that the data underpinning LMs stands to "misrepresent social movements and disproportionately align with existing regimes of power. "</p><p>There are a number of studies that explore bias mitigation through computational techniques such as (a) augmentation of the training data using style transfer <ref type="bibr" target="#b57">[58]</ref> or (b) using counterfactuals to reduce sentiment bias <ref type="bibr" target="#b58">[59]</ref>. However, in their study describing GPT-3 the authors caution against on over reliance on computational solutions. They instead ask for "...more research that engages with the literature outside NLP, better articulates normative statements about harm, and engages with the lived experience of communities affected by NLP systems...mitigation work should not be approached purely with a metric driven objective to 'remove' bias...but in a holistic manner <ref type="bibr" target="#b14">[15]</ref>. For the use case of a poetry cocreation system, bias could be potentially mitigated by including rap lyrics as a key part of the training data set.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4.2.">Towards Culturally Responsive Models</head><p>Emerging from a hobby of African American youth in the 1970s, rap (as an element of hip-hop) has quickly evolved into a mainstream culture and is the most popular music genre in the U.S and many other territories <ref type="bibr" target="#b60">[61,</ref><ref type="bibr" target="#b61">62,</ref><ref type="bibr" target="#b62">63,</ref><ref type="bibr" target="#b63">64]</ref>. Writing rap lyrics requires both creativity to construct a meaningful, interesting story and lyrical skills to produce complex rhyme patterns <ref type="bibr" target="#b25">[26,</ref><ref type="bibr" target="#b47">48,</ref><ref type="bibr" target="#b64">65]</ref>; within the culture of rap, writers are evaluated by peers on the basis of their wordplay, linguistic complexity and ability to use multiple rhyme types (perfect and imperfect) as well as multi-syllabic rhymes <ref type="bibr" target="#b25">[26,</ref><ref type="bibr" target="#b65">66]</ref>. In many ways, the writer within the hip-hop tradition sets language puzzles for their audience. In a recent BBC documentary, Chuck D, the founder of Public Enemy remarked that "poets were always...going to give you everything the truth...that's very important not only in the realm of hip hop...but in the realm of artistry." <ref type="bibr" target="#b66">[67]</ref> Recent computational studies have explored rap on account it its complexity and cultural significance <ref type="bibr" target="#b64">[65,</ref><ref type="bibr" target="#b67">68,</ref><ref type="bibr" target="#b68">69]</ref>. Rap has historically been excluded from most mainstream discussions on co-creative systems and poetry writing. There may well be valid reasons for this such as language appropriateness, perception around negative sentiments, offensive content, and difficulties in accessing material under copyright. However, although there are challenges, the benefits of using extensive rap lyrics within LM data sets include:</p><p>• Training data that represents wider audience concerns, thoughts and feelings.</p><p>• Training data will be dynamic and reflect contemporary sociopolitical issues. • Opens up the possibility of bring voices from excluded communities into the NLP community. • LMs would be enhanced by a linguistically rich and varied source of data.. • Allows lyrics to be part of a wider conversation which potentially generates. new research insight (for computational, language and social researchers).</p><p>Ultimately, as contemporary music's biggest genre, and the one most concerned with rhyme and wordplay, there are multiple reasons to explore using rap lyrics as training data.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5.">Limitations and Future Work</head><p>The paper has a number of limitations. Below some of these are described along with suggested directions for future work. System Design and Implementation: the paper does not fully explore how the proposed system could be built. In particular, there are challenges around the following:</p><p>• Building custom LLMs. One of the design limitations is how to effectively experiment with models of varying degrees of openness (for convenience referred to as black, grey and white box). For black box models (e.g GPT-3) there is no way at present to modify the architecture. What instead might be possible is to fine-tune the model via custom queries over a period of time. So, what combinations of prompts generate the most favourable outputs. Grey box models (BLOOM or GPT-NeoX) offer the possibility of powerful models with open-source training and evaluation code plus model weights <ref type="bibr" target="#b52">[53]</ref>. However, the costs of running and/or adapting these models could be substantial and not something the paper has explored.</p><p>• Customizing models for individuals: this is a system objective but has not been tested. Technically, there is a conflict between the scale and performance benefits of LLM/LM and the comparatively small datasets of individual users. However, as Vigliensoni et al argue, working with small-scale datasets is an overlooked but powerful mechanism for enabling greater human influence over generative AI systems within in creative contexts <ref type="bibr" target="#b69">[70]</ref>. The authors describe an experimental project, ReRites by Johnston which involved fine-tuning GPT-2 on the artists' custom poetry corpus to generate poems. An approach such as this could be taken although clearly using models such as GPT-2 (for which source code is available) has the limitation of performance vs current state-of-the art LLMs. The personalizing of LLMs to individual users is an open topic that requires further research.</p><p>• Acquiring training data: training data for poetry and rap lyrics would not be readily available in the way that the Pile or equivalents are used for general LLMs <ref type="bibr" target="#b18">[19]</ref>. The solution to this would be to source data from scraping the web for lyrics, or directly from services such as MusixMatch <ref type="bibr" target="#b70">[71]</ref> Poetry training data, much of which will be out of copyright, can be acquired via sites such as Project Gutenberg and Poetry Foundation. This approach to training data was used in a 2019 experiment to create a poetry-specific LLM based on the GPT-2 model <ref type="bibr" target="#b71">[72]</ref>.</p><p>Evaluation: literature on evaluating the creativity in a co-creative systems considers a wide number of factors such who evaluates the creativity (e.g. system itself or human users), what is being evaluated (e.g. user interaction or output), when does evaluation occur (e.g in real time or at the end of a session) and how the evaluation is performed (e.g. methods and related metrics) <ref type="bibr" target="#b15">[16]</ref>. There is a broad set of metrics for developing computational models for evaluating creativity. With respect to the system described, the most relevant include a proposed computational model by Agres et al. The model reflects human conceptualization of musical and poetic creativity <ref type="bibr" target="#b72">[73]</ref>. Future work could explore the kind of model described alongside other linguistic-based metrics such as the Divergent Action Task, Bridge-the-Associative-Gap Task, or rhyme creation and identification tasks. <ref type="bibr" target="#b45">[46,</ref><ref type="bibr" target="#b46">47]</ref> Additionally, building on machine learning practices, metrics could be derived for accuracy in terms of the degree to which generated output matches a reference dataset. For example, if the user has a target poetic style, it might be possible to computationally determine the extent to which the completed poem was accurate or not. The paper has not explored these kinds of evaluation in detail and they would form part of future work. Finally, though the evaluations proposed are limited, they could nevertheless contribute to the wider discussion around the topic. As Karimi et al assert "evaluating co-creative systems is still an open research question and there is no standard metric that can be used across specific systems. " <ref type="bibr" target="#b15">[16]</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="6.">Conclusion</head><p>Artistic creativity is a process, in which an initial improvisational phase is followed by a period of focused re-evaluation and revision <ref type="bibr" target="#b19">[20]</ref>. Spontaneous improvisation is a complex cognitive process that shares features with what has been characterized as a 'flow' state <ref type="bibr" target="#b0">[1,</ref><ref type="bibr" target="#b19">20]</ref>. Much current work on co-creative settings focuses on the role of the system as a generator that augments what people can achieve in creative tasks <ref type="bibr" target="#b8">[9]</ref>. There are problems with this such aligning the system capabilities and user expectations, language model bias, system interpretability, and user interaction design <ref type="bibr" target="#b7">[8,</ref><ref type="bibr" target="#b21">22,</ref><ref type="bibr" target="#b73">74]</ref>. Studies have found that different mental expectation of users affects their strategies and perception of the system role in the co-writing process <ref type="bibr" target="#b8">[9,</ref><ref type="bibr" target="#b73">74]</ref>.</p><p>This position paper explored the recent background to co-creative writing systems, with poetry as a use case. Poetry was defined as including song lyrics for which the paper argued that rap was the most relevant genre. The paper then proposed a system that, as far as the author is aware, has novel features relative to the state of the art. The system and how it could be evaluated and implemented were then described. Importantly, the design includes recommendations for user activities external to the system. The rationale for this is that the system priority is to help the human user to develop an artistic style rather than to create text on the users behalf. Issues around the mitigating some system bias using rap lyrics was also discussed. Future work could include more detailed analysis of evaluation methods as well as how these could be delivered internally to the system. Further work on user interface design is also a topic to develop. Additionally, the implementation proposal is high level and constraints such as latency, database design, and other factors have not been considered. In order to build a viable prototype, software architecture would most likely form the next stage of the research. Finally, to revisit the title of the paper: why build a cocreative poetry system that makes people feel that they have "creative superpowers"? Studies demonstrate that poetry is an emotional capable of engaging the brain's areas of primary reward <ref type="bibr" target="#b74">[75]</ref>. It is a form of communication that has existed throughout human and across cultures. In modern society, poetry has become a central part of the most popular music genre. Poetry matters to society. By extension, it is worth building system that can help people experience it firsthand and connect with its traditions. The aim though should not be to make people feel they have "creative superpowers"; instead a system should support people to actually build "creative superpowers".</p></div><figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_0"><head>Figure 1 :</head><label>1</label><figDesc>Figure 1: Google's Verse by Verse: users select from a range of US poets and custom design a poem by choosing from features including the number of syllables per line and the number of stanzas.</figDesc><graphic coords="4,89.29,204.06,203.34,96.53" type="bitmap" /></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_1"><head>Figure 2 :</head><label>2</label><figDesc>Figure 2: SParse And Dense Network Model Elements 1. Text input by user is returned as partially completed poetic text and/or poetic and lyrical recommendations for the user to consider. 2. User personalised data submitted as poems or lyrics and/or recommendations of favourite artists and their work. These are used to create a corpus of user text. Prior examples of user generated text uploaded to system; recommender and/or database search to enhance user text with additional poetic texts (e.g from web crawl) 3. Database of poetic texts (and song lyrics) from web crawl. Clean text is included as well as metadata such as rhyme scheme and Parts of Speech (PoS).</figDesc><graphic coords="6,89.29,418.98,203.36,100.20" type="bitmap" /></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" type="table" xml:id="tab_0"><head>Table 1</head><label>1</label><figDesc>Summary of State-of-the-Art Language Models by Size, Model Type and Ownership</figDesc><table><row><cell>Model Name</cell><cell>Parameters</cell><cell>Model Type</cell><cell>Owner</cell></row><row><cell>BERT</cell><cell>110 -340 million</cell><cell>Transformer</cell><cell>Google</cell></row><row><cell>GPT-2</cell><cell>1.5 billion</cell><cell>Transformer</cell><cell>OpenAI</cell></row><row><cell>LaMDA</cell><cell>137 billion</cell><cell>Transformer</cell><cell>Google</cell></row><row><cell>GPT-3</cell><cell>175 billion</cell><cell>Transformer</cell><cell>OpenAI</cell></row><row><cell>ChatGPT/InstructGPT</cell><cell>175 billion</cell><cell>Transformer</cell><cell>OpenAI</cell></row><row><cell>BLOOM</cell><cell>176 billion</cell><cell>Transformer</cell><cell>BLOOM Project</cell></row><row><cell>Megatron-Turing NLG</cell><cell>530 billion</cell><cell>Transformer</cell><cell>Microsoft and NVIDIA</cell></row><row><cell>PaLM</cell><cell>540 billion</cell><cell>Transformer</cell><cell>Google</cell></row><row><cell>GLaM</cell><cell>1 trillion</cell><cell cols="2">Mixture of Experts Google</cell></row></table></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" type="table" xml:id="tab_2"><head>Table 2</head><label>2</label><figDesc>An Overview of Selected Poetry Writing Tools by Type</figDesc><table><row><cell>Type</cell><cell>Example</cell><cell>Key Features</cell><cell>Constraints</cell></row><row><cell>Autonomous</cell><cell>ChatGPT</cell><cell>Natural language input</cell><cell>Plain text output</cell></row><row><cell></cell><cell></cell><cell>Generates poems and lyrics</cell><cell>Customisation by text prompt</cell></row><row><cell>Autonomous</cell><cell>co:here</cell><cell>Natural language input</cell><cell>Plain text output</cell></row><row><cell></cell><cell></cell><cell>Generates poems and lyrics</cell><cell>High latency</cell></row><row><cell>Autonomous</cell><cell>Rytr</cell><cell>UI has song lyric option</cell><cell>Uses GPT-3 models</cell></row><row><cell></cell><cell></cell><cell>Extensive text processing</cell><cell>Not trained on song data</cell></row><row><cell>Support</cell><cell>RhymeZone</cell><cell>Rhyming dictionary/thesaurus</cell><cell>Single word only</cell></row><row><cell></cell><cell></cell><cell>Generates rhyme suggestions</cell><cell>Cannot be used to write text</cell></row><row><cell>Support</cell><cell>Rhymer</cell><cell>Rhyming dictionary</cell><cell>Single word only</cell></row><row><cell></cell><cell></cell><cell>Generates range of word types</cell><cell>Cannot be used to write text</cell></row><row><cell>Support</cell><cell>Poetry Foundation</cell><cell>Poetry archives and tutorials</cell><cell>No support for real-time creation</cell></row><row><cell></cell><cell></cell><cell>Guides user to external resources</cell><cell>No user customisation options</cell></row><row><cell>Co-creativity</cell><cell>Poem Generator</cell><cell>Customise inputs to create poem</cell><cell>Input variables fixed</cell></row><row><cell></cell><cell></cell><cell>Variety of formal poetic outputs</cell><cell>Limited user interaction or feedback</cell></row><row><cell>Co-creativity</cell><cell>DeepBeat</cell><cell>Generates and/or suggests lyrics</cell><cell>Confusing user interface</cell></row><row><cell></cell><cell></cell><cell>Displays sources of lyric inspiration</cell><cell>Unoriginal output vs GPT-3 models</cell></row><row><cell>Co-creativity</cell><cell>Verse by Verse</cell><cell cols="2">Suggests stanzas in style of known poets Limited forms of poetry</cell></row><row><cell></cell><cell></cell><cell>Language model accounts for bias</cell><cell>Trained on selected U.S poets</cell></row></table></figure>
		</body>
		<back>

			<div type="acknowledgement">
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="7.">Acknowledgements</head><p>This work was supported by the Engineering and Physical Sciences Research Council. The author would also like to acknowledge the support of Swansea Council.</p></div>
			</div>

			<div type="references">

				<listBibl>

<biblStruct xml:id="b0">
	<monogr>
		<title level="m" type="main">Creativity : the psychology of discovery and invention</title>
		<author>
			<persName><forename type="first">M</forename><surname>Csikszentmihalyi</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2013">2013</date>
			<publisher>Harper Perennial Modern Classics</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b1">
	<analytic>
		<title level="a" type="main">Creativity in a nutshell</title>
		<author>
			<persName><forename type="first">M</forename><surname>Boden</surname></persName>
		</author>
		<idno type="DOI">10.1017/S147717560000230X</idno>
	</analytic>
	<monogr>
		<title level="j">Think</title>
		<imprint>
			<biblScope unit="volume">5</biblScope>
			<biblScope unit="page" from="83" to="96" />
			<date type="published" when="2009">2009</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b2">
	<monogr>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">P</forename><surname>Guilford</surname></persName>
		</author>
		<title level="m">The nature of human intelligence</title>
				<imprint>
			<date type="published" when="1967">1967</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b3">
	<monogr>
		<title level="m" type="main">The creative mind : myths and mechanisms</title>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">A</forename><surname>Boden</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2005">2005</date>
			<publisher>Routledge</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b4">
	<analytic>
		<title level="a" type="main">How novelists use generative language models: An exploratory user study</title>
		<author>
			<persName><forename type="first">A</forename><surname>Calderwood</surname></persName>
		</author>
		<author>
			<persName><forename type="first">V</forename><surname>Qiu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">K</forename><surname>Gero</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><forename type="middle">B</forename><surname>Chilton</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">HAI-GEN+user2agent@IUI</title>
				<imprint>
			<date type="published" when="2020">2020</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b5">
	<monogr>
		<title level="m" type="main">Efficient natural language response suggestion for smart reply</title>
		<author>
			<persName><forename type="first">M</forename><surname>Henderson</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Al-Rfou</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><surname>Strope</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>-H. Sung</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Lukacs</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Guo</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Kumar</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><surname>Miklos</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Kurzweil</surname></persName>
		</author>
		<idno type="DOI">10.48550/arXiv.1705.00652</idno>
		<idno>arXiv.org</idno>
		<ptr target="https://arxiv.org/abs/1705.00652.doi:10.48550/arXiv.1705.00652" />
		<imprint>
			<date type="published" when="2017">2017</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b6">
	<analytic>
		<title level="a" type="main">Copoetryme: a co-creative interface for the composition of poetry</title>
		<author>
			<persName><forename type="first">H</forename><forename type="middle">Gonçalo</forename><surname>Oliveira</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Mendes</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Boavida</surname></persName>
		</author>
		<idno type="DOI">10.18653/v1/w17-3508</idno>
		<ptr target="https://aclanthology.org/W17-3508/.doi:10.18653/v1/w17-3508" />
	</analytic>
	<monogr>
		<title level="m">Proceedings of the 10th International Conference on Natural Language Generation</title>
				<meeting>the 10th International Conference on Natural Language Generation</meeting>
		<imprint>
			<date type="published" when="2017">2017</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b7">
	<analytic>
		<title level="a" type="main">Suggestion lists vs. continuous generation: Interaction design for writing with generative models on mobile devices affect text length, wording and perceived authorship</title>
		<author>
			<persName><forename type="first">F</forename><surname>Lehmann</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Markert</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Dang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Buschek</surname></persName>
		</author>
		<idno type="DOI">10.1145/3543758.3543947</idno>
		<idno>doi:10.1145/3543758.3543947</idno>
		<ptr target="https://doi.org/10.1145/3543758.3543947" />
	</analytic>
	<monogr>
		<title level="m">Proceedings of Mensch Und Computer 2022, MuC &apos;22</title>
				<meeting>Mensch Und Computer 2022, MuC &apos;22<address><addrLine>New York, NY, USA</addrLine></address></meeting>
		<imprint>
			<publisher>Association for Computing Machinery</publisher>
			<date type="published" when="2022">2022</date>
			<biblScope unit="page" from="192" to="208" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b8">
	<analytic>
		<title level="a" type="main">Generative models can help writers without writing for them</title>
		<author>
			<persName><forename type="first">K</forename><surname>Arnold</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Volzer</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Madrid</surname></persName>
		</author>
		<ptr target="https://ceur-ws.org/Vol-2903/IUI21WS-HAIGEN-1.pdf" />
	</analytic>
	<monogr>
		<title level="m">Joint Proceedings of the ACM IUI 2021 Workshops</title>
				<imprint>
			<date type="published" when="2021">2021</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b9">
	<monogr>
		<author>
			<persName><forename type="first">A</forename><surname>Ploin</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Eynon</surname></persName>
		</author>
		<author>
			<persName><forename type="first">I</forename><surname>Hjorth</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">A</forename><surname>Osborne</surname></persName>
		</author>
		<ptr target="https://www.oii.ox.ac.uk/news-events/reports/ai-the-arts/" />
		<title level="m">report from the creative algorithmic intelligence research project</title>
				<imprint>
			<date type="published" when="2022">2022</date>
		</imprint>
	</monogr>
	<note>Ai and the arts: How machine learning is changing artistic work</note>
</biblStruct>

<biblStruct xml:id="b10">
	<analytic>
		<title level="a" type="main">Design lessons from ai&apos;s two grand goals: Human emulation and useful applications</title>
		<author>
			<persName><forename type="first">B</forename><surname>Shneiderman</surname></persName>
		</author>
		<idno type="DOI">10.1109/tts.2020.2992669</idno>
	</analytic>
	<monogr>
		<title level="j">IEEE Transactions on Technology and Society</title>
		<imprint>
			<biblScope unit="volume">1</biblScope>
			<biblScope unit="page" from="73" to="82" />
			<date type="published" when="2020">2020</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b11">
	<analytic>
		<title level="a" type="main">Creativity support tools</title>
		<author>
			<persName><forename type="first">B</forename><surname>Shneiderman</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Communications of the ACM</title>
		<imprint>
			<biblScope unit="volume">45</biblScope>
			<biblScope unit="page" from="116" to="120" />
			<date type="published" when="2002">2002</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b12">
	<monogr>
		<title level="m" type="main">Language models are unsupervised multitask learners</title>
		<author>
			<persName><forename type="first">A</forename><surname>Radford</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Wu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Child</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Luan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Amodei</surname></persName>
		</author>
		<author>
			<persName><forename type="first">I</forename><surname>Sutskever</surname></persName>
		</author>
		<ptr target="https://cdn.openai.com/better-language-models/language_models_are_unsupervised_multitask_learners.pdf" />
		<imprint>
			<date type="published" when="2019">2019</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b13">
	<monogr>
		<author>
			<persName><forename type="first">S</forename><surname>Black</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Biderman</surname></persName>
		</author>
		<author>
			<persName><forename type="first">E</forename><surname>Hallahan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Q</forename><surname>Anthony</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Gao</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Golding</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>He</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Leahy</surname></persName>
		</author>
		<author>
			<persName><forename type="first">K</forename><surname>Mcdonell</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Phang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Pieler</surname></persName>
		</author>
		<author>
			<persName><forename type="first">U</forename><forename type="middle">S</forename><surname>Prashanth</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Purohit</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Reynolds</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Tow</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><surname>Wang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Weinbach</surname></persName>
		</author>
		<idno type="DOI">10.48550/arXiv.2204.06745</idno>
		<idno>arXiv.org</idno>
		<ptr target="https://arxiv.org/abs/2204.06745.doi:10.48550/arXiv.2204.06745" />
		<title level="m">Gptneox-20b: An open-source autoregressive language model</title>
				<imprint>
			<date type="published" when="2022">2022</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b14">
	<monogr>
		<title level="m" type="main">Language models are few-shot learners</title>
		<author>
			<persName><forename type="first">T</forename><forename type="middle">B</forename><surname>Brown</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><surname>Mann</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Ryder</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Subbiah</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Kaplan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">P</forename><surname>Dhariwal</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Neelakantan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">P</forename><surname>Shyam</surname></persName>
		</author>
		<author>
			<persName><forename type="first">G</forename><surname>Sastry</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Askell</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Agarwal</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Herbert-Voss</surname></persName>
		</author>
		<author>
			<persName><forename type="first">G</forename><surname>Krueger</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Henighan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Child</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Ramesh</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><forename type="middle">M</forename><surname>Ziegler</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Wu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Winter</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Hesse</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Chen</surname></persName>
		</author>
		<author>
			<persName><forename type="first">E</forename><surname>Sigler</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Litwin</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Gray</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><surname>Chess</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Clark</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Berner</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Mccandlish</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Radford</surname></persName>
		</author>
		<author>
			<persName><forename type="first">I</forename><surname>Sutskever</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Amodei</surname></persName>
		</author>
		<ptr target="https://arxiv.org/abs/2005.14165" />
		<imprint>
			<date type="published" when="2020">2020</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b15">
	<monogr>
		<author>
			<persName><forename type="first">P</forename><surname>Karimi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">K</forename><surname>Grace</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">L</forename><surname>Maher</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Davis</surname></persName>
		</author>
		<idno>CoRR abs/1807.09886</idno>
		<ptr target="http://arxiv.org/abs/1807.09886.arXiv:1807.09886" />
		<title level="m">Evaluating creativity in computational co-creative systems</title>
				<imprint>
			<date type="published" when="2018">2018</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b16">
	<analytic>
		<title level="a" type="main">On the dangers of stochastic parrots: Can language models be too big?</title>
		<author>
			<persName><forename type="first">E</forename><forename type="middle">M</forename><surname>Bender</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Gebru</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Mcmillan-Major</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Shmitchell</surname></persName>
		</author>
		<idno type="DOI">10.1145/3442188.3445922</idno>
		<idno>doi:10.1145/3442188. 3445922</idno>
		<ptr target="https://doi.org/10.1145/3442188.3445922" />
	</analytic>
	<monogr>
		<title level="m">Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, FAccT &apos;21</title>
				<meeting>the 2021 ACM Conference on Fairness, Accountability, and Transparency, FAccT &apos;21<address><addrLine>New York, NY, USA</addrLine></address></meeting>
		<imprint>
			<publisher>Association for Computing Machinery</publisher>
			<date type="published" when="2021">2021</date>
			<biblScope unit="page" from="610" to="623" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b17">
	<monogr>
		<title level="m" type="main">Scaling laws for neural language models</title>
		<author>
			<persName><forename type="first">J</forename><surname>Kaplan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Mccandlish</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Henighan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><forename type="middle">B</forename><surname>Brown</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><surname>Chess</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Child</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Gray</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Radford</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Wu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Amodei</surname></persName>
		</author>
		<idno>CoRR abs/2001.08361</idno>
		<ptr target="https://arxiv.org/abs/2001.08361.arXiv:2001.08361" />
		<imprint>
			<date type="published" when="2020">2020</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b18">
	<monogr>
		<title level="m" type="main">The pile: An 800gb dataset of diverse text for language modeling</title>
		<author>
			<persName><forename type="first">L</forename><surname>Gao</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Biderman</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Black</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Golding</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Hoppe</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Foster</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Phang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>He</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Thite</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Nabeshima</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Presser</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Leahy</surname></persName>
		</author>
		<idno type="DOI">10.48550/arXiv.2101.00027</idno>
		<idno>arXiv.org</idno>
		<ptr target="https://arxiv.org/abs/2101.00027.doi:10.48550/arXiv.2101.00027" />
		<imprint>
			<date type="published" when="2020">2020</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b19">
	<analytic>
		<title level="a" type="main">Neural correlates of lyrical improvisation: An fmri study of freestyle rap</title>
		<author>
			<persName><forename type="first">S</forename><surname>Liu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><forename type="middle">M</forename><surname>Chow</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>Xu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">G</forename><surname>Erkkinen</surname></persName>
		</author>
		<author>
			<persName><forename type="first">K</forename><forename type="middle">E</forename><surname>Swett</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">W</forename><surname>Eagle</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><forename type="middle">A</forename><surname>Rizik-Baer</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><forename type="middle">R</forename><surname>Braun</surname></persName>
		</author>
		<idno type="DOI">10.1038/srep00834</idno>
		<ptr target="https://www.nature.com/articles/srep00834.doi:10.1038/srep00834" />
	</analytic>
	<monogr>
		<title level="j">Scientific Reports</title>
		<imprint>
			<biblScope unit="volume">2</biblScope>
			<date type="published" when="2012">2012</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b20">
	<analytic>
		<title level="a" type="main">Metacontrol of human creativity: The neurocognitive mechanisms of convergent and divergent thinking</title>
		<author>
			<persName><forename type="first">W</forename><surname>Zhang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Z</forename><surname>Sjoerds</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><surname>Hommel</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">NeuroImage</title>
		<imprint>
			<biblScope unit="volume">210</biblScope>
			<date type="published" when="2020">2020</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b21">
	<monogr>
		<title level="m" type="main">Nine potential pitfalls when designing human-ai cocreative systems</title>
		<author>
			<persName><forename type="first">D</forename><surname>Buschek</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Mecke</surname></persName>
		</author>
		<author>
			<persName><forename type="first">F</forename><surname>Lehmann</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Dang</surname></persName>
		</author>
		<idno type="DOI">10.48550/ARXIV.2104.00358</idno>
		<ptr target="https://arxiv.org/abs/2104.00358.doi:10.48550/ARXIV.2104.00358" />
		<imprint>
			<date type="published" when="2021">2021</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b22">
	<monogr>
		<author>
			<persName><forename type="first">T</forename><forename type="middle">L</forename><surname>Scao</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Fan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Akiki</surname></persName>
		</author>
		<author>
			<persName><forename type="first">E</forename><surname>Pavlick</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Ilić</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Hesslow</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Castagné</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><forename type="middle">S</forename><surname>Luccioni</surname></persName>
		</author>
		<author>
			<persName><forename type="first">F</forename><surname>Yvon</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Gallé</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Tow</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><forename type="middle">M</forename><surname>Rush</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Biderman</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Webson</surname></persName>
		</author>
		<author>
			<persName><forename type="first">P</forename><forename type="middle">S</forename><surname>Ammanamanchi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Wang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><surname>Sagot</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Muennighoff</surname></persName>
		</author>
		<author>
			<persName><forename type="first">O</forename><surname>Moral</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Ruwase</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Bawden</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Bekman</surname></persName>
		</author>
		<author>
			<persName><forename type="first">I</forename><surname>Mcmillan-Major</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Beltagy</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Nguyen</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Saulnier</surname></persName>
		</author>
		<author>
			<persName><forename type="first">P</forename><forename type="middle">O</forename><surname>Tan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">V</forename><surname>Suarez</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Sanh</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>Laurençon</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Jernite</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Launay</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Mitchell</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Raffel</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Gokaslan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Simhi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><forename type="middle">F</forename><surname>Soroa</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Aji</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><forename type="middle">A</forename><surname>Alfassy</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><forename type="middle">K</forename><surname>Rogers</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Nitzav</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Xu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Mou</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Emezue</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Klamm</surname></persName>
		</author>
		<author>
			<persName><surname>Leong</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><forename type="middle">I</forename><surname>Strien</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Adelani</surname></persName>
		</author>
		<author>
			<persName><forename type="first">E</forename><forename type="middle">G</forename><surname>Radev</surname></persName>
		</author>
		<author>
			<persName><forename type="first">E</forename><surname>Ponferrada</surname></persName>
		</author>
		<author>
			<persName><forename type="first">E</forename><surname>Levkovizh</surname></persName>
		</author>
		<author>
			<persName><forename type="first">E</forename><forename type="middle">B</forename><surname>Kim</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Natan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">G</forename><surname>Toni</surname></persName>
		</author>
		<author>
			<persName><forename type="first">G</forename><surname>Dupont</surname></persName>
		</author>
		<author>
			<persName><forename type="first">G</forename><surname>Kruszewski</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Pistilli</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Elsahar</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Benyamina</surname></persName>
		</author>
		<author>
			<persName><forename type="first">I</forename><surname>Tran</surname></persName>
		</author>
		<author>
			<persName><forename type="first">I</forename><surname>Yu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">I</forename><surname>Abdulmumin</surname></persName>
		</author>
		<author>
			<persName><forename type="first">I</forename><surname>Johnson</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Gonzalez-Dios</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Javier</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Chim</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Dodge</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Zhu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Chang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Frohberg</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Tobing</surname></persName>
		</author>
		<author>
			<persName><forename type="first">K</forename><surname>Bhattacharjee</surname></persName>
		</author>
		<author>
			<persName><forename type="first">K</forename><surname>Almubarak</surname></persName>
		</author>
		<author>
			<persName><forename type="first">K</forename><surname>Chen</surname></persName>
		</author>
		<author>
			<persName><forename type="first">V</forename><surname>Lo</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Werra</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Weber</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><forename type="middle">B</forename><surname>Phan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Tanguy</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Dey</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">R</forename><surname>Muñoz</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Masoud</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Grandury</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Šaško</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Huang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Coavoux</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Singh</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">T</forename></persName>
		</author>
		<author>
			<persName><forename type="first">.-J</forename><surname>Jiang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">C</forename><surname>Vu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">A</forename><surname>Jauhar</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Ghaleb</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Subramani</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Kassner</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Khamis</surname></persName>
		</author>
		<author>
			<persName><forename type="first">O</forename><surname>Nguyen</surname></persName>
		</author>
		<author>
			<persName><forename type="first">O</forename><surname>Espejel</surname></persName>
		</author>
		<author>
			<persName><forename type="first">P</forename><surname>Gibert</surname></persName>
		</author>
		<author>
			<persName><forename type="first">P</forename><surname>Villegas</surname></persName>
		</author>
		<author>
			<persName><forename type="first">P</forename><surname>Henderson</surname></persName>
		</author>
		<author>
			<persName><forename type="first">P</forename><surname>Colombo</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Q</forename><surname>Amuok</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Lhoest</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Harliman</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><forename type="middle">L</forename><surname>Bommasani</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>López</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Ribeiro</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Osei</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Pyysalo</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Nagel</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><forename type="middle">H</forename><surname>Bose</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Muhammad</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Sharma</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Longpre</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Nikpoor</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Silberberg</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Pai</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><forename type="middle">T</forename><surname>Zink</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Torrent</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Schick</surname></persName>
		</author>
		<author>
			<persName><forename type="first">V</forename><surname>Thrush</surname></persName>
		</author>
		<author>
			<persName><forename type="first">V</forename><surname>Danchev</surname></persName>
		</author>
		<author>
			<persName><forename type="first">V</forename><surname>Nikoulina</surname></persName>
		</author>
		<author>
			<persName><forename type="first">V</forename><surname>Laippala</surname></persName>
		</author>
		<author>
			<persName><forename type="first">V</forename><surname>Lepercq</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Z</forename><surname>Prabhu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Z</forename><surname>Alyafeai</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Talat</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><surname>Raja</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Heinzerling</surname></persName>
		</author>
		<author>
			<persName><forename type="first">E</forename><surname>Si</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><forename type="middle">J</forename><surname>Salesky</surname></persName>
		</author>
		<author>
			<persName><forename type="first">W</forename><forename type="middle">Y</forename><surname>Mielke</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Lee</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Sharma</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Santilli</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Chaffin</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Stiegler</surname></persName>
		</author>
		<author>
			<persName><forename type="first">E</forename><surname>Datta</surname></persName>
		</author>
		<author>
			<persName><forename type="first">G</forename><surname>Szczechla</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Chhablani</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Wang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Pandey</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">A</forename><surname>Strobelt</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Fries</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Rozen</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Gao</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><forename type="middle">M</forename><surname>Sutawika</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">S</forename><surname>Saiful</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Al-Shaibani</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Manica</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Nayak</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Teehan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Albanie</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Shen</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><forename type="middle">H</forename><surname>Ben-David</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Bach</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Kim</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Bers</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Fevry</surname></persName>
		</author>
		<author>
			<persName><forename type="first">U</forename><surname>Neeraj</surname></persName>
		</author>
		<author>
			<persName><forename type="first">V</forename><surname>Thakker</surname></persName>
		</author>
		<author>
			<persName><forename type="first">X</forename><surname>Raunak</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Z.-X</forename><surname>Tang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Z</forename><surname>Yong</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Sun</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>Brody</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Uri</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Tojarieh</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><forename type="middle">W</forename><surname>Roberts</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Chung</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Tae</surname></persName>
		</author>
		<author>
			<persName><forename type="first">O</forename><surname>Phang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Press</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Li</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Narayanan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Bourfoune</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Casper</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Rasley</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Ryabinin</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Mishra</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Zhang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Shoeybi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Peyrounette</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Patry</surname></persName>
		</author>
		<author>
			<persName><forename type="first">O</forename><surname>Tazi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">V</forename><surname>Sanseviero</surname></persName>
		</author>
		<author>
			<persName><forename type="first">P</forename><surname>Platen</surname></persName>
		</author>
		<author>
			<persName><forename type="first">P</forename><forename type="middle">F</forename><surname>Cornette</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Lavallée</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Lacroix</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Rajbhandari</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Gandhi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Smith</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Requena</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Patil</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Dettmers</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Baruwa</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Singh</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A.-L</forename><surname>Cheveleva</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Ligozat</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Subramonian</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Névéol</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Lovering</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Garrette</surname></persName>
		</author>
		<author>
			<persName><forename type="first">E</forename><surname>Tunuguntla</surname></persName>
		</author>
		<author>
			<persName><forename type="first">E</forename><surname>Reiter</surname></persName>
		</author>
		<author>
			<persName><forename type="first">E</forename><surname>Taktasheva</surname></persName>
		</author>
		<author>
			<persName><forename type="first">E</forename><surname>Voloshina</surname></persName>
		</author>
		<author>
			<persName><forename type="first">G</forename><forename type="middle">I</forename><surname>Bogdanov</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Winata</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J.-C</forename><surname>Schoelkopf</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Kalo</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">Z</forename><surname>Novikova</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Forde</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Clive</surname></persName>
		</author>
		<author>
			<persName><forename type="first">K</forename><surname>Kasai</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Kawamura</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Hazan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Carpuat</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Clinciu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Kim</surname></persName>
		</author>
		<author>
			<persName><forename type="first">O</forename><surname>Cheng</surname></persName>
		</author>
		<author>
			<persName><forename type="first">O</forename><surname>Serikov</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Antverg</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Zhang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Zhang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Gehrmann</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Pais</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Shavrina</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Scialom</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Yun</surname></persName>
		</author>
		<author>
			<persName><forename type="first">V</forename><surname>Limisiewicz</surname></persName>
		</author>
		<author>
			<persName><forename type="first">V</forename><surname>Rieser</surname></persName>
		</author>
		<author>
			<persName><forename type="first">V</forename><surname>Protasov</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>Mikhailov</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>Pruksachatkun</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Z</forename><surname>Belinkov</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Z</forename><surname>Bamberger</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Kasner</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Rueda</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Pestana</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Feizpour</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Khan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Faranak</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Santos</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Hevia</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Unldreaj</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Aghagol</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Abdollahi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Tammour</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><surname>Hajihosseini</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><surname>Behroozi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><surname>Ajibade</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><forename type="middle">M</forename><surname>Saxena</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Ferrandis</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Contractor</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Lansky</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>David</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><forename type="middle">A</forename><surname>Kiela</surname></persName>
		</author>
		<author>
			<persName><forename type="first">E</forename><surname>Nguyen</surname></persName>
		</author>
		<author>
			<persName><forename type="first">E</forename><surname>Tan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">E</forename><surname>Baylor</surname></persName>
		</author>
		<author>
			<persName><forename type="first">F</forename><surname>Ozoani</surname></persName>
		</author>
		<author>
			<persName><forename type="first">F</forename><surname>Mirza</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Ononiwu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Rezanejad</surname></persName>
		</author>
		<author>
			<persName><forename type="first">I</forename><surname>Jones</surname></persName>
		</author>
		<author>
			<persName><forename type="first">I</forename><surname>Bhattacharya</surname></persName>
		</author>
		<author>
			<persName><forename type="first">I</forename><surname>Solaiman</surname></persName>
		</author>
		<author>
			<persName><forename type="first">I</forename><surname>Sedenko</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Nejadgholi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Passmore</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">B</forename><surname>Seltzer</surname></persName>
		</author>
		<author>
			<persName><forename type="first">K</forename><surname>Sanz</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Fort</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Dutra</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Samagaio</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Elbadri</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Mieskes</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Gerchick</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Akinlolu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Mckenna</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Qiu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Ghauri</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Burynok</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Abrar</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Rajani</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Elkott</surname></persName>
		</author>
		<author>
			<persName><forename type="first">O</forename><surname>Fahmy</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Samuel</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>An</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Kromann</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Hao</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Alizadeh</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Shubber</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Wang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Roy</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Viguier</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Le</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Oyebade</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>Le</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Z</forename><surname>Yang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><forename type="middle">R</forename><surname>Nguyen</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Kashyap</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Palasciano</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Callahan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Shukla</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Miranda-Escalada</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><surname>Singh</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><surname>Beilharz</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Wang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Brito</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Zhou</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Jain</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Xu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><forename type="middle">L</forename><surname>Fourrier</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Periñán</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Molano</surname></persName>
		</author>
		<author>
			<persName><forename type="first">E</forename><surname>Yu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">F</forename><surname>Manjavacas</surname></persName>
		</author>
		<author>
			<persName><forename type="first">F</forename><surname>Barth</surname></persName>
		</author>
		<author>
			<persName><forename type="first">G</forename><surname>Fuhrimann</surname></persName>
		</author>
		<author>
			<persName><forename type="first">G</forename><surname>Altay</surname></persName>
		</author>
		<author>
			<persName><forename type="first">G</forename><surname>Bayrak</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><forename type="middle">U</forename><surname>Burns</surname></persName>
		</author>
		<author>
			<persName><forename type="first">I</forename><surname>Vrabec</surname></persName>
		</author>
		<author>
			<persName><forename type="first">I</forename><surname>Bello</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Dash</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Kang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Giorgi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">D</forename><surname>Golde</surname></persName>
		</author>
		<author>
			<persName><forename type="first">K</forename><forename type="middle">R</forename><surname>Posada</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Sivaraman</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Bulchandani</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Liu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Shinzato</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Hahn</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Takeuchi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">A</forename><surname>Pàmies</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Castillo</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Nezhurina</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Sänger</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Samwald</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Cullan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Weinberg</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Wolf</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Mihaljcic</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Liu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Freidank</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Kang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Seelam</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><forename type="middle">M</forename><surname>Dahlberg</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Broad</surname></persName>
		</author>
		<author>
			<persName><forename type="first">P</forename><surname>Muellner</surname></persName>
		</author>
		<author>
			<persName><forename type="first">P</forename><surname>Fung</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Haller</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Chandrasekhar</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Eisenberg</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Martin</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Canalli</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Su</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Su</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Cahyawijaya</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><forename type="middle">S</forename><surname>Garda</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Deshmukh</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Mishra</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Kiblawi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Ott</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Sang-Aroonsiri</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Kumar</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Schweter</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Bharati</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Laud</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Gigant</surname></persName>
		</author>
		<author>
			<persName><forename type="first">W</forename><surname>Kainuma</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>Kusa</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><forename type="middle">S</forename><surname>Labrak</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>Bajaj</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>Venkatraman</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>Xu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>Xu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Z</forename><surname>Xu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Z</forename><surname>Tan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Z</forename><surname>Xie</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Ye</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>Bras</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Belkada</surname></persName>
		</author>
		<author>
			<persName><surname>Wolf</surname></persName>
		</author>
		<idno type="DOI">10.48550/arXiv.2211.05100</idno>
		<idno>arXiv.org</idno>
		<ptr target="https://arxiv.org/abs/2211.05100.doi:10.48550/arXiv.2211.05100" />
		<title level="m">Bloom: A 176b-parameter open-access multilingual language model</title>
				<imprint>
			<date type="published" when="2022">2022</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b23">
	<monogr>
		<author>
			<persName><forename type="first">A</forename><surname>Vaswani</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Shazeer</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Parmar</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Uszkoreit</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Jones</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><forename type="middle">N</forename><surname>Gomez</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Kaiser</surname></persName>
		</author>
		<author>
			<persName><forename type="first">I</forename><surname>Polosukhin</surname></persName>
		</author>
		<idno type="DOI">10.48550/arXiv.1706.03762</idno>
		<idno>arXiv.org</idno>
		<ptr target="https://arxiv.org/abs/1706.03762.doi:10.48550/arXiv.1706.03762" />
		<title level="m">Attention is all you need</title>
				<imprint>
			<date type="published" when="2017">2017</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b24">
	<analytic>
		<title level="a" type="main">Scaffolding oral language development through poetry for students learning english</title>
		<author>
			<persName><forename type="first">N</forename><forename type="middle">L</forename><surname>Hadaway</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><forename type="middle">M</forename><surname>Vardell</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><forename type="middle">A</forename><surname>Young</surname></persName>
		</author>
		<ptr target="https://go.gale.com/ps/i.do?id=GALE%7CA75085276&amp;sid=googleScholar&amp;v=2.1&amp;it=r&amp;linkaccess=abs&amp;issn=00340561&amp;p=AONE&amp;sw=w&amp;userGroupName=anon%7E20f961a3" />
	</analytic>
	<monogr>
		<title level="j">The Reading Teacher</title>
		<imprint>
			<biblScope unit="volume">54</biblScope>
			<biblScope unit="page" from="796" to="796" />
			<date type="published" when="2001">2001</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b25">
	<monogr>
		<title level="m" type="main">Book of rhymes : the poetics of hip hop</title>
		<author>
			<persName><forename type="first">A</forename><surname>Bradley</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2017">2017</date>
			<publisher>Basic Civitas</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b26">
	<analytic>
		<title level="a" type="main">Neural correlates of binding lyrics and melodies for the encoding of new songs</title>
		<author>
			<persName><forename type="first">I</forename><surname>Alonso</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Davachi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Valabrègue</surname></persName>
		</author>
		<author>
			<persName><forename type="first">V</forename><surname>Lambrecq</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Dupont</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Samson</surname></persName>
		</author>
		<idno type="DOI">10.1016/j.neuroimage.2015.12.018</idno>
		<ptr target="https://pubmed.ncbi.nlm.nih.gov/26706449/.doi:10.1016/j.neuroimage.2015.12.018" />
	</analytic>
	<monogr>
		<title level="j">NeuroImage</title>
		<imprint>
			<biblScope unit="volume">127</biblScope>
			<biblScope unit="page" from="333" to="345" />
			<date type="published" when="2016">2016</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b27">
	<monogr>
		<title level="m" type="main">A rest service for poetry generation</title>
		<author>
			<persName><forename type="first">H</forename><forename type="middle">G</forename><surname>Oliveira</surname></persName>
		</author>
		<ptr target="https://www.semanticscholar.org/paper/A-REST-Service-for-Poetry-Generation-Oliveira/5b0039186ddb41ad5d037e5dbacfae837eaa5079" />
		<imprint>
			<date type="published" when="2017">2017</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b28">
	<monogr>
		<title level="m" type="main">Poetryme : a versatile platform for poetry generation</title>
		<author>
			<persName><forename type="first">H</forename><forename type="middle">G</forename><surname>Oliveira</surname></persName>
		</author>
		<ptr target="https://www.semanticscholar.org/paper/PoeTryMe-%3A-a-versatile-platform-for-poetry-Oliveira/0c62affa157a453e01514042b55babff428928fa" />
		<imprint>
			<date type="published" when="2012">2012</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b29">
	<analytic>
		<title level="a" type="main">Chinese poetry generation with recurrent neural networks</title>
		<author>
			<persName><forename type="first">X</forename><surname>Zhang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Lapata</surname></persName>
		</author>
		<idno type="DOI">10.3115/v1/d14-1074</idno>
		<ptr target="https://aclanthology.org/D14-1074/.doi:10.3115/v1/d14-1074" />
	</analytic>
	<monogr>
		<title level="m">Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)</title>
				<meeting>the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)</meeting>
		<imprint>
			<date type="published" when="2014">2014</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b30">
	<analytic>
		<title level="a" type="main">Automatic poetry generation from prosaic text</title>
		<author>
			<persName><forename type="first">T</forename><surname>Van De Cruys</surname></persName>
		</author>
		<idno type="DOI">10.18653/v1/2020.acl-main.223</idno>
		<ptr target="https://aclanthology.org/2020.acl-main.223/.doi:10.18653/v1/2020.acl-main.223" />
	</analytic>
	<monogr>
		<title level="m">Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics</title>
				<meeting>the 58th Annual Meeting of the Association for Computational Linguistics</meeting>
		<imprint>
			<date type="published" when="2020">2020</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b31">
	<analytic>
		<title level="a" type="main">Deep-speare: A joint neural model of poetic language, meter and rhyme</title>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">H</forename><surname>Lau</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Cohn</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Baldwin</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Brooke</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Hammond</surname></persName>
		</author>
		<idno type="DOI">10.18653/v1/p18-1181</idno>
		<ptr target="https://aclanthology.org/P18-1181/.doi:10.18653/v1/p18-1181" />
	</analytic>
	<monogr>
		<title level="m">Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics</title>
				<meeting>the 56th Annual Meeting of the Association for Computational Linguistics</meeting>
		<imprint>
			<date type="published" when="2018">2018</date>
			<biblScope unit="volume">1</biblScope>
		</imprint>
	</monogr>
	<note>Long Papers</note>
</biblStruct>

<biblStruct xml:id="b32">
	<monogr>
		<title level="m" type="main">Verse by verse</title>
		<author>
			<persName><surname>Google</surname></persName>
		</author>
		<ptr target="https://sites.research.google/versebyverse/" />
		<imprint>
			<date type="published" when="2022">2022</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b33">
	<monogr>
		<title level="m" type="main">Augmenting poetry composition with verse by verse</title>
		<author>
			<persName><forename type="first">D</forename><surname>Uthus</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Voitovich</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename></persName>
		</author>
		<idno type="DOI">10.18653/v1/2022.naacl-industry.3</idno>
		<imprint>
			<date type="published" when="2022">2022</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b34">
	<monogr>
		<title/>
		<author>
			<persName><forename type="first">Rhymer</forename><surname>Writeexpress</surname></persName>
		</author>
		<ptr target="https://www.rhymer.com/" />
		<imprint>
			<date type="published" when="2023">2023</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b35">
	<monogr>
		<title level="m" type="main">Rhymezone rhyming dictionary and thesaurus</title>
		<author>
			<persName><surname>Datamuse</surname></persName>
		</author>
		<ptr target="https://www.rhymezone.com/" />
		<imprint>
			<date type="published" when="2023">2023</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b36">
	<monogr>
		<ptr target="https://rytr.me/" />
		<title level="m">Rytr, Rytr -best ai writer, content generator writing assistant</title>
				<imprint>
			<date type="published" when="2022">2022</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b37">
	<monogr>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">A</forename><surname>Runco</surname></persName>
		</author>
		<title level="m">Divergent thinking, creativity, and ideation</title>
				<imprint>
			<date type="published" when="2010">2010</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b38">
	<analytic>
		<title level="a" type="main">Breaking away from set patterns of thinking: Improvisation and divergent thinking</title>
		<author>
			<persName><forename type="first">C</forename><surname>Lewis</surname></persName>
		</author>
		<author>
			<persName><forename type="first">P</forename><forename type="middle">J</forename><surname>Lovatt</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Thinking Skills and Creativity</title>
		<imprint>
			<biblScope unit="volume">9</biblScope>
			<biblScope unit="page" from="46" to="58" />
			<date type="published" when="2013">2013</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b39">
	<analytic>
		<title level="a" type="main">Divergent thinking as an indicator of creative potential</title>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">A</forename><surname>Runco</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Acar</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Creativity research journal</title>
		<imprint>
			<biblScope unit="volume">24</biblScope>
			<biblScope unit="page" from="66" to="75" />
			<date type="published" when="2012">2012</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b40">
	<analytic>
		<title level="a" type="main">In praise of convergent thinking</title>
		<author>
			<persName><forename type="first">A</forename><surname>Cropley</surname></persName>
		</author>
		<idno type="DOI">10.1207/s15326934crj1803_13</idno>
	</analytic>
	<monogr>
		<title level="j">Creativity Research Journal -CREATIV-ITY RES J</title>
		<imprint>
			<biblScope unit="volume">18</biblScope>
			<biblScope unit="page" from="391" to="404" />
			<date type="published" when="2006">2006</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b41">
	<analytic>
		<title level="a" type="main">The neuroscience of improvisation</title>
		<author>
			<persName><forename type="first">A</forename><forename type="middle">T</forename><surname>Landau</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><forename type="middle">J</forename><surname>Limb</surname></persName>
		</author>
		<idno type="DOI">10.1177/0027432116687373</idno>
		<ptr target="https://doi.org/10.1177/0027432116687373.doi:10.1177/0027432116687373" />
	</analytic>
	<monogr>
		<title level="j">Music Educators Journal</title>
		<imprint>
			<biblScope unit="volume">103</biblScope>
			<biblScope unit="page" from="27" to="33" />
			<date type="published" when="2017">2017</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b42">
	<monogr>
		<title level="m" type="main">Studying the Impact of AI-based Inspiration on Human Ideation in a Co-Creative Design System</title>
		<ptr target="https://ceur-ws.org/Vol-2903/IUI21WS-HAIGEN-7.pdf" />
		<imprint>
			<date type="published" when="2021">2021</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b43">
	<monogr>
		<author>
			<persName><forename type="first">B</forename><surname>Shneiderman</surname></persName>
		</author>
		<title level="m">Human-Centered AI</title>
				<imprint>
			<publisher>Oxford University Press</publisher>
			<date type="published" when="2022">2022</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b44">
	<analytic>
		<title level="a" type="main">Likert scale: Explored and explained</title>
		<author>
			<persName><forename type="first">A</forename><surname>Joshi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Kale</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Chandel</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename></persName>
		</author>
		<idno type="DOI">10.9734/bjast/2015/14975</idno>
		<ptr target="https://eclass.aspete.gr/modules/document/file.php/EPPAIK269/5a7cc366dd963113c6923ac4a73c3286ab22.pdf.doi:10.9734/bjast/2015/14975" />
	</analytic>
	<monogr>
		<title level="j">British Journal of Applied Science Technology</title>
		<imprint>
			<biblScope unit="volume">7</biblScope>
			<biblScope unit="page" from="396" to="403" />
			<date type="published" when="2015">2015</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b45">
	<analytic>
		<title level="a" type="main">Naming unrelated words predicts creativity</title>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">A</forename><surname>Olson</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Nahas</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Chmoulevitch</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><forename type="middle">J</forename><surname>Cropper</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">E</forename><surname>Webb</surname></persName>
		</author>
		<idno type="DOI">10.1073/pnas.2022340118</idno>
		<ptr target="https://www.pnas.org/content/118/25/e2022340118.doi:10.1073/pnas.2022340118" />
	</analytic>
	<monogr>
		<title level="j">Proceedings of the National Academy of Sciences</title>
		<imprint>
			<biblScope unit="volume">118</biblScope>
			<date type="published" when="2021">2021</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b46">
	<analytic>
		<title level="a" type="main">Becoming better versed: Towards the design of a popular music-based rhyming game for disadvantaged youths</title>
		<author>
			<persName><forename type="first">J</forename><surname>Ocumpaugh</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Mercedes</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Rodrigo</surname></persName>
		</author>
		<author>
			<persName><forename type="first">K</forename><surname>Porayska-Pomsta</surname></persName>
		</author>
		<author>
			<persName><forename type="first">I</forename><surname>Olatunji</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Luckin</surname></persName>
		</author>
		<ptr target="https://apsce.net/icce/icce2018/wp-content/uploads/2018/12/C6-04.pdf" />
	</analytic>
	<monogr>
		<title level="m">Proceedings of the 26th International Conference on Computers in Education</title>
				<meeting>the 26th International Conference on Computers in Education<address><addrLine>Philippines</addrLine></address></meeting>
		<imprint>
			<publisher>Asia-Pacific Society for Computers in Education</publisher>
			<date type="published" when="2018">2018</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b47">
	<analytic>
		<title level="a" type="main">Using automated rhyme detection to characterize rhyming style in rap music</title>
		<author>
			<persName><forename type="first">H</forename><surname>Hirjee</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Brown</surname></persName>
		</author>
		<idno type="DOI">10.18061/1811/48548</idno>
	</analytic>
	<monogr>
		<title level="j">Empirical Musicology Review</title>
		<imprint>
			<biblScope unit="volume">5</biblScope>
			<biblScope unit="page" from="121" to="145" />
			<date type="published" when="2010">2010</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b48">
	<monogr>
		<author>
			<persName><forename type="first">Z</forename><surname>Hu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><forename type="middle">K</forename><surname>.-W. Lee</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><forename type="middle">C</forename><surname>Aggarwal</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Zhang</surname></persName>
		</author>
		<idno type="DOI">10.48550/ARXIV.2010.12742</idno>
		<ptr target="https://arxiv.org/abs/2010.12742.doi:10.48550/ARXIV.2010.12742" />
		<title level="m">Text style transfer: A review and experimental evaluation</title>
				<imprint>
			<date type="published" when="2020">2020</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b49">
	<monogr>
		<author>
			<persName><forename type="first">R</forename><surname>Roberts</surname></persName>
		</author>
		<ptr target="https://www.latimes.com/entertainment/music/la-et-ms-kendrick-pulitzer-reactions-20180420-story.html" />
		<title level="m">Kendrick lamar&apos;s pulitzer prize sparks lively -and at times snobby -conversations on the aesthetics of music</title>
				<imprint>
			<date type="published" when="2018">2018</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b50">
	<monogr>
		<title level="m" type="main">Openai api</title>
		<author>
			<persName><surname>Openai</surname></persName>
		</author>
		<ptr target="https://openai.com/api/" />
		<imprint>
			<date type="published" when="2021">2021</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b51">
	<monogr>
		<author>
			<persName><surname>Amazon</surname></persName>
		</author>
		<ptr target="https://tinyurl.com/amazonGPT" />
		<title level="m">Alexatm 20b is now available in amazon sagemaker jumpstart | amazon web services</title>
				<imprint>
			<date type="published" when="2022">2022</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b52">
	<monogr>
		<title/>
		<author>
			<persName><surname>Huggingface</surname></persName>
		</author>
		<ptr target="https://huggingface.co/docs/transformers/main/en/model_doc/gpt_neox#overview" />
		<imprint>
			<date type="published" when="2022">2022</date>
			<pubPlace>Gpt-neox</pubPlace>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b53">
	<monogr>
		<title level="m" type="main">Current limitations of language models: What you need is retrieval</title>
		<author>
			<persName><forename type="first">A</forename><surname>Komatsuzaki</surname></persName>
		</author>
		<ptr target="https://www.researchgate.net/publication/344261335_Current_Limitations_of_Language_" />
		<imprint>
			<date type="published" when="2020">2020</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b54">
	<monogr>
		<author>
			<persName><forename type="first">F</forename><surname>Hill</surname></persName>
		</author>
		<author>
			<persName><forename type="first">K</forename><surname>Yuan</surname></persName>
		</author>
		<ptr target="https://www.theatlantic.com/technology/archive/2018/10/rupi-kaur-instagram-poet-entrepreneur/572746/" />
		<title level="m">How instagram saved poetry: Social media is turning an art form into an industry</title>
				<imprint>
			<date type="published" when="2018">2018</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b55">
	<monogr>
		<title level="m" type="main">Instagram is the future of poetry</title>
		<author>
			<persName><forename type="first">H</forename><surname>Oliver</surname></persName>
		</author>
		<ptr target="https://unherd.com/2021/10/instagram-is-the-future-of-poetry/" />
		<imprint>
			<date type="published" when="2021">2021</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b56">
	<monogr>
		<title level="m" type="main">Lives of the Poets</title>
		<author>
			<persName><forename type="first">M</forename><surname>Schmidt</surname></persName>
		</author>
		<imprint>
			<date type="published" when="1999">1999</date>
			<pubPlace>Phoenix</pubPlace>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b57">
	<analytic>
		<title level="a" type="main">Investigating societal biases in a poetry composition system</title>
		<author>
			<persName><forename type="first">E</forename><surname>Sheng</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><forename type="middle">C</forename><surname>Uthus</surname></persName>
		</author>
		<ptr target="https://aclanthology.org/2020.gebnlp-1.9/" />
	</analytic>
	<monogr>
		<title level="j">ACL Anthology</title>
		<imprint>
			<biblScope unit="page" from="93" to="106" />
			<date type="published" when="2020">2020</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b58">
	<monogr>
		<title level="m" type="main">Reducing sentiment bias in language models via counterfactual evaluation</title>
		<author>
			<persName><forename type="first">P.-S</forename><surname>Huang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Zhang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Jiang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Stanforth</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Welbl</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Rae</surname></persName>
		</author>
		<author>
			<persName><forename type="first">V</forename><surname>Maini</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Yogatama</surname></persName>
		</author>
		<author>
			<persName><forename type="first">P</forename><surname>Kohli</surname></persName>
		</author>
		<idno type="DOI">10.48550/ARXIV.1911.03064</idno>
		<ptr target="https://arxiv.org/abs/1911.03064.doi:10.48550/ARXIV.1911.03064" />
		<imprint>
			<date type="published" when="2019">2019</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b59">
	<monogr>
		<title level="m" type="main">Towards an Enhanced Understanding of Bias in Pre-trained Neural Language Models: A Survey with Special Emphasis on Affective Bias</title>
		<author>
			<persName><forename type="first">A</forename><forename type="middle">K</forename></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">P</forename><surname>Gangan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><forename type="middle">P</forename></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><forename type="middle">V L</forename></persName>
		</author>
		<imprint>
			<date type="published" when="2022">2022</date>
			<publisher>Springer Nature</publisher>
			<pubPlace>Singapore</pubPlace>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b60">
	<monogr>
		<title level="m" type="main">Hip-hop passes rock to become most popular music genre for first time in history: Nielsen</title>
		<author>
			<persName><forename type="first">J</forename><surname>Lynch</surname></persName>
		</author>
		<ptr target="https://www.businessinsider.com/hip-hop-passes-rock-most-popular-music-genre-nielsen-2018-1?r=US&amp;IR=T" />
		<imprint>
			<date type="published" when="2018">2018</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b61">
	<monogr>
		<title level="m" type="main">Hip-hop is the most listened to genre in the world</title>
		<author>
			<persName><forename type="first">A</forename><surname>Texas</surname></persName>
		</author>
		<ptr target="https://www.nme.com/news/music/various-artists-1151-1214849" />
		<imprint>
			<date type="published" when="2015">2015</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b62">
	<monogr>
		<title level="m" type="main">Hip hop</title>
		<author>
			<persName><surname>Wikipedia</surname></persName>
		</author>
		<ptr target="https://en.wikipedia.org/wiki/Hip_hop" />
		<imprint>
			<date type="published" when="2021">2021</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b63">
	<monogr>
		<title level="m" type="main">Nearly a third of all streams in the us last year were of hip-hop and rnb artists as rock beat pop to second</title>
		<author>
			<persName><forename type="first">T</forename><surname>Ingham</surname></persName>
		</author>
		<ptr target="https://www.musicbusinessworldwide.com/nearly-a-third-of-all-streams-in-the-us-last-year-were-of-hip-hop-and-rb-music/" />
		<imprint>
			<date type="published" when="2021">2021</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b64">
	<analytic>
		<title level="a" type="main">Dopelearning: A computational approach to rap lyrics generation</title>
		<author>
			<persName><forename type="first">E</forename><surname>Malmi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">P</forename><surname>Takala</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Toivonen</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Tapani</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Gionis</surname></persName>
		</author>
		<idno type="DOI">10.1145/2939672.2939679</idno>
	</analytic>
	<monogr>
		<title level="m">KDD &apos;16: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining</title>
				<imprint>
			<date type="published" when="2016">2016</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b65">
	<monogr>
		<title level="m" type="main">We wrote an algorithm to unravel the rhymes of hit musical &apos;hamilton</title>
		<author>
			<persName><forename type="first">J</forename><surname>Eastwood</surname></persName>
		</author>
		<author>
			<persName><forename type="first">E</forename><surname>Hinton</surname></persName>
		</author>
		<ptr target="http://graphics.wsj.com/hamilton/" />
		<imprint>
			<date type="published" when="2016">2016</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b66">
	<monogr>
		<author>
			<persName><forename type="first">C</forename></persName>
		</author>
		<ptr target="https://www.bbc.co.uk/programmes/p0dj70yd" />
		<title level="m">Fight the power: How hip hop changed the world</title>
				<imprint/>
	</monogr>
</biblStruct>

<biblStruct xml:id="b67">
	<monogr>
		<author>
			<persName><forename type="first">N</forename><surname>Condit-Schultz</surname></persName>
		</author>
		<ptr target="https://etd.ohiolink.edu/apexprod/rws_etd/send_file/send?accession=osu1461250949&amp;disposition=inline" />
		<title level="m">MCFlow: A Digital Corpus of Rap Flow</title>
				<imprint>
			<date type="published" when="2016">2016</date>
		</imprint>
	</monogr>
	<note type="report_type">Ph.D. thesis</note>
</biblStruct>

<biblStruct xml:id="b68">
	<monogr>
		<author>
			<persName><forename type="first">J</forename><surname>Eastwood</surname></persName>
		</author>
		<author>
			<persName><forename type="first">E</forename><surname>Hinton</surname></persName>
		</author>
		<ptr target="http://graphics.wsj.com/hamilton-methodology/" />
		<title level="m">How wsj used an algorithm to analyze &apos;hamilton&apos; the musical</title>
				<imprint>
			<date type="published" when="2016">2016</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b69">
	<monogr>
		<title level="m" type="main">A Small-Data Mindset for Generative AI Creative Work</title>
		<imprint>
			<date type="published" when="2022">2022</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b70">
	<monogr>
		<ptr target="https://developer.musixmatch.com/" />
		<title level="m">Musixmatch developer api</title>
				<imprint>
			<date type="published" when="2023">2023</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b71">
	<monogr>
		<title level="m" type="main">Gpt-2 neural network poetry</title>
		<author>
			<persName><forename type="first">S</forename><surname>Presser</surname></persName>
		</author>
		<ptr target="https://www.gwern.net/GPT-2" />
		<imprint>
			<date type="published" when="2019">2019</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b72">
	<analytic>
		<title level="a" type="main">From distributional semantics to conceptual spaces: A novel computational method for concept creation</title>
		<author>
			<persName><forename type="first">S</forename><surname>Mcgregor</surname></persName>
		</author>
		<author>
			<persName><forename type="first">K</forename><surname>Agres</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Purver</surname></persName>
		</author>
		<author>
			<persName><forename type="first">G</forename><surname>Wiggins</surname></persName>
		</author>
		<idno type="DOI">10.1515/jagi-2015-0004</idno>
	</analytic>
	<monogr>
		<title level="j">Journal of Artificial General Intelligence</title>
		<imprint>
			<biblScope unit="volume">6</biblScope>
			<biblScope unit="page" from="55" to="86" />
			<date type="published" when="2015">2015</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b73">
	<monogr>
		<author>
			<persName><forename type="first">D</forename><surname>Yang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>Zhou</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Z</forename><surname>Zhang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Jia</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Li</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Lc</surname></persName>
		</author>
		<ptr target="https://ceur-ws.org/Vol-3124/paper6.pdf" />
		<title level="m">Ai as an activewriter: Interaction strategies with generated text in human-ai collaborative fiction writing</title>
				<imprint>
			<date type="published" when="2019">2019</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b74">
	<analytic>
		<title level="a" type="main">The emotional power of poetry: neural circuitry, psychophysiology and compositional principles</title>
		<author>
			<persName><forename type="first">E</forename><surname>Wassiliwizky</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Koelsch</surname></persName>
		</author>
		<author>
			<persName><forename type="first">V</forename><surname>Wagner</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Jacobsen</surname></persName>
		</author>
		<author>
			<persName><forename type="first">W</forename><surname>Menninghaus</surname></persName>
		</author>
		<idno type="DOI">10.1093/scan/nsx069</idno>
	</analytic>
	<monogr>
		<title level="j">Social Cognitive and Affective Neuroscience</title>
		<imprint>
			<biblScope unit="volume">12</biblScope>
			<biblScope unit="page" from="1229" to="1240" />
			<date type="published" when="2017">2017</date>
		</imprint>
	</monogr>
</biblStruct>

				</listBibl>
			</div>
		</back>
	</text>
</TEI>
