<?xml version="1.0" encoding="UTF-8"?>
<TEI xml:space="preserve" xmlns="http://www.tei-c.org/ns/1.0" 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" 
xsi:schemaLocation="http://www.tei-c.org/ns/1.0 https://raw.githubusercontent.com/kermitt2/grobid/master/grobid-home/schemas/xsd/Grobid.xsd"
 xmlns:xlink="http://www.w3.org/1999/xlink">
	<teiHeader xml:lang="en">
		<fileDesc>
			<titleStmt>
				<title level="a" type="main">Subversive Characters and Stereotyping Readers: Characterizing Queer Relationalities with Dialogue-Based Relation Extraction</title>
			</titleStmt>
			<publicationStmt>
				<publisher/>
				<availability status="unknown"><licence/></availability>
			</publicationStmt>
			<sourceDesc>
				<biblStruct>
					<analytic>
						<author>
							<persName><forename type="first">Kent</forename><forename type="middle">K</forename><surname>Chang</surname></persName>
							<email>kentkchang@berkeley.edu</email>
							<affiliation key="aff0">
								<orgName type="department">School of Information</orgName>
								<orgName type="institution">University of California</orgName>
								<address>
									<settlement>Berkeley</settlement>
									<country>United States of America</country>
								</address>
							</affiliation>
						</author>
						<author>
							<persName><forename type="first">Anna</forename><surname>Ho</surname></persName>
							<email>annaho@berkeley.edu</email>
							<affiliation key="aff0">
								<orgName type="department">School of Information</orgName>
								<orgName type="institution">University of California</orgName>
								<address>
									<settlement>Berkeley</settlement>
									<country>United States of America</country>
								</address>
							</affiliation>
						</author>
						<author>
							<persName><forename type="first">David</forename><surname>Bamman</surname></persName>
							<email>dbamman@berkeley.edu</email>
							<affiliation key="aff0">
								<orgName type="department">School of Information</orgName>
								<orgName type="institution">University of California</orgName>
								<address>
									<settlement>Berkeley</settlement>
									<country>United States of America</country>
								</address>
							</affiliation>
						</author>
						<title level="a" type="main">Subversive Characters and Stereotyping Readers: Characterizing Queer Relationalities with Dialogue-Based Relation Extraction</title>
					</analytic>
					<monogr>
						<idno type="ISSN">1613-0073</idno>
					</monogr>
					<idno type="MD5">09E9114D8176C1B96D3E097B4F18C54A</idno>
				</biblStruct>
			</sourceDesc>
		</fileDesc>
		<encodingDesc>
			<appInfo>
				<application version="0.7.2" ident="GROBID" when="2025-04-23T19:49+0000">
					<desc>GROBID - A machine learning software for extracting information from scholarly documents</desc>
					<ref target="https://github.com/kermitt2/grobid"/>
				</application>
			</appInfo>
		</encodingDesc>
		<profileDesc>
			<textClass>
				<keywords>
					<term>conversation analysis</term>
					<term>language models</term>
					<term>relation extraction</term>
					<term>television studies</term>
					<term>gender and queer studies</term>
				</keywords>
			</textClass>
			<abstract>
<div xmlns="http://www.tei-c.org/ns/1.0"><p>Television is often seen as a site for subcultural identification and subversive fantasy, including in queer cultures. How might we measure subversion, or the degree to which the depiction of social relationship between a dyad (e.g. two characters who are colleagues) deviates from its typical representation on TV? To explore this question, we introduce the task of stereotypic relationship extraction. Built on cognitive stylistics, linguistic anthropology, and dialogue relation extraction, in this paper, we attempt to model the cognitive process of stereotyping TV characters in dialogic interactions: given a dyad, we want to predict: what social relationship do the speakers exhibit through their words? Subversion is then characterized by the discrepancy between the distribution of the model's predictions and the ground truth labels. To demonstrate the usefulness of this task and gesture at a methodological intervention, we enclose four case studies to characterize the representation of queer relationalities in the Big Bang Theory, Frasier, and Gilmore Girls as we explore the suspicious and reparative modes of reading with our computational methods.</p></div>
			</abstract>
		</profileDesc>
	</teiHeader>
	<text xml:lang="en">
		<body>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="1.">Introduction</head><p>Television, often featuring hyper-realized characters, is an important venue for understanding social and relational identities. Take this scene from the Big Bang Theory: howard. So, who wants to rent Fiddler? sheldon. No need! We have the special edition. leonard. Well, maybe we are like Haroun and Tanweer.</p><p>(season 1, episode 8)</p><p>Haroun and Tanweer are, as just revealed to the characters, a gay couple who recently adopted a baby. Knowing that they are a gay couple, Leonard immediately assumes that they love the musical theater that Fiddler on the Roof represents. Indeed, in popular culture, musical theater might have been the queerest genre. However, in his appraisal of its cultural significance in queer culture, John M. Clum, writing in 1999, opens with a rather curious note: "The surfeit of television situation comedy has pretty much killed stage comedy. When you can get crypto-gay Frasier free every week, who needs the gag-rich musical comedy?" [8, p. 12] Perhaps Clum is right. In that same year, his "crypto-gay" show aired an episode rather reminiscent of Wildean comedy of manners, in which the Crane brothers try to organize a dinner party (or according to them, an "intime soiree"), constantly on the phone inviting their friends, only to find this in the voicemail: allison. We just got invited to a dinner party at Dr. Crane's. harry. Which Dr. Crane? allison. Does it matter? You get the one, you get that other one. Personally, I think the whole arrangement's a little … What Alison truly thinks of them is never revealed to the audience, although the quick-witted Frasier jumps to his conclusion: niles. What you suppose she meant by that? frasier. She thinks we're always together-that we're some sort of … couple.</p><p>niles. That's ridiculous! We spend lots of time apart. Besides, who is she to talk? Look at her and Harry! They go everywhere together. frasier. They're married, Niles! Still, there's no reason for her to call us odd.</p><p>(season 6, episode <ref type="bibr" target="#b16">17)</ref> What ensues is another similarly frivolous argument on "who's the other one, " then another on who not to invite to dinner. Much of this episode is Frasier and Niles arguing in the apartment like an old, married couple ("It's possible we have grown a tad dependent on one another. ") while appreciating each other ( "So we spend a lot of time together-so what? I enjoy it!").</p><p>Those aforementioned scenes from the Big Bang Theory and Frasier deal with a key aspect of discursive interactions that constitute the subject of the present study: how certain forms of dialogic interaction index certain social and relational identities, including that of a stereotypical gay man or a married couple. If Frasier and Niles are odd as brothers, who are they to each other? If we see their speeches as indexical signifiers, what social identities do they anchor in the interactional context? Built on cognitive stylistics <ref type="bibr" target="#b9">[10]</ref> and social semiotics <ref type="bibr" target="#b39">[40]</ref>, this work seeks to understand how the depiction of a social relationship between a pair of characters (or a dyad) in conversation deviates from the typical representation of that relationship type on TV. We hope to advance an operationalization of subversion grounded in queer studies to interrogate the representation of queer relationalities on TV, and enclose four case studies to demonstrate how it can enable more close readings, which has implications for both computational humanities and queer studies. <ref type="foot" target="#foot_0">1</ref></p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2.">Task and data</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2.1.">Task: dialogue-based stereotypic relationship extraction</head><p>Our main computational task involves predicting a stereotypical relationship type, given a dialogue between a dyad (or, two characters) from a scene in a TV series. We follow convention of relation extraction in NLP <ref type="bibr" target="#b44">[45,</ref><ref type="bibr" target="#b18">19]</ref> and refer to each dyad in terms of head and tail; unlike the core NLP task, however, we are not simply trying to optimize a model for the true relationship type, but rather identify those moments of dissonance between the truth and a prediction. For example, consider this line from Gilmore Girls: "Lorelai, go to your room!" Rory, who says this line, is Lorelai's daughter, but here she sounds like her mother for the dramatic effect, and indeed, "go to your room" sounds stereotypically like a parent. This kind of subversion is at the core of this work: Rory deviates from the representation of a daughter and talks like a mother. In terms of modeling, the ground truth relationship type is child_of for the dyad (Rory, Lorelai), but we expect the prediction of the stereotypic relationship to be parent_of, precisely because we are modeling the stereotypic belief <ref type="bibr" target="#b9">[10]</ref> of a viewer. Formally, given a scene 𝒮 comprised of multiple dialogue turns, each an utterance 𝑢 𝑖 = (𝑠 𝑖 , 𝑤 0 , … , 𝑤 𝑛 ), where 𝑐 ∈ 𝑆 𝒮 denotes the character (or speaker) identity among all characters 𝐶 in the scene 𝒮 , and 𝑤 the words they speak, we seek to train a model 𝐹 (𝑐 𝒮 ℎ , 𝑐 𝒮 𝑡 ), where 𝑐 ℎ is the character that occupies the head position, 𝑐 𝑡 the corresponding tail, to predict a relationship label 𝑟 ∈ ℛ, making it an |ℛ|-way classification problem.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2.2.">Dataset: dialogues and dyads</head><p>In order to carry out this inquiry, we need to identify the true relationship for a set of character pairs attended with dialogue in scripts, and build a model of their stereotypical interaction. To support this task, we put together a dedicated dataset of the following components:</p><p>Dialogues from parsed teleplays. We digitize and parse teleplays of pilot episodes from TV Writing to support this task. <ref type="foot" target="#foot_1">2</ref> Pilot episodes in the teleplay format are preferable for this task because, unlike sampling a random episode from a collection of transcripts, they typically do not require their audience to have any background knowledge of the series itself, and the standardized format of the teleplay gives us reliable scene segmentation as well as other structural information of the interaction (e.g. speaker labels and background action statements). However, digitized PDF files are unstructured. To address this, we leverage the fact that in teleplays, structural elements are distinguished by the amount of indentation a line has. For example, speaker labels are most heavily indented. We used Teseract to perform OCR on the PDF files, <ref type="foot" target="#foot_2">3</ref> which gives us both the recognized texts and the bounding box associated with them for each page. With this information, we used OpenAI's GPT-4o to parse those OCR'd teleplays in a one-shot setup: the model is tasked to classify each line as one of the following: scene header, speaker label, speaker note, action statement, or other, and combine consecutive lines of the same structural role. This results in 787 titles, which we split into training, development, and test sets.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Relationship type labels.</head><p>Another component is the relationship type labels that we can use for training models and analysis. We first use Wikipedia On-Demand API to identify and gather pages related to each title for which we have the teleplay of the pilot episode. <ref type="foot" target="#foot_3">4</ref> With this resource, we devise a pipeline of three stages: During the mining stage, we employ GPT-4o to extract relationship tuples from these summaries without using any predefined relationship labels. This extraction process was followed by a manual review, where we pruned the labels by merging semantically similar ones, such as "kid_of" and "child_of"; this is the pruning stage. To ensure quality, a co-author replicated the relationship extraction task on a test set comprising 50 titles in our test set. For relations that GPT-4o did extract, the accuracy is satisfactory at 81.67%. Finally, we verify the accuracy of all extractions in both the development and test sets, which concludes the verification stage. In principle, several of the relationship types can be overlapping-two characters may be seen to be both married (spouse_of) and lovers (love_interest_of). In order to create a multiclass classification problem (predicting only one label for each dyad), we rank all relationship types based on their specificity (as listed in Table <ref type="table" target="#tab_6">3</ref> in Appendix B) and ask a model to predict the most specific relationship type from this set. The most frequent relationship types are: colleague_of, friend_of, sibling_of, spouse_of, and classmate_of.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Dyads.</head><p>To generate dyads for training and analysis, we begin by collecting the set of speaker labels present in each teleplay. These labels are often noisy due to OCR errors and inconsistencies with how names appear in Wikipedia summaries. To standardize these labels, we query the title in the Movie Database (TMDb), <ref type="foot" target="#foot_4">5</ref> which provides a list of characters, both recurring and guest. We then match each speaker label with a canonical character name from TMDb using a simple heuristic: if there is at least one token overlap, we select the TMDb character name with minimal edit distance. Labels that do not match (typically generic names like "MAN #1") are discarded. With standardized speaker labels, we create the list of dyads of interest for each scene by permuting the labels in pairs (i.e. creating 2-permutations from the set of distinct speakers in a scene). This means that a pair of characters is considered only if both have speaking roles within the same scene. Finally, we include a dyad in our dataset if we have previously extracted its relationship type from Wikipedia. See Appendix C for statistics and more information.</p><p>Anonymization. Previous work indicates speaker anonymization is beneficial as it mitigates the distraction and noise named entities might introduce <ref type="bibr" target="#b6">[7]</ref>. We similarly anonymize our dataset to evaluate its impact. For each scene, we maintain a mapping table between canonical speaker names and randomly assigned entity IDs. All speaker identities are then replaced with ENTITY plus their unique scene ID, and their mentions in dialogue lines are anonymized in the same way. Some canonical names include generic words, often related to a profession (e.g. "coach"), and those words would be anonymized, which might lead to an unnecessary &lt;background&gt; Briefcase in hand , ENTITY 5 is once again waiting for the elevator . He 's approached by ENTITY 6 , 39 , smart , cute , but not sweet . You do n 't get to be hospital administrator and dean of medicine by being sweet . &lt;speaker&gt; ENTITY 6 &lt;line&gt; I was expecting you in my office twenty minutes ago . &lt;speaker&gt; ENTITY 5 &lt;line&gt; Really ? That 's odd because I had no intention of being in your office twenty minutes ago . loss of information. To address this, we aggregate all tokens in canonical speaker names and manually annotate whether each token is part of a proper name or a non-name content word. An example is in Fig. <ref type="figure" target="#fig_0">1</ref> (special tokens like &lt;speaker&gt; are explained in Sec. 3).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.">Models and experiments</head><p>Given this data, we can build and evaluate models of stereotyping readers, who learn from the totality of relationships encoded in our training data to infer the relationship enacted between two characters in a specific scene. We do not expect a model to be able to identify the true relationship with perfect accuracy-not every relationship is enacted in dialogue at the level of a single scene; but more importantly, our work is premised on the idea that the relationship we observe on screen (and that a model observes as well) can exhibit variation that is deliberately at odds with that "truth. " And yet, accuracy at predicting that truth provides us with an instrumental means to select between different models, and we assess several variants in order to find the one most sensitive to the dialogic indicators of how relationships are performed.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.1.">Models</head><p>We compare the performance of the following models on this task to select the best strategy to model stereotyping readers with our data. We first establish the majority class (predicting the most frequent class, colleague_of) baseline for all models. Since the task takes the form 𝐹 (𝑐 𝒮 ℎ , 𝑐 𝒮 𝑡 ), those models can be categorized based on how we choose to represent the character 𝑐 ℎ and 𝑐 𝑡 in scene 𝒮 : supervised and prompting: Supervised. We start with an utterance-based model, where we string together all utterances spoken by the head and tail speakers, respectively. The motivation is that each speaker can be represented by all of their utterances in the scene. Those utterances are subsequently encoded by the same Longformer-base encoder <ref type="bibr" target="#b1">[2]</ref>; we extract the CLS tokens (&lt;s&gt;) that represent all the utterances and concatenate them, resulting in the overall representation:</p><formula xml:id="formula_0">ℎ = [𝑒 𝑐 ℎ &lt;s&gt; ; 𝑒 𝑐 𝑡 &lt;s&gt; ].<label>(1)</label></formula><p>Next, we include a representation of the entire scene using the attentive pooling technique.</p><p>Here, we similarly string all the tokens in the entire scene together, but to enhance the structural awareness of the teleplay (e.g. some tokens are speaker labels, and some are their lines), we introduce the following special tokens, whose representations are learned during training: &lt;scene&gt;, &lt;speaker&gt;, &lt;line&gt;, and &lt;background&gt;. A full example is in Fig. <ref type="figure" target="#fig_0">1</ref>. We take inspiration from <ref type="bibr" target="#b34">[35]</ref> and incorporate attentive pooling techniques for the scene representation. Since we have the utterances from both head and tail speakers from the utterance-based model, we want to emphasize other information in the scene by guiding the model to attend less to those utterances and more to dialogue lines from other speakers. In encoding the scene here, we introduce a token-level mask 𝑀, where 𝑀[𝑗] = 0 if the 𝑗-th word is spoken by either head or tail speaker and 𝑀[𝑗] = 1 otherwise. Following <ref type="bibr" target="#b34">[35]</ref>, the scene information selected by 𝑀 is:</p><formula xml:id="formula_1">ℎ 𝒮 = 𝑒 𝒮 &lt;s&gt; ; 𝐴 = 𝑤 𝐴 ⊤ ℎ 𝒮 ; 𝛼 = softmax(𝐴 ⊙ 𝑀).<label>(2)</label></formula><p>The head-and tail-aware attention is used to pull the hidden states: ℎ 𝒮 ⊤ 𝛼, which is concatenated with head and tail utterances:</p><formula xml:id="formula_2">ℎ = [𝑒 𝑐 ℎ &lt;s&gt; ; 𝑒 𝑐 𝑡 &lt;s&gt; ; ℎ 𝒮 ⊤ 𝛼].<label>(3)</label></formula><p>The overall representation ℎ is then fed to a linear classification head 𝑓 , which yields 𝑃(𝑟|ℎ) = softmax(𝑓 (ℎ)) and r = arg max 𝑃(⋅).</p><p>Prompting. For prompt-based models, the overall prompt design resembles a QA task, where given a scene, the model is tasked to answer, head speaker is ____ of tail speaker. We consider three popular strategies to enhance the performance of large language models: we prompt LLaMA 3-70b-instruct zero-shot and one-shot, 6 and leverage the hidden chain-of-thought process <ref type="bibr" target="#b43">[44]</ref> in OpenAI's o1-mini. 7 For more details, see Appendix D. </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.2.">Experimental results</head><p>Experimental results are reported in Table <ref type="table" target="#tab_0">1</ref>, including 95% confidence intervals from 10,000 bootstrap resamples. <ref type="foot" target="#foot_7">8</ref> We evaluate the performance of each model by comparing its prediction against the true relationship label we have obtained from Wikipedia. Given the premise of this work is that the true relationship type is not necessarily performed in every interaction, we expect the accuracy here to be low, but the model should still perform better than guessing the most frequent label in the training set. In assessing the impact of anonymization, we include additional rows for when we anonymize the training set and columns for test ones.</p><p>For the supervised models, we observe that adding contextual information about the scene that is absent from the head and tail utterances significantly improves the performance of the model. When the model already has the scene information, anonymizing the training set appears beneficial, which is aligned with the findings reported in <ref type="bibr" target="#b6">[7]</ref>. For evaluation, anonymization does not significantly hurt the performance of our supervised models. However, it does for the prompt-based models we evaluate. While they yield similar performance on the unanonymized data (around 0.242), the three prompt-based models do not produce identical predictions: LLaMA's zero-shot and one-shot models have a Cohen's 𝜅 <ref type="bibr" target="#b8">[9]</ref> of 0.71[0.70, 0.72], and that between LLaMA zero-shot and OpenAI o1-mini is 0.37[0.36, 0.39]. This suggests a low agreement rate between LLaMA and OpenAI models.</p><p>Since the goal of this section is to figure out the best strategy for modeling stereotyping readers, it is crucial to establish the facial validity of the best-performing model before we impart any trust in its predictions. In further examining the face validity of the predictions of our best-performing model before moving on to the analysis, we represent the most distinct tokens for the key predicted relationship types measured by log-odds ratio with an uninformative Dirichlet prior <ref type="bibr" target="#b29">[30]</ref> in Table <ref type="table" target="#tab_1">2</ref>, which we can consider a form of post-hoc global explanation providing insight into what a model has learned <ref type="bibr" target="#b11">[12]</ref>. We aggregate all head utterances by the predicted relationship type and use them as the target corpus, and the rest as the reference corpus. For each relationship type presented, we include the top ten tokens most strongly asso-ciated with the target corpus. Those five types are chosen because they are central to our case studies presented in the analysis section below. In Table <ref type="table" target="#tab_1">2</ref>, we see that the model has learned to associate the relationship types with some of the words the dyad in question typically talks about (e.g. parents talk about kids), colleague has to do with occupational terms on TV (e.g. detectives investigate the death of someone), and friend is focused on high school life (e.g. students vote for student council president). Although there are terms that seem confusing (say, jacket in colleague_of) out of context, the words that are more strongly associated with those categories make an intuitive sense in the context of scripted TV series.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4.">Analysis</head><p>Well, I suppose I do think of you as a sister. And sometimes, a mother.</p><p>-Sheldon Cooper to his friend, Penny, in the Big Bang Theory -eve kosofsky sedgwick, Tendencies <ref type="bibr" target="#b35">[36]</ref> Television is often seen as a medium for subcultural identification <ref type="bibr" target="#b15">[16]</ref> and subversive fantasy <ref type="bibr" target="#b30">[31]</ref>, and this work is animated by the sociological impulse in certain strands of queer studies that see artistic forms as reflecting "the texture and makeup of queer social worlds" <ref type="bibr">[26, p. 115]</ref>. From this perspective, we can see certain moments on TV as representing a queer time and place that sits "in opposition to the social institutions of family, heterosexuality, and reproduction" [18, p. 1], where endless possibilities of subversive relational forms take shape in the "excesses of meaning" <ref type="bibr">[36, p. 8]</ref>. We can use the model described in this paper to characterize this phenomenon. For our analysis, we choose the dataset introduced in Sang, Mou, Yu, Yao, Li, and Stanton <ref type="bibr" target="#b34">[35]</ref>, which consists of five TV series, each almost in their entirety, which allows us to study narrative arcs that span multiple seasons. Through the case studies, we hope to demonstrate how this work might shed light on the representation of queer modes of relating in the Big Bang Theory, Frasier, and Gilmore Girls.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4.1.">Queer characters and suspicious reading</head><p>Our first case study takes up David Halperin's inquiry into queer love <ref type="bibr" target="#b16">[17]</ref> and its central question: "how is it possible for two men to be together" when existing social institutions cannot accommodate such a form of togetherness <ref type="bibr">[14, p. 136</ref>]. For Michel Foucault and Halperin, the love between men is queer not because of their sexual preferences and practices; it is instead because of their counter-conduct <ref type="bibr" target="#b10">[11]</ref>. In the context of this study, for any given discursive and dyadic interaction on television, we see how "one conducts oneself, lets oneself be conducted, and finally, in which one behaves under the influence of a conduct as the action of conducting" <ref type="bibr">[11, p. 128</ref>]. Conduct is dictated by the social relationship the dyad indexically presumes and projects through conducting with their speech acts. In this light, the act of subversion through speech-when characters disrupt expected linguistic norms by using forms typically reserved for certain social categories-transgresses the presumptive bounds of relational form and is essential to the practice of counter-conduct. Importantly, counter-conduct necessitates new forms of relationality: men in queer love need to "invent, from A to Z, a relationship that is still formless" <ref type="bibr">[14, p. 136</ref>]. Can we use our model to investigate counter-conduct and relational forms? The titles in our analysis dataset feature some characters that have become the subject of various queer readings: for example, Frasier and Niles from Frasier are said to embody gay sensibility <ref type="bibr" target="#b32">[33]</ref>, and the four male protagonists of the Big Bang Theory perform "queer-straight masculinity" <ref type="bibr" target="#b28">[29]</ref>. Juxtaposing the relational possibilities queerness affords and the subversive potentials that many find inherent in those characters, we can use our model as a tool to facilitate and augment close reading.</p><p>In the Big Bang Theory, Raj Koothrappali and Howard Wolowitz are colleagues at Caltech, but they often talk like a couple: howard. We're just saying all the things we love about each other. raj. Oh, like you and I did at couple's therapy?</p><p>(season 8, episode 9)</p><p>Much debate surrounding Raj focuses on whether he is gay, to which Steve Molaro, producer and writer of the show, says: while it's viable, "it was a little more interesting to have a guy so comfortable in his feminine side who's not gay, and explore that" <ref type="bibr">[32, p. 244</ref>]. Along with his self-identification as a metrosexual and fascination with divas ("Cher, Madonna, Adele. All the women who rock me", season 5 episode 14), we might understand Molaro as gesturing at separating two distinct dimensions of the Raj character: his sexual orientation and, per Foucault, his "way of life" <ref type="bibr" target="#b13">[14]</ref>. Against this backdrop, we argue that Raj and Howard offer more than occasional punchlines; they represent an instance of queer love: they have to invent a form of togetherness for themselves, despite being constantly under the watch of, occasionally derided by, the maternal signifier, the figure sans figure Mrs. Wolowitz, Howard's mother, who we never see on screen: "Frankly, after all your sleepovers with the little brown boy, a girl is a big relief" (season 5, episode 3). This need to invent is made explicit by another character in the series, Dr. Beverly Hofstadter, albeit in a pejorative tone: "the two of you have created an ersatz homosexual marriage to satisfy your need for intimacy" (season 2, episode 15). In Fig. <ref type="figure">2</ref>, we chart the percentage of the dyad being predicted as colleagues or spouses to each other across the eight seasons in our dataset of choice. It is not surprising to see colleague being the most prominent relationship type, but it gradually decreases from 70.2% in season 1 to 46.4% in Season 8, while the "spouse_of" relationship type is predicted starting from season 2, peaking at 7.4% in Season 7. This indicates a predominant colleague relationship with minor fluctuations towards a more intimate or spousal-like dynamic. While talking like spouses when they are colleagues can be seen as an act of transgression, do those characters necessarily submit to the social institution of marriage in their form of co-existence, which the spouse category would entail? If we believe our stereotyping reader and assume that the spouse is an observable relational form between them, we ask: can there be subversion within subversion, and do Raj and Howard contest this normative relational form? For that we return to close, suspcious reading. One relevant episode takes place towards the end the series (season 12, episode 22): We find Raj at an airport, waiting for his flight to London, where he is expected to meet with his girlfriend, Anu. And we see Howard in discussion on this with his wife, Bernadette: bernadette. Go stop him. Get your best friend back. howard. You are my best friend! bernadette. We don't have time for this! Go! This exchange, along with the ensuing airport scene, stages a jubilant celebration of queer love. If, according to Halperin, "where the happy couple advances, deviance retreats" <ref type="bibr">[17, p. 397</ref>], thanks to Bernadette, we see this playing out in the opposite direction: the married couple steps aside, for queer love to flourish. Howard getting Raj back by no means signals the end of his marriage with Bernadette, but it surfaces the tension between traditional heteronormative relationships and non-normative desires: Howard's dynamic with Raj reveals an undercurrent of emotional intimacy and dependency that challenges the rigid boundaries of what is considered acceptable, normal male bonding within the confines of marriage. Bernadette, curiously, becomes a kind of referee, simultaneously reinforcing and undermining the normalcy of her marriage: She exposes the instability of the heteronormative relationship model, while also ensuring that it doesn't just break apart. As Oscar Wilde puts it in his putatively queer Earnest, "In married life, three is company and two is none. "</p><p>Now we return to Niles and Frasier Crane, to the question we raise at the beginning of this paper: If they are not just brothers, who are they to each other? It is not surprising that in Fig. <ref type="figure">3</ref>, the most salient relationship type for them is that of a sibling, but we see how they perform a few different ones over the course of the show. Towards the end, Nile appears to be just as much a parent and a colleague as a brother for Frasier. We see how they "invent" (in Foucault's word) a new relational form for themselves as they oscillate between the relationship types we Rory Gilmore and Lorelai Gilmore in Gilmore Girls already have names for, although others, like Alison and Harry from Introduction, might find them odd-and, indeed, queer-at times.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4.2.">Anti-normative characters and reparative reading</head><p>Today, queer encompasses a broad spectrum of identities, practices, and desires related to sex and gender. But this is not the case for queer theory at its infancy: writing around 1993, Eve Kosofsky Sedgwick notes how queer scholarship "can't be subsumed under gender and sexuality at all" <ref type="bibr">[36, p. 8]</ref>. In this section, we operate on this expanded notion of queer and turn to subversive modes of parenting. Recall this line from Section 2: "Go to your room, Lorelai" (season 1, episode 4) is the daughter talking like a mother. This is an instance of subversion where traditional parent-child boundaries is blurred, as Rory no longer conforms to the conventional roles. We do see two modes of parenting depicted in Gilmore Girls: the traditional model Lorelai and her mother, Emily Gilmore represents, and the new, subversive one between Rory and Lorelai. In Fig. <ref type="figure" target="#fig_2">4</ref>, we chart the interaction patterns by the percentage of the predicted relationship type between these two pairs of mother and daughter each season, focused on the top three relationship types. According to our model, we see Emily, compared to Lorelai, is more of a traditional mother throughout, with parent_of being the dominant relationship type. This is aligned with our impression with the characters: as Lorelai says, "Rory and I are best friends, Mom. We're best friends first, and mother and daughter second. And you and I are mother and daughter always" (season 2, episode 16). However, as we see in Fig. <ref type="figure" target="#fig_2">4</ref>, they start to talk more like sisters around each other in later seasons. One episode where the dynamic between Lorelai and Emily changes, as identified by our model is "Friday and Alright For Fighting" (season 6, episode 13), where Emily says jokingly to Lorelai, "I only wished I'd remembered to call her a cocktail waitress!" This is a surprise to Lorelai: "That's my mother's version of the c word!"</p><p>Another intriguing example of subversive parenting can be found between Sheldon Cooper and Penny in the Big Bang Theory. In this show, Sheldon works with Raj and Howard at Caltech, and Penny represents the "cute girl next door next to the nerds" <ref type="bibr" target="#b12">[13]</ref> archetype: the main male cast routinely succumbs to her feminine charm, especially in early seasons, with the sole exception of Sheldon. For this reason, Sheldon is regarded as asexual <ref type="bibr" target="#b28">[29]</ref> and infantilized <ref type="bibr" target="#b37">[38]</ref>. The latter dimension of the character is explored throughout the series through Penny, which is the main plot of "The Intimacy Acceleration" (season 8, episode 15), from which the epigraph of this section is taken. In this episode, the two engage in a farcical experiment to find out if Sheldon and Penny can fall in love. For Sheldon, his announced goal is not to win the girl, but to have her drive him to a "convention celebrating the life and work of Gary Gygax. " Their experiment commences with Penny saying, "I will buy you all the dragon T-shirts you want. " For most of this episode, like a Kleinian baby <ref type="bibr" target="#b19">[20]</ref>, Sheldon explores object relations and symbol formation in his phantasy-as-experiment: at the end of it, he compares himself to "human bowl of tomato soup", and Penny to his sister and his mother. Our model of stereotyping readers captures that, and more. The top relationship types for Sheldon and Penny do include sibling_of and child_of, and according to the model, one of the moments where Sheldon talks like Penny's child involves her trying to put him to sleep, though unsuccessfully: "No, I don't want to go to sleep, you can't make me" (season 8, episode 13). What's surprising here is Sheldon and Penny, much like Frasier and Niles, take up multiple relational roles over the eight seasons, and the most frequent of them is that of colleagues. If we revisit the series with a keen eye on when they speak like colleagues, we see how Penny can act like a counsel in Sheldon's social and everyday life: on how to empathize with others (season 2, episode 3), girl trouble at a bar where Penny works (season 4, episode 17), and so on. Penny's capacity for social mentoring reverses the normal dynamics between them, where Sheldon feels and acts like her superior. In terms of intertextuality, this can explain why Sheldon thinks of Penny as a sister: in the prequel to the series, Young Sheldon, we see his sister, Missy Cooper, possess extraordinary social intelligence.</p><p>Surprise is the operative word for this section, and this choice of words is intentional. Inspired by Melanie Klein's work, including her theories on object relations and phantasy, Sedgwick developed her concept of repatative reading: "[T]o read from a reparative position is to surrender the knowing, anxious paranoid determination that no horror, however apparently unthinkable, shall ever come to the reader as new; to a reparatively positioned reader, it can seem realistic and necessary to experience surprise" <ref type="bibr">[37, p. 146</ref>]. In being surprised, we see how computational methods can enable us to take the reparative position as we approach the text; we attempt to bring out the multiplicity of characters, like Emily and Penny, and begin to repair their agency. Indeed, they are much more than stereotypical mothers or stereotypical cute girls.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5.">Conclusion</head><p>A conversation has no necessary terminus.</p><p>-tyler bradway, "Queer Narrative Theory and the Relationality of Form" <ref type="bibr" target="#b2">[3]</ref> In this paper, we model a stereotyping reader who can infer the social relationship of pairs of characters (or dyads) in conversation. As an algorithmic measuring device, this model is queer in and of itself: the model tries to learn, for example, what a couple talks like, but we are ultimately interested in finding characters that are not a couple but talk like one, therein lies the queerness we wish to explore. As such, metrics like accuracy (as we argue in Section 3) are at best an instrumental means, and the model is interesting (as we see in the case studies) only when it predicts anything but the truth. As queer studies intersect with computational humanities, through our model, we wish to take initial steps to "dismantle the logics of success and failure" <ref type="bibr">[15, p. 2]</ref> to resist the "normal business in the academy" <ref type="bibr">[43, p. xxvi]</ref>, and in so doing, reflect on disciplinary practices in the relevant research communities to "build a better description" <ref type="bibr" target="#b27">[28]</ref> of queer culture.</p><p>One of the powerful images that Sedgwick invokes in her work, which has ultimately altered the landscape of queer theory permeably and forever, is that of a "theory kindergarten" <ref type="bibr">[37, p. 94</ref>]. <ref type="foot" target="#foot_8">9</ref> As we gesture towards a potential future for a queer cultural analytics <ref type="bibr" target="#b5">[6]</ref>, we look back on Sedgwick's theory kindergarten. Sedgwick was critical, but we might think of a theory kindergarten as a generative space of playful exploration, not bound by rigid epistemological frameworks or normative, institutional constraints. As such, theory kindergarten can be as inclusive, reflexive, and enabling: as we see in Touching Feeling, it invites us to "think otherwise" <ref type="bibr">[37, p. 11]</ref>: embrace surprise and creativity, allow for new modes of understanding and inquiry to emerge-perhaps including computation, without reducing the complexity and multiplicity of queer thought. If relational forms that emerge out of dialogic interactions showcase the "open mesh of possibilities" of queerness <ref type="bibr">[36, p. 7</ref>] that Sedgwick speaks of, interdisciplinary conversations, as Bradway, the source of the epigraph for this section, so eloquently intimates in the context of queer narrative theory, do not need an overdetermined terminus. We hope this work can motivate more researchers to study the representation of subversion in queer cultures and test the limits of both queer theory and computational methods. Back in the kindergarten: experiment and play, think and operationalize otherwise, and reimagine queerness vis-à-vis computation.<ref type="foot" target="#foot_9">10</ref> </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>A. Additional related work</head><p>This work builds on prior research in several disciplinary traditions.</p><p>Sociolinguistics and linguistic anthropology. The study of social relationships through language is central to the fields of sociolinguistics and linguistic anthropology. These disciplines provide tools for analyzing how language constructs and reflects social identities and power dynamics. For this work, Michael Silverstein's work <ref type="bibr" target="#b38">[39,</ref><ref type="bibr" target="#b39">40]</ref>, which explores the ways in which language ideologies and linguistic practices intersect, informs our approach to how social relationships are subverted and maintained through dialogue.</p><p>Dialogue understanding and natural language processing. The design and implementation of our computational methods are indebted to the field of natural language processing (NLP), especially work on dialogue understanding. Our main task is built on dialogue relation extraction techniques, which are employed to classify the relationships between characters based on their conversational exchanges <ref type="bibr" target="#b18">[19,</ref><ref type="bibr" target="#b21">22]</ref>. This work also builds upon narrative understanding and conversation modeling. This is exemplified by, among others, TVShowGuess <ref type="bibr" target="#b34">[35]</ref>, which leverages neural models to perform reading comprehension tasks on television shows. In the context of this work, understanding the hierarchical structure of dialogue is also crucial <ref type="bibr" target="#b41">[42,</ref><ref type="bibr" target="#b26">27,</ref><ref type="bibr" target="#b22">23]</ref>.</p><p>TV and film studies. Much of this work aims to understand representation on screen, which is the subject of TV and film studies <ref type="bibr" target="#b40">[41]</ref>, and in particular, analyzing dialogue within TV and film is essential for understanding how social relationships are portrayed and subverted. This work is inspired by linguistic analysis in this space <ref type="bibr" target="#b33">[34,</ref><ref type="bibr" target="#b0">1]</ref> and works such as Sarah Kozloff's <ref type="bibr" target="#b20">[21]</ref> which look into the mechanics of scripted dialogue and its impact on the audience's perception of characters and their relationships.</p><p>Gender and queer studies. The subversion of social relationships in TV often intersects with issues of gender and sexuality. Judith Butler's theories on gender performativity provide the essential framework for understanding how characters on TV subvert traditional gender roles and expectations <ref type="bibr" target="#b4">[5]</ref>. The positivist approaches in queer studies <ref type="bibr" target="#b15">[16,</ref><ref type="bibr" target="#b23">24]</ref> inform the theoretical foundation of this work as we articulate subversion in computational terms.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>B. Ranked relationship types</head><p>See Table <ref type="table" target="#tab_6">3</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>C. Dataset statistics</head><p>After the process described in Section 2, each pilot teleplay is now transformed into a sequence of scenes, which is comprised of speakers with canonical names and their lines, as well as,  </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>D.2. Sample OpenAI o1-mini prompt and response</head><p>See Fig. <ref type="figure" target="#fig_3">7</ref> for the prompt, and Fig. <ref type="figure">8</ref> for an example response from ChatGPT o1-mini. The API to o1-mini does not include access to the tokens used for chain-of-thought, so this example is included as a sanity check and see the thinking process of o1 models where the thought process is visible to us.</p><p>messages = [ { "role": "system", "content": f"""You are a helpful assistant designed to extract relationships between TV characters in a scene of a TV series. You will be provided with their dialogues, wrapped in &lt;dialogue&gt;. Speaker names start with `ENTITY`, and their lines are separated by `:`. You will read the dialogue and identify the relationship between a certain pair of entities, as requested in &lt;question&gt;. The relationship is directed, so the order of entities in each triplet matters. **Return only a JSON object** with the following property:</p><p>-"answer": one of the following {LABEL_OPTIONS}.</p><p>This property must always be present.  </p></div><figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_0"><head>Figure 1 :</head><label>1</label><figDesc>Figure 1: Example of an anonymized and post-processed scene (only first two lines represented here).</figDesc></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_1"><head>[</head><label></label><figDesc>O]ne of the things that "queer" can refer to: the open mesh of possibilities, gaps, overlaps, dissonances and resonances, lapses and excesses of meaning [ . . .].</figDesc></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_2"><head>Figure 4 :</head><label>4</label><figDesc>Figure 4: Heatmap representing the mother-daughter relationship arc between Rory and Lorelai Gilmore (above) and between Lorelai and Emily Gilmore (below) in Gilmore Girls in the first six seasons.</figDesc></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_3"><head>Figure 7 :</head><label>7</label><figDesc>Figure 7: Prompt for OpenAI o1-mini.</figDesc></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0"><head></head><label></label><figDesc></figDesc><graphic coords="21,105.95,265.20,383.38,204.22" type="bitmap" /></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" type="table" xml:id="tab_0"><head>Table 1</head><label>1</label><figDesc>Experimental results. All metrics are reported with 95% bootstrap confidence intervals.</figDesc><table><row><cell></cell><cell></cell><cell>Accuracy</cell></row><row><cell></cell><cell cols="2">anonymized test set unanonymized test set</cell></row><row><cell>Majority</cell><cell>0.265</cell><cell>0.265</cell></row><row><cell>supervised</cell><cell></cell><cell></cell></row><row><cell>Longformer</cell><cell>0.305 [0.294-0.315]</cell><cell>0.298 [0.287-0.309]</cell></row><row><cell cols="2">+ anonymized training set 0.293 [0.283-0.303]</cell><cell>0.306 [0.295-0.317]</cell></row><row><cell cols="2">+ scene attentive pooling 0.248 [0.238-0.258] + both 0.338 [0.327-0.349]</cell><cell>0.348 [0.337-0.359] 0.367 [0.356-0.378]</cell></row><row><cell>prompting</cell><cell></cell><cell></cell></row><row><cell>LLaMA 3-70b</cell><cell>0.197 [0.188-0.206]</cell><cell>0.243 [0.233-0.253]</cell></row><row><cell>+ one-shot</cell><cell>0.212 [0.202-0.221]</cell><cell>0.242 [0.232-0.252]</cell></row><row><cell>OpenAI o1-mini</cell><cell>0.181 [0.172-0.190]</cell><cell>0.241 [0.231-0251]</cell></row></table></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" type="table" xml:id="tab_1"><head>Table 2</head><label>2</label><figDesc>Most distinct words measured by log-odds ratio for key relationship types.</figDesc><table><row><cell cols="2">Relation type Most distinct words</cell></row><row><cell>parent_of</cell><cell>kids, son, mother, house, father, darling, honey, debate, worried, stay</cell></row><row><cell>sibling_of</cell><cell>sister, brother, whistledown, lady, cherry, lord, mom, dollars, hastings, must</cell></row><row><cell>spouse_of</cell><cell>honey, love, kids, marriage, baby, married, clean, treat, maple, care</cell></row><row><cell cols="2">colleague_of death, find, magic, heroin, found, real, ship, missing, library, case</cell></row><row><cell>friend_of</cell><cell>girls, fun, york, president, buddy, school, high, rally, jacket, vote</cell></row></table></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" type="table" xml:id="tab_3"><head></head><label></label><figDesc>Another heatmap representing the progression of relationship types between Niles and Frasier in Frasier over eleven seasons. Only the top five relationship types are presented here.</figDesc><table><row><cell></cell><cell></cell><cell></cell><cell></cell><cell cols="7">Niles Crane and Frasier Crane in Frasier</cell><cell></cell><cell></cell><cell></cell><cell></cell></row><row><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell>50</cell><cell></cell></row><row><cell>Relationship Type</cell><cell>sibling_of parent_of colleague_of child_of spouse_of</cell><cell>51.0 9.8 9.8 13.7 15.7</cell><cell>42.7 7.3 22.0 14.6 9.8</cell><cell>34.2 5.3 22.4 23.7 10.5</cell><cell>38.8 19.4 17.9 6.0 13.4</cell><cell>41.7 8.3 18.1 13.9 13.9</cell><cell>37.4 6.6 17.6 17.6 9.9</cell><cell>40.8 2.6 26.3 19.7 6.6</cell><cell>40.0 7.1 18.6 20.0 10.0</cell><cell>39.3 1.6 26.2 18.0 9.8</cell><cell>30.5 10.2 16.9 25.4 10.2</cell><cell>26.6 11.4 21.5 24.1 11.4</cell><cell>10 20 30 40</cell><cell>Percentage</cell></row><row><cell></cell><cell></cell><cell>1</cell><cell>2</cell><cell>3</cell><cell>4</cell><cell>5</cell><cell>6</cell><cell>7</cell><cell>8</cell><cell>9</cell><cell>10</cell><cell>11</cell><cell></cell><cell></cell></row><row><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell>Season</cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell></row><row><cell cols="2">Figure 3:</cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell></row></table></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" type="table" xml:id="tab_5"><head></head><label></label><figDesc>Another heatmap representing the progression of relationship types between Sheldon Cooper and Penny over eight seasons in the Big Bang Theory. Only the top five relationship types are presented here.</figDesc><table><row><cell></cell><cell></cell><cell></cell><cell cols="6">Sheldon Cooper and Penny in The Big Bang Theory</cell><cell></cell><cell></cell><cell></cell></row><row><cell>Relationship Type</cell><cell>colleague_of sibling_of child_of friend_of parent_of</cell><cell>39.6 4.2 31.2 10.4 10.4</cell><cell>38.6 0.0 29.8 5.3 12.3</cell><cell>42.2 6.2 20.3 20.3 9.4</cell><cell>30.8 7.7 38.5 7.7 15.4</cell><cell>45.7 2.2 6.5 17.4 23.9</cell><cell>39.0 2.4 24.4 22.0 7.3</cell><cell>30.8 12.3 21.5 13.8 15.4</cell><cell>34.5 10.9 10.9 21.8 14.5</cell><cell>10 40 20 30</cell><cell>Percentage</cell></row><row><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell>0</cell><cell></cell></row><row><cell></cell><cell></cell><cell>1</cell><cell>2</cell><cell>3</cell><cell>4</cell><cell>5</cell><cell>6</cell><cell>7</cell><cell>8</cell><cell></cell><cell></cell></row><row><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell cols="2">Season</cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell></row><row><cell cols="2">Figure 5:</cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell><cell></cell></row></table></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" type="table" xml:id="tab_6"><head>Table 3</head><label>3</label><figDesc>Ranked relationship types.where applicable, a list of relationship tuples for speakers in the scene. The statistics of title and token counts for this dataset are reported in Table4.11   </figDesc><table><row><cell>Rank Relationship Type</cell><cell>Rank Relationship Type</cell></row><row><cell>1 grandparent_of</cell><cell>15 enemy_of</cell></row><row><cell>2 grandchild_of</cell><cell>16 colleague_of</cell></row><row><cell>3 parent_of</cell><cell>17 classmate_of</cell></row><row><cell>4 child-in-law_of</cell><cell>18 roommate_of</cell></row><row><cell>5 child_of</cell><cell>19 neighbor_of</cell></row><row><cell>6 sibling-in-law_of</cell><cell>20 teacher_of</cell></row><row><cell>7 sibling_of</cell><cell>21 student_of</cell></row><row><cell>8 relative_of</cell><cell>22 boss_of</cell></row><row><cell>9 ex-spouse_of</cell><cell>23 subordinate_of</cell></row><row><cell>10 ex-boy/girlfriend_of</cell><cell>24 trainer_of</cell></row><row><cell>11 ex-love_interest_of</cell><cell>25 trainee_of</cell></row><row><cell>12 spouse_of</cell><cell>26 acquaintance_of</cell></row><row><cell>13 boy/girlfriend_of</cell><cell>27 friend_of</cell></row><row><cell>14 love_interest_of</cell><cell>28 other</cell></row></table></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" type="table" xml:id="tab_7"><head>Table 4</head><label>4</label><figDesc>Summary of train, development, and test sets.</figDesc><table><row><cell></cell><cell cols="2">training development</cell><cell>test</cell></row><row><cell># titles</cell><cell>552</cell><cell>115</cell><cell>120</cell></row><row><cell># scenes</cell><cell>36,320</cell><cell cols="2">7,078 6,965</cell></row><row><cell># number of dyads with labels</cell><cell>9,223</cell><cell cols="2">4,978 7,176</cell></row><row><cell># avg tokens per</cell><cell></cell><cell></cell><cell></cell></row><row><cell>scene</cell><cell>192</cell><cell>194</cell><cell>201</cell></row><row><cell>utterance</cell><cell>95</cell><cell>96</cell><cell>103</cell></row><row><cell>D</cell><cell></cell><cell></cell><cell></cell></row></table></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" type="table" xml:id="tab_8"><head>. Sample prompts D.1. LLaMA 3 prompt</head><label></label><figDesc></figDesc><table><row><cell>See Fig. 6.</cell></row></table></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" type="table" xml:id="tab_9"><head></head><label></label><figDesc>Do not include any additional text or explanations outside the JSON object. &lt;dialogue&gt;SCENE: INT. WEINBERG APARTMENT -MIDGE'S OLD BEDROOM -MOMENTS LATER ENTITY 24: That forehead is not improving. [ENTITY 24 lifts ESTHER out and lays her down on the bed.] ENTITY 2: What? Are you sure? ENTITY 24: It's getting bigger. The whole face will be out of proportion. ENTITY 2: But look at her nose. It's elongating now, see? ENTITY 24: The nose is not the problem. The nose you can fix. But this gigantic forehead ... ENTITY 2: Well, there's always bangs. ENTITY 24: I'm just afraid she's not a very pretty girl. ENTITY 2: Mama, she's a baby. ENTITY 24: I just want her to be happy. It's easier to be happy when you're pretty. ENTITY 24: You're right. Bangs will help.&lt;/dialogue&gt; &lt;question&gt; ENTITY 2 is what of ENTITY 24?&lt;/question&gt;""" } ]</figDesc><table /></figure>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="1" xml:id="foot_0">See Appendix A for more related work.</note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="2" xml:id="foot_1">https://sites.google.com/site/tvwriting/.</note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="3" xml:id="foot_2">https://github.com/tesseract-ocr/tesseract.</note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="4" xml:id="foot_3">https://enterprise.wikimedia.com/products/.</note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="5" xml:id="foot_4">https://www.themoviedb.org/.</note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="6" xml:id="foot_5">https://huggingface.co/meta-llama/Meta-Llama-3-70B.</note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="7" xml:id="foot_6">https://openai.com/index/openai-o1-mini-advancing-cost-efficient-reasoning/.</note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="8" xml:id="foot_7">For supervised models, we use a learning rate of 5 × 10 −5 with 100 warm-up steps and no weight decay. All inputs are padded or truncated to 4, 096 tokens. All models are trained on four L40S GPUs. If the scene is longer than 4, 096 tokens, it is truncated before being inserted into the prompt (only four scenes were truncated). We use Outline to constrain the output space to be one of the relationship types: https://github.com/outlines-dev/outlines.</note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="9" xml:id="foot_8">See also<ref type="bibr" target="#b3">[4]</ref>,<ref type="bibr" target="#b24">[25]</ref>.</note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="10" xml:id="foot_9">Code to support this work can be found at: https://github.com/kentchang/subversive-characters-chr2024.</note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="11" xml:id="foot_10">Tokens are counted with the tiktoken implementation of BPE tokenizer o200k_base: https://github.com/openai/ tiktoken/tree/main.</note>
		</body>
		<back>

			<div type="acknowledgement">
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Acknowledgments</head><p>We thank the anonymous reviewers for their helpful comments. We are grateful for feedback provided by Richard So and Mackenzie Cramer at different stages of this project. The research reported in this article was supported by funding from the National Science Foundation (IIS-1942591), the National Endowment for the Humanities (HAA-271654-20), and a UC Berkeley Paul Fasana LGBTQ Studies Fellowship to K. C.</p></div>
			</div>

			<div type="annex">
<div xmlns="http://www.tei-c.org/ns/1.0"><head>messages = [</head><p>{ "role": "system", "content": f"""Your goal is to extract relationships between TV characters in a scene of a TV series. You will be provided with their dialogues, wrapped in &lt;dialogue&gt;. Speaker names start with `ENTITY`, and their lines are separated by `:`. You will read the dialogue and identify the relationship between a certain pair of entities, as requested in &lt;question&gt;. The relationship is directed, so the order of entities in each triplet matters.</p><p>Here are the possible relationship types: {LABEL_OPTIONS}. Here is an example:""" }, { "role": "user", "content": f"""&lt;dialogue&gt;SCENE: ENTITY 24: I'm just afraid she's not a very pretty girl. ENTITY 2: Mama, she's a baby. ENTITY 24: I just want her to be happy. It's easier to be happy when you're pretty. ENTITY 24: You're right. Bangs will help.&lt;/dialogue&gt; &lt;question&gt; ENTITY 2 is what of ENTITY 24? ANSWER with ONLY {LABEL_OPTIONS} &lt;/question&gt;""" }, { "role": "assistant", "content": "child_of" }, { "role": "system", "content": f"""Great job! You have successfully identified the relationship between the two entities. Now, let's move on to the next one.""" }, { "role": "user", "content": f"""&lt;dialogue&gt;{scene_string}&lt;/dialogue&gt; &lt;question&gt; {head} is what of {tail}? ANSWER with ONLY: {LABEL_OPTIONS}.&lt;/question&gt;""" }, ]  </p></div>			</div>
			<div type="references">

				<listBibl>

<biblStruct xml:id="b0">
	<monogr>
		<title level="m" type="main">Language and Characterisation in Television Series: A Corpus-informed Approach to the Construction of Social Identity in the Media</title>
		<author>
			<persName><forename type="first">M</forename><surname>Bednarek</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2023">2023</date>
			<publisher>John Benjamins Publishing Company</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b1">
	<monogr>
		<title level="m" type="main">Longformer: The Long-Document Transformer</title>
		<author>
			<persName><forename type="first">I</forename><surname>Beltagy</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">E</forename><surname>Peters</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Cohan</surname></persName>
		</author>
		<idno type="arXiv">arXiv:2004.05150</idno>
		<imprint>
			<date type="published" when="2020">2020</date>
		</imprint>
	</monogr>
	<note>cs.CL</note>
</biblStruct>

<biblStruct xml:id="b2">
	<analytic>
		<title level="a" type="main">Queer Narrative Theory and the Relationality of Form</title>
		<author>
			<persName><forename type="first">T</forename><surname>Bradway</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Publications of the Modern Language Association of America</title>
		<imprint>
			<biblScope unit="volume">136</biblScope>
			<biblScope unit="issue">5</biblScope>
			<biblScope unit="page" from="711" to="727" />
			<date type="published" when="2021">2021</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b3">
	<monogr>
		<title level="m" type="main">Theory Kindergarten</title>
		<author>
			<persName><forename type="first">D</forename><forename type="middle">P</forename><surname>Britzman</surname></persName>
		</author>
		<editor>S. M. Barber and D. L. Clark</editor>
		<imprint>
			<date type="published" when="2013">2013</date>
			<publisher>Routledge</publisher>
			<biblScope unit="page" from="121" to="142" />
			<pubPlace>London, England</pubPlace>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b4">
	<monogr>
		<title level="m" type="main">Gender Trouble: Feminism and the Subversion of Identity</title>
		<author>
			<persName><forename type="first">J</forename><surname>Butler</surname></persName>
		</author>
		<imprint>
			<date type="published" when="1990">1990</date>
			<publisher>Routledge</publisher>
			<pubPlace>Ny</pubPlace>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b5">
	<analytic>
		<title level="a" type="main">The Queer Gap in Cultural Analytics</title>
		<author>
			<persName><forename type="first">K</forename><forename type="middle">K</forename><surname>Chang</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Debates in the Digital Humanities</title>
				<editor>
			<persName><forename type="first">M</forename><forename type="middle">K G</forename><surname>Lauren</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">F</forename><surname>Klein</surname></persName>
		</editor>
		<imprint>
			<publisher>U of Minnesota Press</publisher>
			<date type="published" when="2023">2023. 2023</date>
			<biblScope unit="page" from="105" to="119" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b6">
	<analytic>
		<title level="a" type="main">SummScreen: A Dataset for Abstractive Screenplay Summarization</title>
		<author>
			<persName><forename type="first">M</forename><surname>Chen</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Z</forename><surname>Chu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Wiseman</surname></persName>
		</author>
		<author>
			<persName><forename type="first">K</forename><surname>Gimpel</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics</title>
				<meeting>the 60th Annual Meeting of the Association for Computational Linguistics<address><addrLine>Dublin, Ireland</addrLine></address></meeting>
		<imprint>
			<date type="published" when="2022">2022</date>
			<biblScope unit="volume">1</biblScope>
			<biblScope unit="page" from="8602" to="8615" />
		</imprint>
	</monogr>
	<note>Association for Computational Linguistics</note>
</biblStruct>

<biblStruct xml:id="b7">
	<monogr>
		<title level="m" type="main">Something for the Boys: Musical Theater and Gay Culture</title>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">M</forename><surname>Clum</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2001">2001</date>
			<publisher>St. Martin&apos;s Press</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b8">
	<analytic>
		<title level="a" type="main">A CoefÏcient of Agreement for Nominal Scales</title>
		<author>
			<persName><forename type="first">J</forename><surname>Cohen</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Educational and psychological measurement</title>
		<imprint>
			<biblScope unit="volume">20</biblScope>
			<biblScope unit="issue">1</biblScope>
			<biblScope unit="page" from="37" to="46" />
			<date type="published" when="1960">1960</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b9">
	<monogr>
		<title level="m" type="main">Language and Characterisation: People in Plays and Other Texts</title>
		<author>
			<persName><forename type="first">J</forename><surname>Culpeper</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2001">2001</date>
			<publisher>Longman</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b10">
	<analytic>
		<title level="a" type="main">In Praise of Counter-Conduct</title>
		<author>
			<persName><forename type="first">A</forename><forename type="middle">I</forename><surname>Davidson</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">History of the human sciences</title>
		<imprint>
			<biblScope unit="volume">24</biblScope>
			<biblScope unit="issue">4</biblScope>
			<biblScope unit="page" from="25" to="41" />
			<date type="published" when="2011">2011</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b11">
	<analytic>
		<title level="a" type="main">Techniques for Interpretable Machine Learning</title>
		<author>
			<persName><forename type="first">M</forename><surname>Du</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Liu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">X</forename><surname>Hu</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Communications of the ACM</title>
		<imprint>
			<biblScope unit="volume">63</biblScope>
			<biblScope unit="issue">1</biblScope>
			<biblScope unit="page" from="68" to="77" />
			<date type="published" when="2019">2019</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b12">
	<monogr>
		<author>
			<persName><forename type="first">A</forename><surname>Dumaraog</surname></persName>
		</author>
		<ptr target="https://screenrant.com/big-bang-theory-penny-sexualized-kaley-cuoco-response/" />
		<title level="m">Big Bang Theory: Kaley Cuoco Explains How Penny Became Less Sexualized</title>
				<imprint/>
	</monogr>
</biblStruct>

<biblStruct xml:id="b13">
	<analytic>
		<title level="a" type="main">Friendship as a Way of Life</title>
		<author>
			<persName><forename type="first">M</forename><surname>Foucault</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Ethics: Subjectivity and Truth (Essential Works of Foucault</title>
				<editor>
			<persName><forename type="first">P</forename><surname>Rainbow</surname></persName>
		</editor>
		<meeting><address><addrLine>NY</addrLine></address></meeting>
		<imprint>
			<publisher>The New Press</publisher>
			<date type="published" when="1998">1998</date>
			<biblScope unit="volume">1</biblScope>
			<biblScope unit="page" from="135" to="140" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b14">
	<monogr>
		<author>
			<persName><forename type="first">J</forename><surname>Halberstam</surname></persName>
		</author>
		<title level="m">The Queer Art of Failure</title>
				<imprint>
			<publisher>Duke University Press</publisher>
			<date type="published" when="2011">2011</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b15">
	<monogr>
		<title level="m" type="main">How To Be Gay</title>
		<author>
			<persName><forename type="first">D</forename><forename type="middle">M</forename><surname>Halperin</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2012">2012</date>
			<publisher>Harvard University Press</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b16">
	<analytic>
		<title level="a" type="main">Queer Love</title>
		<author>
			<persName><forename type="first">D</forename><forename type="middle">M</forename><surname>Halperin</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Critical inquiry</title>
		<imprint>
			<biblScope unit="volume">45</biblScope>
			<biblScope unit="issue">2</biblScope>
			<biblScope unit="page" from="396" to="419" />
			<date type="published" when="2019">2019</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b17">
	<monogr>
		<author>
			<persName><forename type="first">J</forename></persName>
		</author>
		<author>
			<persName><forename type="first">Jack</forename><surname>Halberstam</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Halberstam</surname></persName>
		</author>
		<title level="m">In a Queer Time and Place: Transgender Bodies, Subcultural Lives</title>
				<imprint>
			<publisher>NYU Press</publisher>
			<date type="published" when="2005">2005</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b18">
	<analytic>
		<title level="a" type="main">The CRECIL Corpus: A New Dataset for Extraction of Relations between Characters in Chinese Multi-Party Dialogues</title>
		<author>
			<persName><forename type="first">Y</forename><surname>Jiang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>Xu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>Zhan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">W</forename><surname>He</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>Wang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Z</forename><surname>Xi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Wang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">X</forename><surname>Li</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>Li</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>Yu</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the Thirteenth Language Resources and Evaluation Conference</title>
				<editor>
			<persName><forename type="first">N</forename><surname>Calzolari</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">F</forename><surname>Béchet</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">P</forename><surname>Blache</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">K</forename><surname>Choukri</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">C</forename><surname>Cieri</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">T</forename><surname>Declerck</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">S</forename><surname>Goggi</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">H</forename><surname>Isahara</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">B</forename><surname>Maegaard</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">J</forename><surname>Mariani</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">H</forename><surname>Mazo</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">J</forename><surname>Odijk</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">S</forename><surname>Piperidis</surname></persName>
		</editor>
		<meeting>the Thirteenth Language Resources and Evaluation Conference<address><addrLine>Marseille, France</addrLine></address></meeting>
		<imprint>
			<publisher>European Language Resources Association</publisher>
			<date type="published" when="2022">2022</date>
			<biblScope unit="page" from="2337" to="2344" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b19">
	<monogr>
		<author>
			<persName><forename type="first">M</forename><surname>Klein</surname></persName>
		</author>
		<author>
			<persName><surname>Love</surname></persName>
		</author>
		<title level="m">Guilt, and Reparation &amp; Other Works, 1921-1945</title>
				<meeting><address><addrLine>New York, NY</addrLine></address></meeting>
		<imprint>
			<publisher>Delacorte Press</publisher>
			<date type="published" when="1975">1975</date>
		</imprint>
	</monogr>
	<note>Her the Writings of Melanie Klein</note>
</biblStruct>

<biblStruct xml:id="b20">
	<monogr>
		<title level="m" type="main">Overhearing Film Dialogue</title>
		<author>
			<persName><forename type="first">S</forename><surname>Kozloff</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2000">2000</date>
			<publisher>University of California Press</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b21">
	<monogr>
		<title level="m" type="main">Empirical Analysis of Dialogue Relation Extraction with Large Language Models</title>
		<author>
			<persName><forename type="first">G</forename><surname>Li</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Z</forename><surname>Xu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Z</forename><surname>Shang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Liu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">K</forename><surname>Ji</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>Guo</surname></persName>
		</author>
		<idno type="arXiv">arXiv:2404.17802</idno>
		<imprint>
			<date type="published" when="2024">2024</date>
		</imprint>
	</monogr>
	<note>cs.CL</note>
</biblStruct>

<biblStruct xml:id="b22">
	<analytic>
		<title level="a" type="main">Hierarchical Dialogue Understanding with Special Tokens and Turn-Level Attention</title>
		<author>
			<persName><forename type="first">X</forename><surname>Liu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Zhang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Zhang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">F</forename><surname>Xue</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>You</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Tiny Papers ICLR</title>
				<imprint>
			<date type="published" when="2023">2023</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b23">
	<analytic>
		<title level="a" type="main">Doing Being Deviant: Deviance Studies, Description, and the Queer Ordinary</title>
		<author>
			<persName><forename type="first">H</forename><surname>Love</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Differences</title>
		<imprint>
			<biblScope unit="volume">26</biblScope>
			<biblScope unit="issue">1</biblScope>
			<biblScope unit="page" from="74" to="95" />
			<date type="published" when="2015">2015</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b24">
	<analytic>
		<title level="a" type="main">Truth and Consequences: On Paranoid Reading and Reparative Reading</title>
		<author>
			<persName><forename type="first">H</forename><surname>Love</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Criticism</title>
		<imprint>
			<biblScope unit="volume">52</biblScope>
			<biblScope unit="issue">2</biblScope>
			<biblScope unit="page" from="235" to="241" />
			<date type="published" when="2010">2010</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b25">
	<monogr>
		<title level="m" type="main">Underdogs</title>
		<author>
			<persName><forename type="first">H</forename><surname>Love</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2021">2021</date>
			<publisher>University of Chicago Press</publisher>
			<pubPlace>Chicago, IL</pubPlace>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b26">
	<analytic>
		<title level="a" type="main">Unsupervised Learning of Hierarchical Conversation Structure</title>
		<author>
			<persName><forename type="first">B.-R</forename><surname>Lu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Y</forename><surname>Hu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Cheng</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><forename type="middle">A</forename><surname>Smith</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Ostendorf</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Findings of the Association for Computational Linguistics: EMNLP 2022</title>
				<editor>
			<persName><forename type="first">Y</forename><surname>Goldberg</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">Z</forename><surname>Kozareva</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">Y</forename><surname>Zhang</surname></persName>
		</editor>
		<meeting><address><addrLine>Abu Dhabi, United Arab Emirates</addrLine></address></meeting>
		<imprint>
			<date type="published" when="2022">2022</date>
			<biblScope unit="page" from="5657" to="5670" />
		</imprint>
	</monogr>
	<note>Association for Computational Linguistics</note>
</biblStruct>

<biblStruct xml:id="b27">
	<analytic>
		<title level="a" type="main">Building a Better Description</title>
		<author>
			<persName><forename type="first">S</forename><surname>Marcus</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><surname>Love</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Best</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Representations</title>
		<imprint>
			<biblScope unit="volume">135</biblScope>
			<biblScope unit="issue">1</biblScope>
			<biblScope unit="page" from="1" to="21" />
			<date type="published" when="2016">2016</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b28">
	<analytic>
		<title level="a" type="main">Disciplining Heterosexuality: Interrogating the Heterosexual Ideal</title>
		<author>
			<persName><forename type="first">A</forename><surname>Mcclanahan</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">The Sexy Science of The Big Bang Theory: Essays on Gender in the Series</title>
				<editor>
			<persName><forename type="first">N</forename><surname>Farghaly</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">E</forename><surname>Leone</surname></persName>
		</editor>
		<editor>
			<persName><surname>Mcfarland</surname></persName>
		</editor>
		<imprint>
			<date type="published" when="2015">2015</date>
			<biblScope unit="page" from="88" to="110" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b29">
	<analytic>
		<title level="a" type="main">Fightin&apos; Words: Lexical Feature Selection and Evaluation for Identifying the Content of Political Conflict</title>
		<author>
			<persName><forename type="first">B</forename><forename type="middle">L</forename><surname>Monroe</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">P</forename><surname>Colaresi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">K</forename><forename type="middle">M</forename><surname>Quinn</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Political analysis: an annual publication of the Methodology Section of the American Political Science Association</title>
		<imprint>
			<biblScope unit="volume">16</biblScope>
			<biblScope unit="issue">4</biblScope>
			<biblScope unit="page" from="372" to="403" />
			<date type="published" when="2017">2017</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b30">
	<monogr>
		<title level="m" type="main">The Queer Fantasies of the American Family Sitcom</title>
		<author>
			<persName><forename type="first">T</forename><surname>Pugh</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2018">2018</date>
			<publisher>Rutgers University Press</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b31">
	<analytic>
		<title level="a" type="main">The Big Bang Theory: The Definitive</title>
		<author>
			<persName><forename type="first">J</forename><surname>Radloff</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Inside Story of the Epic Hit Series</title>
				<meeting><address><addrLine>London, England</addrLine></address></meeting>
		<imprint>
			<publisher>Grand Central Publishing</publisher>
			<date type="published" when="2022">2022</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b32">
	<analytic>
		<title level="a" type="main">Popular Culture and Queer Representation</title>
		<author>
			<persName><forename type="first">D</forename><surname>Raymond</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">A Critical Perspective</title>
				<imprint>
			<date type="published" when="2003">2003</date>
			<biblScope unit="page" from="98" to="110" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b33">
	<monogr>
		<title level="m" type="main">Television Dramatic Dialogue: A Sociolinguistic Study</title>
		<author>
			<persName><forename type="first">K</forename><surname>Richardson</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2010">2010</date>
			<publisher>Oxford University Press</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b34">
	<analytic>
		<title level="a" type="main">TVShowGuess: Character Comprehension in Stories as Speaker Guessing</title>
		<author>
			<persName><forename type="first">Y</forename><surname>Sang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">X</forename><surname>Mou</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Yu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Yao</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Li</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Stanton</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies</title>
				<editor>
			<persName><forename type="first">M</forename><surname>Carpuat</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">M.-C</forename><surname>De Marneffe</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">I</forename><forename type="middle">V</forename><surname>Meza Ruiz</surname></persName>
		</editor>
		<meeting>the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies<address><addrLine>Seattle, United States</addrLine></address></meeting>
		<imprint>
			<date type="published" when="2022">2022</date>
			<biblScope unit="page" from="4267" to="4287" />
		</imprint>
	</monogr>
	<note>Association for Computational Linguistics</note>
</biblStruct>

<biblStruct xml:id="b35">
	<monogr>
		<author>
			<persName><forename type="first">E</forename><forename type="middle">K</forename><surname>Sedgwick</surname></persName>
		</author>
		<title level="m">Tendencies</title>
				<imprint>
			<publisher>Duke University Press</publisher>
			<date type="published" when="1993">1993</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b36">
	<monogr>
		<title level="m" type="main">Touching Feeling</title>
		<author>
			<persName><forename type="first">E</forename><forename type="middle">K</forename><surname>Sedgwick</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2003">2003</date>
			<publisher>Duke University Press</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b37">
	<analytic>
		<title level="a" type="main">The Adolescent Quest</title>
		<author>
			<persName><forename type="first">J</forename><surname>Shaw</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">The Sexy Science of The Big Bang Theory: Essays on Gender in the Series</title>
				<editor>
			<persName><forename type="first">N</forename><surname>Farghaly</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">E</forename><surname>Leone</surname></persName>
		</editor>
		<editor>
			<persName><surname>Mcfarland</surname></persName>
		</editor>
		<imprint>
			<date type="published" when="2015">2015</date>
			<biblScope unit="page" from="72" to="87" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b38">
	<analytic>
		<title level="a" type="main">Cultural&quot; Concepts and the Language-Culture Nexus</title>
		<author>
			<persName><forename type="first">M</forename><surname>Silverstein</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Current anthropology</title>
		<imprint>
			<biblScope unit="volume">45</biblScope>
			<biblScope unit="issue">5</biblScope>
			<biblScope unit="page" from="621" to="652" />
			<date type="published" when="2004">2004</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b39">
	<monogr>
		<title level="m" type="main">Language in Culture: Lectures on the Social Semiotics of Language</title>
		<author>
			<persName><forename type="first">M</forename><surname>Silverstein</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2022">2022</date>
			<publisher>Cambridge University Press</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b40">
	<monogr>
		<title level="m" type="main">Gilmore Girls: A Cultural History</title>
		<author>
			<persName><forename type="first">L</forename><forename type="middle">C</forename><surname>Stache</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><forename type="middle">D</forename><surname>Davidson</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2019">2019</date>
			<publisher>Rowman &amp; Littlefield</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b41">
	<analytic>
		<title level="a" type="main">A Domain Based Approach to Social Relation Recognition</title>
		<author>
			<persName><forename type="first">Q</forename><surname>Sun</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><surname>Schiele</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Fritz</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)</title>
				<meeting><address><addrLine>, HI</addrLine></address></meeting>
		<imprint>
			<publisher>Ieee</publisher>
			<date type="published" when="2017">2017</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b42">
	<analytic>
		<title level="a" type="main">Fear of a Queer Planet</title>
		<author>
			<persName><forename type="first">M</forename><surname>Warner</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Studies in Classical Philology</title>
				<meeting><address><addrLine>Minneapolis, MN</addrLine></address></meeting>
		<imprint>
			<publisher>University of Minnesota Press</publisher>
			<date type="published" when="1993">1993</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b43">
	<analytic>
		<title level="a" type="main">Chain-of-Thought Prompting Elicits Reasoning in Large Language Models</title>
		<author>
			<persName><forename type="first">J</forename><surname>Wei</surname></persName>
		</author>
		<author>
			<persName><forename type="first">X</forename><surname>Wang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Schuurmans</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Bosma</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><surname>Ichter</surname></persName>
		</author>
		<author>
			<persName><forename type="first">F</forename><surname>Xia</surname></persName>
		</author>
		<author>
			<persName><forename type="first">E</forename><surname>Chi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">Q</forename><forename type="middle">V</forename><surname>Le</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Zhou</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Advances in Neural Information Processing Systems</title>
				<editor>
			<persName><forename type="first">S</forename><surname>Koyejo</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">S</forename><surname>Mohamed</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">A</forename><surname>Agarwal</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">D</forename><surname>Belgrave</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">K</forename><surname>Cho</surname></persName>
		</editor>
		<imprint>
			<publisher>Curran Associates, Inc</publisher>
			<date type="published" when="2022">2022</date>
			<biblScope unit="volume">35</biblScope>
			<biblScope unit="page" from="24824" to="24837" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b44">
	<analytic>
		<title level="a" type="main">Dialogue-Based Relation Extraction</title>
		<author>
			<persName><forename type="first">D</forename><surname>Yu</surname></persName>
		</author>
		<author>
			<persName><forename type="first">K</forename><surname>Sun</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><surname>Cardie</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Yu</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics</title>
				<editor>
			<persName><forename type="first">D</forename><surname>Jurafsky</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">J</forename><surname>Chai</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">N</forename><surname>Schluter</surname></persName>
		</editor>
		<editor>
			<persName><forename type="first">J</forename><surname>Tetreault</surname></persName>
		</editor>
		<meeting>the 58th Annual Meeting of the Association for Computational Linguistics</meeting>
		<imprint>
			<date type="published" when="2020">2020</date>
			<biblScope unit="page" from="4927" to="4940" />
		</imprint>
	</monogr>
	<note>Association for Computational Linguistics</note>
</biblStruct>

				</listBibl>
			</div>
		</back>
	</text>
</TEI>
