<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>Ital-IA</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Unmasking Climate Change Impacts: Traversing Storms, Cold, Heat and Fire in Corporate Earnings Calls through a Hybrid Taxonomy and GPT-based Methodology</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Michele Cimino</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Annalisa Molino</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Maria Paola Priola</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Lorenzo Prosperi</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Lea Zicchino</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Dept. of Economics, University of Cagliari</institution>
          ,
          <addr-line>Cagliari</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Dept. of Financial Markets and Intermediaries Analysis</institution>
          ,
          <addr-line>Prometeia. Bologna</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Johns Hopkins University SAIS Europe.</institution>
          <addr-line>Bologna</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2024</year>
      </pub-date>
      <volume>4</volume>
      <fpage>29</fpage>
      <lpage>30</lpage>
      <abstract>
        <p>Understanding how companies are managing the risks and opportunities of climate change is critical for investors, financial institutions and analysts. Corporate earnings calls are a valuable source of information and fill gaps in climate change data. We use transcripts of these calls in Europe and the US over the past two decades to assess how companies are afected by four climate hazards: storms, cold weather, heat waves and wildfires. Our approach involves several steps. First, we develop a classification system (taxonomy) for each climate hazard by reviewing scientific reports. This taxonomy is then expanded by identifying semantically similar words using a Word2Vec model. We then identify sentences in the transcripts that contain these climate-related keywords. Using generative AI techniques, specifically GPT 3.5, we analyse these sentences to gain insights into how individual companies are exposed to climate change risks. We distinguish between negative impacts (risks) and potential benefits (opportunities) for their business activities. We also identified three main channels through which climate risks afect diferent companies: 1) disruptions to the company's supply chain, 2) impacts on the company's demand, and 3) direct damage to the company's assets and operations. Our findings show that exposure to physical climate risk varies widely across sectors in terms of the types of events and the channels through which they afect firms. This innovative dataset has the potential to provide investors and analysts with accurate information on past climate risk exposures, thereby enhancing their understanding of how climate change may impact economic activity and corporate decision-making.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Climate change</kwd>
        <kwd>Physical risks</kwd>
        <kwd>Text Analysis</kwd>
        <kwd>Pattern Matching</kwd>
        <kwd>Conference calls</kwd>
        <kwd>Word Embedding</kwd>
        <kwd>C58 Financial Econometrics</kwd>
        <kwd>C63 Computational Techniques</kwd>
        <kwd>G32 Financial Risk and Risk Management</kwd>
        <kwd>Q54 Climate</kwd>
        <kwd>Natural Disasters and Their Management</kwd>
        <kwd>Global Warming CEUR-WS</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>amount of data that needs to be properly analyzed. This
task in particular, when applied to the diversified
naIn an era of increasing environmental uncertainty, un- ture of large corporations spanning various geographical
derstanding the exposure of firms to physical
climaterelated financial risks has become imperative. Indeed,
the increasing likelihood of acute hazards such as floods,
storms, wildfires, heat waves, and cold waves presents a
formidable challenge to corporations worldwide. These
risks pose big challenges for companies, not just in terms
of how they might afect the value of buildings and
infrastructure or generate business interruption, but also
because they can disrupt supply chains and afect the
demand for products. Capturing the full spectrum of
physical climate-related financial risks demands a large
regions, increases the complexity of assessing their
vulnerability to climate-related hazards.</p>
      <p>Our objective is to utilize NLP techniques to extract
information from earnings call transcripts, thereby
discerning firm-level indicators of physical risk exposure.</p>
      <p>In particular, the indicators that we extract ofer
information on firms’ exposure in 3 diferent dimensions. Firstly,
the exposure metrics are hazard-specific; the hazards
considered in this paper are the following: wildfires, floods,
hurricanes, cold waves, heat waves, and droughts.
Secondly, we aim to diferentiate between the adverse efects
of these hazards on business activity, identifying whether
they pose risks or present opportunities for firms. Thirdly,
we seek to delineate the channels through which these
hazards exert their influence, distinguishing between
direct impacts, such as the destruction of firms’ physical
infrastructure, and indirect efects, such as disruptions
to supply chains or reductions in consumer demand.</p>
      <p>Our paper mainly contributes to the strands of
finan</p>
      <p>
        3. Extracting Physical Risk Metrics
3.1. Taxonomy definition
licly listed companies catalogued in the Refinitiv Eikon
database. Our dataset includes companies from 17
sectors, and with headquarters in 34 countries, although we
report a concentration of 68% in North America and 23%
in European countries.
text analysis to measure firm-level exposure to climate
risk. From early applications to more recent
advancements, studies utilizing text analysis have provided
insights into market perceptions, sector vulnerabilities, and
regulatory developments related to climate change. By
leveraging textual data from diverse sources including
news articles ([
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]; [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]; [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]; [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]), regulatory documents
([
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]) and firm-specific documents as annual reports,
10-Ks and earnings conference calls ([
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ])
previous studies ofered granular insights into the
multifaceted nature of climate risk, possibly enabling
targeted risk assessments and mitigation strategies. While
some of the previous studies only focus on transition
risk, others delved deeper into sub-categories of
transition and physical risk. We contribute to the line of
literature measuring climate risk exposure at the firm
level by developing a new methodology to extract
physical risk indicators, separating physical risk into several
climate hazards, between risk and business opportunities
and between demand and supply-related shocks.
      </p>
      <p>Our findings highlight that the efects of climate
hazards on firms are not uniform, with variations observed
across sectors, time frames, and types of hazards.
Moreover, we find a significant portion of firms that exhibit
positive exposure to these hazards and a majority of firms
indirectly impacted, often through shocks in their end
markets or disruptions in their supply chains.</p>
      <sec id="sec-1-1">
        <title>Note: * paragraphs, transcripts and firms not already included in the matched sample</title>
        <p>70% with the NHM Boolean model. This strategy enables
the exclusion of overly ambiguous keywords that could
introduce excessive noise into our exposure metric.
Additionally, we drop keywords that do not occur within our
documents. This refinement process ends with a
taxonomy of 43 keywords, from our initial sample exceeding
80.</p>
        <p>
          Finally, we enrich our taxonomy through the
implementation of a Skip-Gram Word2Vec model [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ], a neural
network-based approach for learning vector
representations of words, known as word embedding. We train the
Word2Vec model on a trigram corpus generated from the
matched transcripts. Once trained, the model is used to
identify semantically related words for each leading
keyword in the taxonomy with a similarity ratio threshold
of 80%. By applying the Word2Vec model, we expand our
taxonomy with an additional set of 25 text snippets. A
snapshot of the full taxonomy is shown in Figure 1.
Descriptive statistics of the matched paragraphs are shown
in Table 1.
3.2. NLP signal extraction
We employ Generative AI models, specifically, GPT-3.5
deployed through Azure Azure Machine Learning
studio [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ], to analyze paragraphs identified by the Boolean
model (refer to Section 3.1) and extract structured
indicators of corporate physical hazard exposure. Our goal is
to complete three primary tasks:
1. Validation of Climate Hazard Exposure. This
entailed confirming the precise occurrence of the
hazard (True Positive) within the paragraphs and
eliminating False Positives erroneously flagged
by the Boolean model.
2. Risk versus Opportunities. In instances where
the text references are physical hazards, we
measure whether the event has an impact on the firm
and its directionality. The Generative AI model
is prompted to categorize a mention of a climate
hazard as “risk" if the paragraphs provided
evidence of potential harm to the company’s
economic operations. Conversely, the mention could
be classified as “opportunity" if the text clearly
indicated that the hazard presented a business
prospect for the company.
3. Channels of Corporate Exposure. we
identify the channels through which the hazard
impacted the corporation’s business. The model
was prompted to diferentiate between “direct
impacts", such as the destruction of corporate
physical infrastructure or immediate disruptions to
operations, and “indirect impacts", where the
hazard afected either the company’s supply chains,
influencing the supply of intermediate goods for
production, or the company’s end markets,
affecting the demand of company’s services and
goods.
        </p>
        <p>To extract the aforementioned indicators, we craft
unique prompts for each task. For our study, we devise
three zero-shot prompts, each with explicit instructions
detailing: a) the tasks to be executed, including
descriptions of the indicators to be generated, b) the format of
the desired output, which is a JSON document with
labelled variables, c) the analytical context, encompassing
a brief definition of an earnings conference call, the
paragraphs subject to analysis, the keyword identifying the
hazard type, accompanied by a succinct hazard group
description and the NACE 1 prevalent economic sector
of the company.</p>
      </sec>
      <sec id="sec-1-2">
        <title>Task 1</title>
      </sec>
      <sec id="sec-1-3">
        <title>Class: Exposure</title>
      </sec>
      <sec id="sec-1-4">
        <title>Task 2</title>
      </sec>
      <sec id="sec-1-5">
        <title>Task 3</title>
      </sec>
      <sec id="sec-1-6">
        <title>Class: 0</title>
      </sec>
      <sec id="sec-1-7">
        <title>Class: Risk</title>
      </sec>
      <sec id="sec-1-8">
        <title>Class: Opportunity</title>
      </sec>
      <sec id="sec-1-9">
        <title>Class: 0</title>
      </sec>
      <sec id="sec-1-10">
        <title>Class: Direct</title>
        <p>Class: Indirect</p>
        <p>To evaluate the model’s precision, we manually
annotate a subset of paragraphs for each task and compare
human and machine classification. Given that the sample
distribution in task 1 predominantly favours True
Positives (the Boolean model is applied solely to keywords
with 90% and 80% Precision, as delineated in section 3.1),
we augment our validated database with out-of-sample
Negative paragraphs (without any mention of physical
hazards) to balance our dataset, sourcing from the
ambiguous text snippets dropped by the Boolean models.</p>
        <p>The model’s performance results are in Table 2 for
each task. Balanced accuracy approximates 83% for the
initial task and 80-76% for the subsequent tasks. F1 scores
for the first task equals 77%, 71% for the second task and
70% for task three.</p>
        <p>Subsequently, we apply the model to the entire corpus
of identified paragraphs, with each paragraph being
categorized in terms of exposure, risk versus opportunity, and
exposure channel. Only paragraphs verified by GPT in
Task 1 were deemed valid from the initial set pinpointed
by the Boolean model. These paragraph indicators were
then aggregated at both the transcript and firm levels.
other hazards, we source events from Wikipedia. The
outcomes of this analysis are depicted in Figure 2. The
data reveals an increase in the number of exposed firms
to hurricanes following the years in which the considered
hurricanes struck the US. A similar trend is observed for
the other risks. These findings provide preliminary
evidence of a consistent correlation between exposed firms
and the incidence of major physical events.
4. Analysis An analysis of the distribution of firms exposed to
physical hazards reveals distinct patterns. Initially, an
asIn this section, we aim to provide an analysis of indicators sessment of sector-specific vulnerability (refer to Figure
derived at the firm level. Our initial focus is on evaluating 3) indicates a pronounced disparity in hazard exposure
whether the total number of exposed firms in our sample among sectors. Flood-related events constitute the
prito a specific hazard tends to be higher in years coinciding mary risk across all sectors, followed by cold waves as
with significant events. To accomplish this, we conduct a the secondary hazard. Heatwaves and wildfires present
preliminary assessment as follows. After determining the a more varied pattern of exposure. Specifically, the
agriindividual exposure of each firm, we track the number cultural sector (NACE A) and water-related industries
of exposed firms across diferent hazards over time. Sub- (NACE E) are comparatively more susceptible to
heatsequently, we compile a list of major global events. For waves and droughts. In opposition, the construction
hurricanes, we reference NOAA data2, selecting Katrina industry faces a heightened risk from wildfires.
and Sandy as significant events with a category exceed- Furthermore, it is significant to note that a
considing 5. Additionally, we include hurricanes Harvey, Irma, erable fraction of firms are subject to multiple hazards
and Maria, which occurred in the same year (2017). For (illustrated in Figure 6), with nearly 30% of all firms
categorized under this multi-hazard exposure.
2https://www.nhc.noaa.gov/news/UpdatedCostliest.pdf</p>
        <p>I_AARG II_BNNGM ._FANUCM c._LEECDold_wav_TEAERWe flo._TFSRNCOod_hur_TEADRGicNaAneCs__TASPNRHEwSindectIL_TEHOorheat_IJ_TCwave_dL_ERrought _FPROM wildfiI_ADNNMre _ANUHQM ,_TSARR AN
T
UN0.50
O
C</p>
        <p>The second analysis we conduct aims to examine the
risk and opportunity patterns associated with each haz- is also a proportion of firms that are indirectly afected,
ard across various sectors. As depicted in Table 3, a especially through cold waves and floods. The results
significant majority of firms present negative exposure of the analysis at the sectoral level are shown in Figure
to hazards. This phenomenon is especially marked in the 6. The mining sector stands out because it is directly
case of floods and wildfires. Nonetheless, there exists a exposed to all risks, a result somehow expected. The
agrisubstantial proportion of firms that demonstrate positive cultural sector tends more often to be exposed directly
exposure, especially after cold waves and heat waves. rather than indirectly, while among the most indirectly
Looking at the diversification by economic sector could exposed sectors, we find the trade and accommodation
provide some intuitions in explaining this tendency in services.
our data. Figure 5 portrays the distribution of risk and
opportunity across sectors for diferent hazards. It be- 5. Conclusion
comes apparent that certain sectors face relatively lower
exposure to specific hazards, whereas others might even Our study reveals a multifaceted landscape of climate
reap advantages. For example, firms engaged in electric risk exposure among firms. The application of NLP
techpower generation (NACE D) are intuitively positioned niques to earnings call transcripts allows the
identifito gain from cold waves, as demand for utilities tends to cation of firm-specific, hazard-related exposure metrics
rapidly increase during such events. that vary significantly across diferent dimensions. Our</p>
        <p>Next, we investigated which sectors are impacted di- findings indicate that while physical climate hazards
genrectly through damage to assets and operations, and erally pose risks to business activities, there are instances
which indirectly, disruptions to the supply chain or to where they can present opportunities, particularly for
the demand. It is clear from Table 3 that firms are more ifrms that benefit from the aftermath of such events, and
likely to be indirectly rather than directly exposed to most notably, the highest share of physical risk exposures
physical hazards. While there is more than half of the for firms come from an indirect source, being either a
ifrms which is indirectly exposed to the hazard, there shock in demand caused by hazard impacts in end
mar</p>
      </sec>
      <sec id="sec-1-11">
        <title>Hazard class</title>
        <p>cold_wave
flood_hurricanes_wind
heat_wave_drought
wildfire</p>
      </sec>
      <sec id="sec-1-12">
        <title>Total</title>
        <p>kets, or disruption of value and supply chains in the firms’
network.</p>
        <p>The taxonomy developed has proven efective in
discerning the nuanced impacts of climate hazards. This
has facilitated the deployment of generative language
models, and the consequent granular understanding of
the direct and indirect channels through which these
hazards afect firms, highlighting the complex
interdependencies within supply chains and consumer markets.
Our research underscores the importance of considering
these multifaceted efects when assessing climate-related
ifnancial risks.</p>
        <p>Looking forward, the insights garnered from this study
could serve as a valuable resource for navigating the
evolving landscape of climate risks. Investors and
financial institutions could leverage this research to enhance
their understanding of how climate change may impact
economic activity and corporate decision-making.
Ultimately, our work contributes to the broader discourse
on sustainable finance, emphasizing the need for
innovative approaches to understand and mitigate the financial
repercussions of climate change. Additional work is still
required to leverage our newly created database and
investigate more deeply the intricate impacts of physical
climate risk on corporations.</p>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>Acknowledgments</title>
      <p>We would like to thank Jakob Jones and Michele Tursi
for their support in the construction of the Earnings call
database. We would also thank Michele Filannino for his
guidance on GPT deployments and perceptive feedback,
and Professor Giovanna Bua and Professor Daniel Kapp
for their availability to share data and provide valuable
insights. We also thank participants at the 2023
International Fintech Research Conference in Naples.</p>
      <sec id="sec-2-1">
        <title>Opportunity</title>
      </sec>
      <sec id="sec-2-2">
        <title>No exposure</title>
      </sec>
      <sec id="sec-2-3">
        <title>Direct</title>
      </sec>
      <sec id="sec-2-4">
        <title>Indirect No Channel 25.74 15.45</title>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>R. F.</given-names>
            <surname>Engle</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Giglio</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Lee</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B. T.</given-names>
            <surname>Kelly</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Stroebel</surname>
          </string-name>
          ,
          <article-title>Hedging climate change news</article-title>
          ,
          <source>Yale ICF Working Paper</source>
          <year>2019</year>
          (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>K. B. K. I. David Ardia</surname>
            ,
            <given-names>Keven</given-names>
          </string-name>
          <string-name>
            <surname>Bluteau</surname>
          </string-name>
          ,
          <article-title>Climate change concerns and the performance of green vs</article-title>
          .
          <source>brown stocks, Management Science</source>
          <volume>69</volume>
          (
          <year>2023</year>
          )
          <fpage>7607</fpage>
          -
          <lpage>7632</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>M. R. . S. G.</given-names>
            <surname>Faccini</surname>
          </string-name>
          ,
          <string-name>
            <surname>R.</surname>
          </string-name>
          ,
          <article-title>Dissecting climate risks: Are they reflected in stock prices? (</article-title>
          <year>2023</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>G.</given-names>
            <surname>Bua</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Kapp</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Ramella</surname>
          </string-name>
          , L. Rognone,
          <article-title>Transition versus physical climate risk pricing in european ifnancial markets: A text-based approach (</article-title>
          <year>2022</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>H.</given-names>
            <surname>Berkman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Jona</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. S.</given-names>
            <surname>Soderstrom</surname>
          </string-name>
          ,
          <article-title>Firm-specific climate risk and market valuation (</article-title>
          <year>2024</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>J.</given-names>
            <surname>Koelbel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Leippold</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Rillaerts</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Q.</given-names>
            <surname>Wang</surname>
          </string-name>
          ,
          <article-title>Ask bert: How regulatory disclosure of transition and physical climate risks afects the cds term structure</article-title>
          , Swiss Finance Institute Research Paper, Journal of Financial Econometrics, forthcoming
          <volume>21</volume>
          (
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>Z.</given-names>
            <surname>Sautner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. Van</given-names>
            <surname>Lent</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Vilkov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Zhang</surname>
          </string-name>
          , Firmlevel climate change exposure,
          <source>The Journal of Finance</source>
          <volume>78</volume>
          (
          <year>2023</year>
          )
          <fpage>1449</fpage>
          -
          <lpage>1498</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>Q.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Shan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Tang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Yao</surname>
          </string-name>
          ,
          <article-title>Corporate climate risk: Measurements and responses, Review of Financial Studies</article-title>
          ,
          <string-name>
            <surname>Forthcoming</surname>
          </string-name>
          (
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Bingler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Kraus</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Leippold</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Webersinke</surname>
          </string-name>
          ,
          <article-title>Cheap talk and cherry-picking: What climatebert has to say on corporate climate risk disclosures</article-title>
          ,
          <source>Finance Research Letters</source>
          <volume>47</volume>
          (
          <year>2022</year>
          )
          <fpage>102776</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>S.</given-names>
            <surname>Raschka</surname>
          </string-name>
          ,
          <article-title>An overview of general performance metrics of binary classifier systems</article-title>
          ,
          <source>arXiv preprint arXiv:1410.5330</source>
          (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>T.</given-names>
            <surname>Mikolov</surname>
          </string-name>
          , I. Sutskever,
          <string-name>
            <given-names>K.</given-names>
            <surname>Chen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. S.</given-names>
            <surname>Corrado</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Dean</surname>
          </string-name>
          ,
          <article-title>Distributed representations of words and phrases and their compositionality</article-title>
          ,
          <source>Advances in neural information processing systems</source>
          <volume>26</volume>
          (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>Azure-AI-Services</surname>
          </string-name>
          , Openai (gpt-35
          <string-name>
            <surname>-</surname>
          </string-name>
          turbo - version
          <year>2023</year>
          -
          <volume>05</volume>
          -15) [large language model] (
          <year>2023</year>
          ). URL: https://learn.microsoft.com/en-us/azure/ ai-services/openai.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>