<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>CILC</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Large Language Models: What They Are, Why They Are Important, and What They Fail At</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Roberto Navigli</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Sapienza University of Rome</institution>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2024</year>
      </pub-date>
      <volume>39</volume>
      <abstract>
        <p>The advent of Large Language Models (LLMs) like GPT-4 represents a significant leap forward in the field of Artificial Intelligence, ofering unprecedented capabilities in understanding, generating, and interacting with human language. This talk aims to demystify these complex systems, explaining their fundamental architecture, how they are trained on vast datasets, and the underlying technologies that enable their sophisticated processing abilities. We will explore the importance of LLMs, highlighting their role in driving innovation, enhancing productivity, and opening new avenues for human-computer interaction. However, with great power comes great responsibility, and LLMs are not without their limitations and challenges. This presentation will critically examine the inherent weaknesses of LLMs, such as biases in training data, the potential for generating misleading information, and ethical concerns. We will delve into real-world examples to illustrate these failures, ofering a balanced perspective on the capabilities and limitations of these models. Finally, I will overview ongoing research in my group aimed at mitigating these shortcomings, including extracting facts from generated text and interconnecting them to the source text.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Disclaimer: 90% of this abstract was generated by GPT-4.</p>
    </sec>
  </body>
  <back>
    <ref-list />
  </back>
</article>