<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>IIR</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Content representation and analysis: the Magic Project and the Illuminated Dante Project integrated systems for multimedia information retrieval</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Stefania Conte</string-name>
          <email>stefania.conte@unina.it</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Gennaro Ferrante</string-name>
          <email>gennaro.ferrante@unina.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Lorenza Laccetti</string-name>
          <email>lorenza.laccetti@unina.it</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Andrea Mazzucchi</string-name>
          <email>andrea.mazzucchi@unina.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Yahya Momtaz</string-name>
          <email>yahya.momtaz@unina.it</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Augusto Tortora</string-name>
          <email>augusto.tortora@unina.it</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Humanities, University of Naples Federico II</institution>
          ,
          <country country="IT">Italy</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Department of Physics "Ettore Pancini," University of Naples Federico II</institution>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2024</year>
      </pub-date>
      <volume>14</volume>
      <fpage>05</fpage>
      <lpage>06</lpage>
      <abstract>
        <p>From the collaboration between the Department of Humanities and the Department of Physics "Ettore Pancini" of the University of Naples "Federico II", with the addition of three private companies, the "MAGIC" project started in mid-2023. The project aims to create a Service Center for the treatment, conservation, digitization, preservation and enhancement of the archival and book heritage. Starting from the Illuminated Dante project, that is, the digitization (managed by the Department of Humanities) of the illuminated manuscripts of Dante Alighieri's Divine Comedy, dated between the 14th and 15th centuries and preserved in national and international museums, libraries and archives, the MAGIC project as a whole proceeds towards information systems and information retrieval systems that aim to acquire information, to archive it and to preserve it in specific databases, without neglecting its distribution and communication. The analysis of the contents and the extraction of the information also lead to a second objective: the easy readability of the text. Artificial intelligence algorithms are being used as image filtering techniques in what is commonly called the bleed-through effect, where ink bleeds between the front and back of manuscripts, making them difficult to read.</p>
      </abstract>
      <kwd-group>
        <kwd>Manuscripts</kwd>
        <kwd>artificial intelligence</kwd>
        <kwd>web portals</kwd>
        <kwd>information retrieval1</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        In May 2023, thanks to the cooperation between the Department of Humanities and the
Department of Physics “Ettore Pancini” of the University of Naples “Federico II”, the MAGIC
project was launched, a multidisciplinary project with heterogeneous and transversal skills,
capable of combining scientific research in the field and the growth of knowledge with the
use of innovative technological solutions, first and foremost the digitalization planned for
the Illuminated Dante project. The Center intends to experiment and adopt new
technologies in the service of information retrieval, in the presence of libraries and archives
rich in heritages to be communicated and a public attentive and predisposed to interaction
and information sharing. The MAGIC project also stems from the co-partnership with three
major industrial companies, leaders in the field of Information and Communications
Technology applied to cultural heritage and digitization; companies that have an in-house
R&amp;D division and have acquired the necessary know-how to guide all stages of the process,
from the creation of information to its archiving and dissemination [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. Multimodality and multimedia in Dante Alighieri’s Commedia</title>
      <p>Conventions, incentives and scientific partnership agreements with Italian and foreign
curators have supported the digitization and dissemination of a core of 283 illuminated
manuscripts of Dante Alighieri's Divine Comedy.</p>
      <p>
        The dedicated web portal, IDP-Illuminated Dante Project (www.dante.unina.it), curated
by the Department of Humanistic Studies, displays high-definition digitized images in the
JPEG 2000 multi-resolution format of the first 101 manuscripts with copyright concession
and using the Mirador viewer [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. It is a large hypertextual system in which access to the
data occurs through open access navigation and exploration by the user, be they a specialist
and scholar, or an avid reader of the world of Dante.
      </p>
      <p>
        The web portal, object of interest, represents a system of textual and multimedia
information retrieval, since the information to be managed and searched are in different
forms: text and images. The system manages hundreds of textual contents, first of all those
concerning the poem of the Divine Comedy, according to the edition edited by Giorgio
Petrocchi and divided into the three canticles of Inferno, Purgatory and Paradise, in turn
divided into verses. Furthermore, the IDP-Illuminated Dante Project portal reports for each
manuscript its own descriptive sheet, considering the bibliographic object under the
paleographic, codicological, philological and historical aspects, as well as under the
iconographic one, arriving at a very analytical expository analysis, which goes as far as the
examination of the individual images that accompany and embellish the code. A search for
"Subjects" and "Decorative types" from the boxes on the Home page or directly from the
Navigation bar allows the system user to perform an exhaustive and complete search of the
text/image relationship. For each image inserted in the portal, the typology, execution
technique, subject and macro-subject, keywords, text-image relationship, relationship with
the Dante and extra-Dante tradition, and any notes are outlined. The same occurs with the
iconographic information that characterizes the "Subjects" field, an alphabetical list that
lists protagonists, contexts, things and places present in Dante's Comedy. The description
cards follow the Manus OnLine (MOL) platform, and will then be exported via XML TEI-P5,
on the portal www.dante.unina.it. This procedure allows the indexer to proceed with the
compilation of the initial grids in pre-established or free fields [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
      </p>
    </sec>
    <sec id="sec-3">
      <title>3. Artificial intelligence and data access</title>
      <p>The second goal of the Magic project is the creation of new cultural assets available for the
community to enjoy. The primary goal is not only the mere faithful reproduction of
manuscripts, but to ensure their easy readability for users, transcending sociocultural
boundaries. In fact, an important phase of the project concerns the image quality control
system, with the aim of ensuring the efficient readability of the entire information content
of the original manuscripts, especially for non-experts, since manuscripts commonly have
irregular and difficult-to-read writing.</p>
      <p>Ancient manuscripts can be subject to different types of degradation. A frequent problem
is the oxidation of inks: their composition causes oxidation, or the production of acidic
substances, which gradually penetrate between the recto and verso of the pages and vice
versa; this effect is known as bleed through. The approach introduced by the Magic project
examines artificial intelligence for content analysis and information extraction. The
experimental phase allows us to identify the most suitable and effective techniques to
counteract this phenomenon compatibly with its presence and intensity. From the tested
approaches, a chosen image filtering technique is based on the enhancement and
propagation of spatial coherence structures.</p>
      <p>
        Once the text lines within the image are identified, a combination of spatial and semantic
concatenation logic can be applied. This method employs a comprehensive pipeline,
utilizing various color spaces and techniques such as contrast enhancement and white
border inpainting to improve segmentation accuracy of different document regions. In fact,
attenuation occurs in two sequential phases, an identification step, which requires the use
of unsupervised machine learning algorithms; and a removal step, also called inpainting,
where pixels labeled as bleedthrough are replaced with pixels that mimic the background
hue. The proposed method integrates a clustering mechanism paired with Gaussian Mixture
Models to distinctively identify and separate foreground, background, and bleed-through
elements. Furthermore, these techniques allow to know the entire apparatus of comments
and glosses that are rich in the illuminated manuscripts of the different editions of Dante's
Comedy, also useful for the purposes of research and philological study of the texts (see
Figure 1) [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ].
      </p>
    </sec>
    <sec id="sec-4">
      <title>4. Conclusions</title>
      <p>The interdisciplinarity of the MAGIC project collimates and converges toward the
interdisciplinarity of information retrieval, which arises precisely from the intersection of
different disciplines involving ontology, design, information architecture, human behavior
about information, linguistics, information science, and computer science.</p>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgements</title>
      <p>The project was funded by Ministry of Enterprise and Made in Italy, (code n.
F/130093/03/X38 and CUP: B69J23000560005) and by Ministry of University and
Research (code n. PIR01_00011, CUP: I66C18000100006).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>G.</given-names>
            <surname>Russo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Aiosa</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Alfano</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Chianese</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Cornevilli</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. D.</given-names>
            <surname>Domenico</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Maddalena</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Mazzucchi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Muraglia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Russillo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Salvi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Spisso</surname>
          </string-name>
          , G. Trombetti, G. Zollo, “MA.
          <string-name>
            <surname>G.I.C.</surname>
          </string-name>
          : Manuscripts of Girolamini In Cloud” in: IOP Conference Series, Materials Science and Engineering,
          <volume>949</volume>
          ,
          <issue>012081</issue>
          (
          <year>2020</year>
          ), pp.
          <fpage>1</fpage>
          -
          <lpage>8</lpage>
          . doi:
          <volume>10</volume>
          .1088/
          <fpage>1757</fpage>
          -899X/949/1/012081
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>S.</given-names>
            <surname>Conte</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. M.</given-names>
            <surname>Maddalena</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Mazzucchi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Merola</surname>
          </string-name>
          , G. Russo,
          <string-name>
            <surname>G.</surname>
          </string-name>
          <article-title>Trombetti in use: The role of project MA.G.I.C. in the context of the European strategies for the digitization of the library and archival heritage” in: Bucciero, Alberto and Fanini, Bruno and Graf, Holger</article-title>
          and Pescarin, Sofia and Rizvic, Selma (Eds),
          <source>Eurographics Workshop on Graphics and Cultural Heritage</source>
          ,
          <source>The Eurographics Association</source>
          ,
          <year>2023</year>
          , pp.
          <fpage>119</fpage>
          -
          <lpage>128</lpage>
          . doi:
          <volume>10</volume>
          .2312/gch.20231167
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>C.</given-names>
            <surname>Perna</surname>
          </string-name>
          , ”
          <article-title>Illuminated Dante Project: un archivio e database per la più antica iconografia dantesca (secc. XIV-XV)”</article-title>
          , in: DigItalia,
          <volume>15</volume>
          (
          <issue>2</issue>
          ), (
          <year>2020</year>
          ), pp.
          <fpage>150</fpage>
          -
          <lpage>158</lpage>
          . https://doi.org/10.36181/digitalia-00022.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>G.</given-names>
            <surname>Ferrante</surname>
          </string-name>
          , ”
          <article-title>Illuminated Dante project : un approccio integrato di studi testuali</article-title>
          , librari e iconografici” in: Perna, Ciro (Ed) Immaginare la Commedia, Roma, Salerno,
          <year>2022</year>
          , pp.
          <fpage>237</fpage>
          -
          <lpage>244</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>G.</given-names>
            <surname>Wan</surname>
          </string-name>
          , L. Zi, “
          <article-title>Content based information retrieval and digital libraries”</article-title>
          ,
          <source>in: Information technology and libraries</source>
          , (
          <year>2008</year>
          ), pp.
          <fpage>41</fpage>
          -
          <lpage>46</lpage>
          . doi:
          <volume>10</volume>
          .6017/ital.v27i1.
          <fpage>3262</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>T.</given-names>
            <surname>Brizio</surname>
          </string-name>
          , “
          <article-title>Project Management and Digital Transformation. Performance Measuring Model of Digital Projects and Archives”</article-title>
          ,
          <source>in: JLIS.It</source>
          <volume>9</volume>
          (
          <issue>3</issue>
          ), (
          <year>2018</year>
          ), pp.
          <fpage>92</fpage>
          -
          <lpage>108</lpage>
          . doi.org/10.4403/jlis.it-12420.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>A.</given-names>
            <surname>Zanni</surname>
          </string-name>
          , “
          <article-title>Libraries and Open Access Industry”</article-title>
          ,
          <source>in: JLIS.It</source>
          <volume>9</volume>
          (
          <issue>3</issue>
          ), (
          <year>2018</year>
          ), pp.
          <fpage>75</fpage>
          -
          <lpage>91</lpage>
          . doi.org/10.4403/jlis.it-12486.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>S.</given-names>
            <surname>Conte</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. M.</given-names>
            <surname>Di Domenico</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Mazzei</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Mazzucchi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Russo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Salvi</surname>
          </string-name>
          ,
          <string-name>
            <surname>A</surname>
          </string-name>
          . Tortora, “
          <article-title>The MAGIC project: first research results” in: Bernasconi, Eleonora and Mannocci, Andrea and Poggi, Antonella and Salatino, Angelo</article-title>
          and Silvello Gianmaria (Eds),
          <source>Proceedings of the 20th Conference on Information and Research</source>
          science Connecting to Digital and Library science, Bressanone, Brixen,
          <fpage>22</fpage>
          -
          <lpage>23</lpage>
          february
          <year>2024</year>
          ,
          <year>2024</year>
          , pp.
          <fpage>87</fpage>
          -
          <lpage>93</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>R.</given-names>
            <surname>Morriello</surname>
          </string-name>
          , “
          <article-title>Blockchain, intelligenza artificiale e internet delle cose in biblioteca in:</article-title>
          <source>AIB Studi</source>
          ,
          <volume>59</volume>
          (
          <issue>1-2</issue>
          ), (
          <year>2020</year>
          ), pp.
          <fpage>45</fpage>
          -
          <lpage>68</lpage>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>