<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>and Recom mendation of Novel Contents in Online Libraries</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Chiara Barbera</string-name>
          <email>chiara.barbera@edu.unito.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Antonio Lieto</string-name>
          <email>antonio.lieto@unito.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Gian Luca Pozzato</string-name>
          <email>gianluca.pozzato@unito.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="editor">
          <string-name>Cognitive Systems, Recommender System, Knowledge Invention, Description Logics, nonmonotonic</string-name>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Dipartimento di Informatica, Università di Torino</institution>
          ,
          <addr-line>c.so Svizzera 185, 10149 Turin</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>In this work we present AMARETTO (dynAMic generAtoR of novEl conTenT in bOoks), an intelligent recommender system exploiting a nonmonotonic extension of Description Logics with typical properties and probabilities to dynamically generate novel contents in Goodreads, the largest website for readers and book recommendations (https://www.goodreads.com). The tool AMARETTO can be used to both the generation/suggestion of novel genres of books and the reclassification of the available items within such new genres. AMARETTO first extracts a prototypical description of the available genres by means of a standard information extraction pipeline, then it generates novel classes of genres as the result of an ontology-based combination of such extracted representations, by exploiting the reasoning capabilities of a probabilistic extension of a Description Logic of typicality. We have tested AMARETTO by reclassifying the available books in Goodreads with respect to the new generated genres, as well as with an evaluation, in the form of a controlled user study experiment, of the feasibility of using the obtained reclassifications as recommended contents. The obtained results are encouraging and pave the way to many possible further improvements and research directions.</p>
      </abstract>
      <kwd-group>
        <kwd>reasoning</kwd>
        <kwd>probabilities</kwd>
        <kwd>reasoning about typicality</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Dynamic generation of novel knowledge via conceptual recombination is a relevant
phenomenon. It highlights some crucial aspects of the knowledge processing capabilities in human
cognition. Indeed, such ability concerns high-level capacities associated to creative thinking
and problem solving. The recent literature suggests the relevance of this topic [
        <xref ref-type="bibr" rid="ref1 ref2 ref3">1, 2, 3</xref>
        ], however,
it still represents an open challenge in the field of artificial intelligence [
      </p>
      <sec id="sec-1-1">
        <title>4]. Indeed, dealing with this problem requires, from an AI perspective, the harmonization of two conflicting requirements: the need of a syntactic and semantic compositionality – typical of logical systems</title>
        <p>1st Italian Workshop on Artificial Intelligence for Cultural Heritage (AI4CH22), co-located with the 21st International</p>
        <p>LGOBE
(G. L. Pozzato)
https://www.antoniolieto.net (A. Lieto); http://www.di.unito.it/~pozzato/ (G. L. Pozzato)</p>
        <p>
          © 2022 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).
– and the one concerning the exhibition of typicality efects. Such requirements, however,
can be hardly accommodated in standard symbolic systems, including formal ontologies [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ].
According to a well-known argument [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ], in fact, prototypes, namely commonsense conceptual
representations based on typical properties, are not compositional. The argument runs as
follows: consider a concept like pet fish . It results from the composition of the concept pet
and of the concept fish . However, the prototype of pet fish cannot result from the composition
of the prototypes of a pet and a fish: e.g. a typical pet is furry, a typical fish is grayish, but a
typical pet fish is neither furry nor grayish, on the contrary, typically, it is red. The pet fish
phenomenon is a paradigmatic example of the dificulty to address when building formalisms
and systems trying to imitate this combinatorial human ability. Examples of such dificulties
concern: handling exceptions to attribute inheritance, handling the possible inconsistencies
arising between conflicting properties of the concepts to be combined etc.
        </p>
        <p>
          In this work, we exploit an ontology-based framework able to account for this type of
humanlike concept combination and we show how it can be used as a tool for the generation and the
suggestion of novel editorial content, following the same idea of DENOTER [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ], a
KnowledgeBased System for the dynamic generation and classification of novel contents in multimedia
broadcasting. In particular, we adopt the recently introduced nonmonotonic extension of
Description Logics (from now on DL, see [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]) able to reason about typicality with probabilities
and called TCL (typicality-based compositional logic) introduced in [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ]. Description Logics are a
class of decidable fragments of first order logics that are at the base of Ontology Web Language
(OWL and OWL 2), used for the realization of computational ontologies. Nowadays, DLs are
the most important and widespread symbolic knowledge-representation formalisms [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]. In
the logic TCL, “typical” properties can be directly specified by means of a “typicality” operator
T enriching the underlying DL, and a TBox can contain inclusions of the form T() ⊑  to
represent that “typical  s are also  ”. As a diference with standard DLs, in the logic TCL one
can consistently express exceptions and reason about defeasible inheritance as well.
        </p>
        <p>
          Typicality inclusions are also equipped by a real number  ∈ (0.5, 1] representing the
probability/degree of belief in such a typical property: this allows us to define a semantics inspired to the
DISPONTE semantics [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ] characterizing probabilistic extensions of DLs, which in turn is used
in order to describe diferent scenarios where only some typicality properties are considered.
Given a KB containing the prototypical description of two concepts   and   occurring in it,
we then consider only some scenarios in order to define a revised knowledge base, enriched by
typical properties of the combined concept  ⊑   ⊓   by also implementing some heuristics
coming from the cognitive semantics.
        </p>
        <p>In this work we exploit the logic TCL in order to dynamically generate novel knowledge about
literary genres and their properties by means of a mechanism for commonsense combination.
This generative and creative capacity has been tested in the context of the online platform
Goodreads (https://www.Goodreads.com), one of the largest site for readers and book
recommendations providing information about literary genres as well as about hundreds of books.
We introduce the system AMARETTO (dynAMic generAtoR of novEl conTenT in bOoks) which,
ifrst, automatically builds prototypes of existing basic genres in Goodreads (Children’s, Fantasy,
Horror, and so on). In Goodreads, each book is explicitly marked as belonging to one or more
basic genres. By means of a web crawler, AMARETTO extracts information about concepts
or properties occurring with the highest frequencies in the textual descriptions of the book
available in the online platform. Such prototypes are formalized by means of a TCL knowledge
base, whose TBox contains both rigid inclusions of the form</p>
        <p>BasicGenre ⊑ Concept,
in order to express essential desiderata but also constraints, for instance Childrens ⊑ Good
(contents for children must have goods) and Childrens ⊑ ¬Sex (due to law restrictions, sexual
contents for kids must be forbidden), as well as prototypical properties of the form
 ∶∶</p>
        <p>T(BasicGenre) ⊑ TypicalConcept,
representing typical concepts of a given genre, where  is a real number in the range (0.5, 1],
expressing the frequency of such a concept in items belonging to that genre: for instance,
0.825 ∶∶ T(Horror ) ⊑ House is used to express that the typical horror book contains/refers to
the concept House with a frequency/probability/degree of belief of the 82.5%, and such a degree
is automatically extracted by AMARETTO from the description of the books currently available
on Goodreads and classified as belonging to such a genre.</p>
        <p>Given the knowledge base with the prototypical descriptions of basic genres, AMARETTO
exploits the reasoning capabilities of the logic TCL in order to generate new derived genres as the
result of the creative combination of two basic ones. It is possible to use AMARETTO also for
combining derived genres with either basic or derived ones. With the prototypical descriptions
of the derived genres at hand, the tool AMARETTO reclassifies the books of Goodreads taking
such new, derived genres into account. The basic idea is as follows: a book can be considered as
belonging to/is recommended for a given new generated genre if its metadata (name, description,
title) contain all the rigid properties as well as at least the 30% of the typical properties of the
prototype of such a derived genre.</p>
        <p>We have also tested AMARETTO by performing two diferent kinds of evaluation: on the
one hand, an automatic evaluation, on the other hand an evaluation of the satisfaction of
users. In both cases, the results that we have obtained seem promising, witnessing that the
tool AMARETTO could represent a first step in the direction of designing a novel, data-driven,
logic-based, “white box” smart recommender system.</p>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>2. Logical Reasoning for Concept Combination: the Description</title>
    </sec>
    <sec id="sec-3">
      <title>Logic TCL</title>
      <p>
        The tool AMARETTO exploits the Description Logic TCL [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] for the generation of new literary
genres as the combination of two existing ones.
      </p>
      <p>The language of TCL extends the basic DL  ℒ  by typicality inclusions of the form
 ∶∶</p>
      <p>T() ⊑ 
where  ∈ (0.5, 1] is a real number representing its degree of belief, whose meaning is that “we
believe with degree/probability  that, normally,  s are also  s”. We avoid probabilities  ≤ 0.5
since it would be misleading for typicality inclusions, since typical knowledge is known to come
with a low degree of uncertainty.</p>
      <p>We define a knowledge base  = ⟨ℛ,  ,  ⟩ where ℛ is a finite set of rigid properties of
the form  ⊑  ,  is a finite set of typicality properties of the form  ∶∶ T() ⊑  where
 ∈ (0.5, 1] ⊆ ℝ is the degree of belief of the typicality inclusion, and  is the ABox, i.e. a finite
set of formulas of the form either () or (, ) , where ,  ∈ O and  ∈ R .</p>
      <p>
        The Description Logic TCL relies on the DL of typicality  ℒ  + TR introduced in [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ],
which allows to describe the protoype of a concept, in this case a literary genre. As a diference
with standard DLs, in the logic  ℒ  + TR one can consistently express exceptions and reason
about defeasible inheritance as well. The semantics of the T operator is characterized by the
properties of rational logic [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], recognized as the core properties of nonmonotonic reasoning.
The Description Logic  ℒ  + TR is characterized by a minimal model semantics corresponding
to an extension to DLs of a notion of rational closure as defined in [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] for propositional logic:
the idea is to adopt a preference relation among  ℒ  + TR models, where intuitively a
model is preferred to another one if it contains less exceptional elements, as well as a notion
of minimal entailment restricted to models that are minimal with respect to such preference
relation. As a consequence, the operator T inherits well-established properties like specificity
and irrelevance; in the example, the Description Logic  ℒ  + TR allows one to infer that
T(Student ⊓ Tall) ⊑ Young (being tall is irrelevant with respect to being young) and, if one
knows that Annekee is a typical senior student, to infer that she is not young, giving preference
to the most specific information.
      </p>
      <p>
        The Description Logic of typicality with rational closure is finally extended in order to deal
with concept combination: the logic TCL considers a distributed semantics similar to DISPONTE
[
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] for probabilistic DLs. This logic allows one to label inclusions T() ⊑  with a real number
between 0.5 and 1, representing its degree of belief, assuming that each axiom is independent
from each others. Degrees in typicality inclusions allow to define a probability distribution
over scenarios: intuitively, a scenario is obtained by choosing, for each typicality inclusion,
whether it is considered as true or false. In an extension of the above example, we could have
the following KB:
(1) SeniorStudent ⊑ Student
(2) 0.7 ∶∶ T(Student) ⊑ Young
(3) 0.95 ∶∶ T(SeniorStudent) ⊑ ¬Young
(4) 0.85 ∶∶ T(SeniorStudent) ⊑ Married
We consider eight diferent scenarios, representing all possible combinations of typicality
inclusion, for instance {((2), 1), ((3), 1), ((4), 0)} represents the scenario in which (2) and (3) hold,
whereas (4) is not considered. The standard inclusion (1) holds in every scenario, representing a
rigid property not admitting exceptions. We equip each scenario with a probability depending on
those of the involved inclusions: the scenario of the example has probability 0.7 × 0.95 × (1 − 0.85),
since 2 and 3 are involved, whereas 4 is not. Such probabilities are then taken into account in
order to select the most adequate scenario describing the prototype of the combined concept.
      </p>
      <p>
        In order to capture the ability of combining concepts, the logic TCL exploits a method inspired
by cognitive semantics [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] for the identification of a dominance efect between the concepts to
be combined: for every combination, we distinguish a HEAD, representing the stronger element
of the combination, and a MODIFIER. The basic idea is: given a KB and two concepts   (HEAD)
and   (MODIFIER) occurring in it, we consider only some scenarios in order to define a revised
knowledge base, enriched by typical properties of the combined concept  ⊑   ⊓   .
      </p>
      <p>Formally, given a KB  = ⟨ℛ,  ,  ⟩ and given two concepts   and   occurring in  ,
the logic TCL allows defining a prototype of the concept obtained by the combination of the
HEAD   and the MODIFIER   . Such a prototype contains typical properties of the form
 ∶∶</p>
      <p>T(  ⊓   ) ⊑ 
and are obtained by considering blocks of scenarios with the same probability, in decreasing
order from the highest to the lowest. We first discard all the inconsistent scenarios, then:
• we discard trivial scenarios, that is to say scenario consistently inheriting all the properties
from the HEAD from the starting concepts to be combined. This choice is motivated
by the challenges provided by task of commonsense conceptual combination itself: in
order to generate plausible and creative compounds it is necessary to maintain a level of
surprise in the combination. Thus all scenarios inheriting all the properties of the HEAD,
including the one where all the properties of both concepts HEAD and MODIFIER, are
inherited, are discarded since they prevent this surprise;
• among the remaining ones, we discard those inheriting properties from the MODIFIER
in conflict with properties that could be consistently inherited from the HEAD; as an
example, in the combination of the literary genres Mystery – as the HEAD – and Christian
– MODIFIER — the logic could have to deal with the conflicting properties:
0.85 ∶∶ T(Horror ) ⊑ Killer
0.60 ∶∶ T(Christian) ⊑ ¬Killer
In this case, all scenarios where the latter inclusion is considered are discarded, even if
the former one is discarded too, since they reject the HEAD/MODIFIER heuristics;
• if the set of scenarios of the current block is empty, i.e. all the scenarios have been
discarded either because trivial or because preferring the MODIFIER, we repeat the
procedure by considering the block of scenarios, having the immediately lower probability.
Remaining scenarios are those selected by the logic TCL. The ultimate output of our mechanism
is a knowledge base whose set of typicality properties is obtained by adding to those of the
initial knowledge, the inclusions considered in the selected scenario(s), namely those describing
the prototype of the combined concept   ⊓   . If more than one scenario is selected by the
logic TCL, then several alternative final knowledge bases are provided.</p>
      <p>Formally, given a scenario  satisfying the above properties, we define the properties of
  ⊓   as the set of inclusions  ∶∶ T(  ⊓   ) ⊑  , for all T(  ⊓   ) ⊑  that are entailed
from  in the logic TCL. The probability  is such that:
• if T(  ) ⊑  is entailed from  , that is to say  is a property inherited either from the
HEAD (or from both the HEAD and the MODIFIER), then  corresponds to the degree of
belief of such inclusion of the HEAD in the initial knowledge base, i.e.  ∶ T(  ) ⊑  ∈  ;
• otherwise, i.e. T(  ) ⊑  is entailed from  , then  corresponds to the degree of belief of
such inclusion of a MODIFIER in the initial knowledge base, i.e.  ∶ T(  ) ⊑  ∈  .
The knowledge base obtained as the result of combining concepts   and   i is defined as:
   ⊓  = ⟨ℛ,  ∪ { ∶</p>
      <p>T(  ⊓   ) ⊑ },  ⟩,
for all  such that either T(  ) ⊑  is entailed in  or T(  ) ⊑  is entailed in  , and  is
defined as above.</p>
      <p>It can be shown that reasoning in the logic TCL is ExpTime-complete. Since reasoning
in standard  ℒ  is ExpTime-complete too, this means that, even if we add probabilities,
typicalities, and scenarios for combining prototypes, we remain in the same complexity class of
the initial, monotonic Description Logic.</p>
    </sec>
    <sec id="sec-4">
      <title>3. The tool AMARETTO: Automatic Generation of Novel</title>
    </sec>
    <sec id="sec-5">
      <title>Literary Genres</title>
      <p>We describe the tool AMARETTO, the system exploiting the logic TCL in order to generate
and suggest novel literary genres for Goodreads (https://www.Goodreads.it). AMARETTO is
implemented in Python and it makes use of the library o w l r e a d y 2 (https://pythonhosted.org/
Owlready2/) for relying on the services of eficient DL reasoners (like HermiT).</p>
      <p>
        As already sketched, the tool AMARETTO first builds a prototypical description of basic
literary genres available in Goodreads. At present, in order to provide a first evaluation of the
system, we consider the following literary genres: Children’s, Fantasy, Fiction, History, Horror,
Mystery, Romance, and Thriller. To this aim, a web crawler extracts metadata from books and
texts available on the platform. More in detail, for each item the crawler extracts (i) the genre
to which it belongs and (ii) the set of “significant” words (i.e., excluding prepositions, proper
names, articles, etc.) occurring in the description of each item, as well as their frequency. These
information are used in order to provide a description of each basic genre in terms of its typical
properties in the logic TCL, where the frequency of a concept/word for a genre is obtained from
the number of occurrences of such a concept/word in the items belonging to that genre. The
ifve properties with the highest frequency over 0.5 are included in the prototypical description
of each basic genre. Formally, similarly to what done in [
        <xref ref-type="bibr" rid="ref15 ref7">7, 15, 16</xref>
        ], we have:
Definition 1. Given a book  , let   be the set of significant concepts extracted for  by the web
crawler, and let Concept ∈   . Let  , Concept be the number of occurrences of Concept in the
description of  . We define the frequency  , Concept of concept Concept for the item  as
 , Concept =
 , Concept
∑∈   ,
.
      </p>
      <p>Definition 2. Given a basic literary genre Genre, let ℬ be the set of books belonging to Genre,
and let  Genre be the set of concepts occurring in such items, i.e.  Genre = ⋃∈ℬ   , where   .</p>
      <p>Given a concept Concept ∈  Genre and a book  ∈ ℬ , let  , Concept be the number of
occurrences of Concept in the description of  . We define  Genre,Concept the number of occurrences of
Concept in the description of items of Genre, i.e.</p>
      <p>Genre,Concept = ∑  , Concept .</p>
      <p>∈ℬ
We also define the frequency of Concept for a genre Genre, written  Genre,Concept :
 Genre,Concept =</p>
      <p>Genre,Concept
∑∈ Genre  Genre,C
.</p>
      <p>The prototypical description of a basic literary Genre inTCL is defined as the set of inclusions
 1 ∶∶ T(Genre) ⊑ TypicalConcept1
 2 ∶∶ T(Genre) ⊑ TypicalConcept2
⋮
 5 ∶∶ T(Genre) ⊑ TypicalConcept5,
where TypicalConcept1, TypicalConcept2, … , TypicalConcept5 are the five concepts in  Genre
with the highest frequencies higher than 50%; frequencies are then also used as degrees of belief
of the respective inclusions. If needed, in some cases we have also manually added some rigid
properties, thus integrating the bottom-up, data-driven, process of prototype formation with
top down expert knowledge. Recalling the example in the Introduction, we have exploited this
opportunity given by the logic TCL for imposing some constraints, for instance to avoid that
books for children contain/refer to sex and violence. Therefore, the knowledge base generated
by the crawler will contain, among typical properties, also rigid inclusions like Childrens ⊑ ¬Sex
and Childrens ⊑ ¬Violence. The tool AMARETTO generates novel hybrid literary genres by
combining existing ones by exploiting the reasoning mechanism provided by the logic TCL and
described in the previous section. As an example, consider the following prototypes of basic
genres Childrens and Mystery:</p>
      <p>AMARETTO combines the two basic genres by means of a variant of CoCoS [17], a Python
implementation of reasoning services for the logic TCL in order to exploit eficient DLs reasoners
for checking both the consistency of each generated scenario and the existence of conflicts
among properties. As an example, the new, derived literary genre obtained by combining
Children’s and Mystery, with the number of the inherited properties fixed to be no higher than
eight, has the following TCL description:
Obviously, rigid properties of both basic concepts Childrens and Mystery are inherited by the
derived concept as well.</p>
    </sec>
    <sec id="sec-6">
      <title>4. The tool AMARETTO: Reclassifying and Recommending</title>
    </sec>
    <sec id="sec-7">
      <title>Books with Respect to Generated Literary Genres</title>
      <p>Apart from the process of automatic knowledge generation, AMARETTO is also able to reclassify
books of Goodreads within the novel derived genres (generated as described in the previous
section). As mentioned, indeed, each book is equipped by some information available in
Goodreads, including title and description of the item. AMARETTO extracts such information
and then computes the frequencies of concepts in it as in Definition 2, in order to compare them
with the properties of a derived genre. If the book contains all the rigid properties and at least
the 30% of the typical properties of the genre under consideration, then the book is classified
as belonging to it. Last, AMARETTO suggests the set of classified contents, in a descending
order of compatibility, where a rank of compatibility of a single book with respect to a genre
is intuitively obtained as the sum of the frequencies of “compatible” concepts, i.e. concepts
belonging to both the book and the prototypical description of the literary genre. Formally:
Definition 3. Given a book  , let DerivedGenre be a derived literary genre as defined in Section 3
and let   be the set of concepts/words occurring in  as in Definition 2. Given a knowledge
base KB of literary genres built by AMARETTO, we say that  is compatible with DerivedGenre
if the following conditions hold:</p>
      <sec id="sec-7-1">
        <title>1.  contains all rigid properties of DerivedGenre, i.e. { ∣ DerivedGenre ⊑  ∈ 2.  contains at least the 30% of typical properties of DerivedGenre , i.e.</title>
        <p>KB} ⊆  
∣  DerivedGenre ∣
∣   ∩  DerivedGenre ∣ ≥ 0.3,
where  DerivedGenre is the set of typical properties of DerivedGenre as in Definition 4.</p>
        <p>As an example, consider the above derived genre Childrens ⊓ Mystery, and the book “The
Phantom Tollbooth” (https://www.goodreads.com/book/show/378.The_Phantom_Tollbooth?
from_search=true&amp;from_srp=true&amp;qid=x8ixl8TNqL&amp;rank=1). It is reclassified in the novel,
generated genre Childrens ⊓ Mystery. Indeed:
• all rigid properties of both basic genres are satisfied, that is to say the only rigid property
Search belongs to the properties of the book under consideration, whereas neither Murder
nor Blood nor Sex nor Evil nor Violence belong to the properties extracted by the crawler
for the book itself;
• more than the 30% of the typical properties of the derived genre are satisfied by the items,
in particular “The Phantom Tollbooth” has Story with frequency 0.90, Readers (0.90), and
Time (0.90) with a total score of 3.6.</p>
        <p>In conclusion, the tool AMARETTO will recommended the song “The Phantom Tollbooth”. As
usual, recommended songs are listed in a non increasing order by their score.</p>
      </sec>
    </sec>
    <sec id="sec-8">
      <title>5. Tests and Evaluations</title>
      <p>We have evaluated AMARETTO in order to check whether it could be considered a promising
approach for generating new knowledge about literary genres and recommending books in the
context of the Goodreads platform.</p>
      <p>The first evaluation is completely automatic and inheres the capability of the system of
generating novel hybrid literary genres that are able to be populated by the original content of
the Goodreads platform via a re-classification mechanism involving the books of the platform.
In this case, the success criterion concerns the avoidance of the creation of empty boxes
corresponding to the new generated combined genres. With the only exceptions of three
genres, all the derived literary genres contain books that are classified under such a genre. It is
worth noticing that, in some cases, a book is classified in the derived genre of two basic ones,
without being member of the initial genres. For instance, the book “The Cuckoo’s Calling” by
J.K.Rowling (under the name Robert Galbraith) is classified as belonging to the genre Mystery,
however it is re-classified in the genre derived as the combination of Childrens and Fantasy.
Similarly, the above mentioned book “The Phantom Tollbooth” by Norton Juster belongs to the
genre Fantasy but it is also classified in the combination of Childrens and Mystery.</p>
      <p>A second evaluation aimed at measuring the satisfaction of the potential users of the platform
when exposed to the contents of the novel categories suggested by AMARETTO. It consisted
in a user study involving 20 persons (10 females, 10 males, aged 20-45) that evaluated
recommendations generated by the system for seven combined literary genres. All the participants
were selected from the same population, i.e., voluntary persons using an availability sampling
strategy. Participants were all naive to the experimental procedure and to the aims of the
study. This is one of the most commonly used methodology for the evaluation of recommender
systems based on controlled small groups analysis [18]. This evaluation was carried out as a
classical “one to one” lab controlled experiment, that is to say one person at time with one expert
interviewer, and we adopted a thinking aloud protocol: this technique consists in recording
the verbal explanations provided by the people while executing a given laboratory task. It has
been used in the AI literature since the pioneering work by Newell and Simon, as a source to
individuate the heuristics used by humans to solve a given task [19, 20]. At this stage, this
solution was methodologically preferred with respect to the adoption of large scale online
surveys since it allowed us to have more control on the type of thoughts and considerations
emerging during the evaluation of the results. In this setting, the users had to start the interview
by indicating a couple of preferred genres among those available in Goodreads.</p>
      <p>This selection triggered both the activation of a novel hybrid prototypical literary genre
by AMARETTO and the corresponding reclassification of books of Goodreads based on such
selection. The output of the system, pruned to show the top 5 best results, was then evaluated
with a 1-10 voting scale expressing the satisfaction of the received recommendations. The
results of this second evaluation are shown in Table 1 and are promising. For each pair, we have
reported only one combination (and not the symmetric one, obtained by exchanging the roles of
HEAD and MODIFIER), since we have found very few diferences between the two alternatives.
We have obtained an average rate of 6.67 in a 1-10 scale: this result seems to be promising,
especially considering that only some literary genres have been involved in this test. We are
currently working on extending our test including all the genres available on GoodReads.</p>
    </sec>
    <sec id="sec-9">
      <title>6. Conclusions and Future Works</title>
      <p>In this work we have presented AMARETTO, a knowledge-based system for the dynamic
generation of novel literary genres, exploiting the reasoning mechanism of the logic TCL in order
to generate, reclassify and suggest books as belonging to novel literary genres in the context
of Goodreads, one of the world’s largest portal for readers and book recommendations. The
system has been tested in twofold evaluation showing promising results for both the automatic
evaluation and the user acceptability of the recommended books.</p>
      <p>
        AMARETTO exploits the logic TCL, introduced in order to tackle the task of modelling
prototypical concept composition in a human-like fashion (and with human-level performances).
Several approaches have been proposed in both the AI and computational cognitive science
communities to this aim. Other attempts similar to the one adopted here concerns the modelling
of the conceptual blending phenomenon: a task where the obtained concept is entirely novel
and has no strong association with the two base concepts. In this setting, [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] proposed a
mechanism for conceptual blending based on the DL ℰ ℒ ++. They construct the generic space
of two concepts by introducing an upward refinement operator that is used for finding common
generalizations of ℰ ℒ ++ concepts. However, diferently from us, what they call prototypes are
expressed in the standard monotonic formalism, which does not allow to reason about typicality
and defeasible inheritance. More recently, a diferent approach is proposed in [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], where the
authors see the problem of concept blending as a nonmonotonic search problem and proposed
to use Answer Set Programming (ASP) to deal with this search problem. There is no evidence,
however, that both the frameworks of [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] and [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] would be able to model.
      </p>
      <p>The core component of the system AMARETTO relies on CoCoS. In future research, we aim
at studying the application of optimization techniques in [21] in order to improve its eficiency
and, a consequence, the one of the proposed knowledge generation system.</p>
      <p>Furthermore, we aim at extending the evaluation provided in this paper in two directions.
The first one concerns the inclusion of all literary genres available in GoodReads. The second
one goes in the direction of testing our tool AMARETTO including a suitable extension for
the automated extraction of negated typical properties of the form  ∶∶ T(Genre) ⊑ ¬ . This
aspect would require to analyze in more detail heuristic aspects concerning the eficiency about
the concept selection and combination.
doi:h t t p s : / / d o i . o r g / 1 0 . 1 0 1 6 / j . c o g s y s . 2 0 2 2 . 1 0 . 0 0 1 .
[16] A. Lieto, G. L. Pozzato, S. Zoia, V. Patti, R. Damiano, A commonsense reasoning framework
for explanatory emotion attribution, generation and re-classification, Knowledge Based
Systems 227 (2021) 107166. URL: https://doi.org/10.1016/j.knosys.2021.107166. doi:1 0 . 1 0 1 6 /
j . k n o s y s . 2 0 2 1 . 1 0 7 1 6 6 .
[17] A. Lieto, G. L. Pozzato, A. Valese, COCOS: a typicality based concept combination system,
in: P. Felli, M. Montali (Eds.), Proceedings of the 33rd Italian Conference on Computational
Logic, Bolzano, Italy, September 20-22, 2018, volume 2214 of CEUR Workshop Proceedings,
CEUR-WS.org, 2018, pp. 55–59. URL: http://ceur-ws.org/Vol-2214/paper6.pdf.
[18] G. Shani, A. Gunawardana, Evaluating recommendation systems, in: Recommender
systems handbook, Springer, 2011, pp. 257–297.
[19] A. Newell, J. C. Shaw, H. A. Simon, Report on a general problem solving program, in: IFIP
congress, volume 256, Pittsburgh, PA, 1959, p. 64.
[20] A. Newell, H. A. Simon, Human problem solving, volume 104, n. 9, Prentice-Hall Englewood</p>
      <p>Clifs, NJ, 1972.
[21] M. Alberti, E. Bellodi, G. Cota, F. Riguzzi, R. Zese, cplint on SWISH: probabilistic logical
inference with a web browser, Intelligenza Artificiale 11 (2017) 47–64. URL: https://doi.
org/10.3233/IA-170106. doi:1 0 . 3 2 3 3 / I A - 1 7 0 1 0 6 .</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>M.</given-names>
            <surname>Eppe</surname>
          </string-name>
          , E. Maclean,
          <string-name>
            <given-names>R.</given-names>
            <surname>Confalonieri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Kutz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Schorlemmer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Plaza</surname>
          </string-name>
          , K.-U. Kühnberger,
          <article-title>A computational framework for conceptual blending</article-title>
          ,
          <source>Artificial Intelligence</source>
          <volume>256</volume>
          (
          <year>2018</year>
          )
          <fpage>105</fpage>
          -
          <lpage>129</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>M.</given-names>
            <surname>Lewis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Lawry</surname>
          </string-name>
          ,
          <article-title>Hierarchical conceptual spaces for concept combination</article-title>
          ,
          <source>Artificial Intelligence</source>
          <volume>237</volume>
          (
          <year>2016</year>
          )
          <fpage>204</fpage>
          -
          <lpage>227</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>R.</given-names>
            <surname>Confalonieri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Schorlemmer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Kutz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Peñaloza</surname>
          </string-name>
          , E. Plaza,
          <string-name>
            <given-names>M.</given-names>
            <surname>Eppe</surname>
          </string-name>
          , Conceptual blending in EL++,
          <source>in: Proc. of the 29th Int. Work. on Description Logics</source>
          ,
          <string-name>
            <surname>DL</surname>
          </string-name>
          <year>2016</year>
          ,
          <year>2016</year>
          . URL: http://ceur-ws.
          <source>org/</source>
          Vol-
          <volume>1577</volume>
          /paper_8.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Boden</surname>
          </string-name>
          ,
          <source>Creativity and artificial intelligence</source>
          ,
          <source>Artificial Intelligence</source>
          <volume>103</volume>
          (
          <year>1998</year>
          )
          <fpage>347</fpage>
          -
          <lpage>356</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>M.</given-names>
            <surname>Frixione</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Lieto</surname>
          </string-name>
          ,
          <article-title>Representing concepts in formal ontologies: Compositionality vs</article-title>
          . typicality efects,
          <source>Logic and Logical Philosophy</source>
          <volume>21</volume>
          (
          <year>2012</year>
          )
          <fpage>391</fpage>
          -
          <lpage>414</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>D. N.</given-names>
            <surname>Osherson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. E.</given-names>
            <surname>Smith</surname>
          </string-name>
          ,
          <article-title>On the adequacy of prototype theory as a theory of concepts</article-title>
          ,
          <source>Cognition</source>
          <volume>9</volume>
          (
          <year>1981</year>
          )
          <fpage>35</fpage>
          -
          <lpage>58</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>E.</given-names>
            <surname>Chiodino</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. Di</given-names>
            <surname>Luccio</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Lieto</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Messina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. L.</given-names>
            <surname>Pozzato</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rubinetti</surname>
          </string-name>
          ,
          <article-title>A knowledgebased system for the dynamic generation and classification of novel contents in multimedia broadcasting</article-title>
          , in: G.
          <string-name>
            <surname>De Giacomo</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Catalá</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          <string-name>
            <surname>Dilkina</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Milano</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Barro</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Bugarín</surname>
          </string-name>
          , J. Lang (Eds.),
          <source>ECAI 2020 - 24th European Conference on Artificial Intelligence</source>
          ,
          <volume>29</volume>
          <fpage>August</fpage>
          -8
          <source>September</source>
          <year>2020</year>
          , Santiago de Compostela, Spain,
          <source>August 29 - September 8</source>
          ,
          <year>2020</year>
          , volume
          <volume>325</volume>
          <source>of Frontiers in Artificial Intelligence and Applications</source>
          , IOS Press,
          <year>2020</year>
          , pp.
          <fpage>680</fpage>
          -
          <lpage>687</lpage>
          . URL: https://doi.org/10.3233/FAIA325.
          <source>doi:1 0 . 3 2 3 3 / F A I A 2 0</source>
          <volume>0 1 5 4 .</volume>
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>F.</given-names>
            <surname>Baader</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Calvanese</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>McGuinness</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Patel-Schneider</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Nardi</surname>
          </string-name>
          ,
          <article-title>The description logic handbook: Theory, implementation and applications</article-title>
          , Cambridge university press,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>A.</given-names>
            <surname>Lieto</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. L.</given-names>
            <surname>Pozzato</surname>
          </string-name>
          ,
          <article-title>A description logic framework for commonsense conceptual combination integrating typicality, probabilities and cognitive heuristics</article-title>
          ,
          <source>Journal of Experimental and Theoretical Artificial Intelligence</source>
          <volume>32</volume>
          (
          <year>2020</year>
          )
          <fpage>769</fpage>
          -
          <lpage>804</lpage>
          . URL: https://doi. org/10.1080/0952813X.
          <year>2019</year>
          .
          <volume>1672799</volume>
          .
          <source>doi:1 0 . 1 0</source>
          <volume>8 0 / 0 9 5 2 8 1 3 X . 2 0 1 9 . 1 6 7 2 7 9 9 .</volume>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>F.</given-names>
            <surname>Riguzzi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Bellodi</surname>
          </string-name>
          , E. Lamma,
          <string-name>
            <given-names>R.</given-names>
            <surname>Zese</surname>
          </string-name>
          ,
          <article-title>Probabilistic description logics under the distribution semantics</article-title>
          ,
          <source>Semantic Web</source>
          <volume>6</volume>
          (
          <year>2015</year>
          )
          <fpage>477</fpage>
          -
          <lpage>501</lpage>
          . URL: http://dx.doi.org/10.3233/SW-140154.
          <source>doi:1 0 . 3 2 3 3 / S W - 1</source>
          <volume>4 0 1 5 4 .</volume>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>L.</given-names>
            <surname>Giordano</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Gliozzi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Olivetti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. L.</given-names>
            <surname>Pozzato</surname>
          </string-name>
          ,
          <article-title>Semantic characterization of Rational Closure: from Propositional Logic to Description Logics</article-title>
          ,
          <source>Artificial Intelligence</source>
          <volume>226</volume>
          (
          <year>2015</year>
          )
          <fpage>1</fpage>
          -
          <lpage>33</lpage>
          .
          <source>doi:1 0 . 1 0 1 6 / j . a r t i n t . 2 0 1 5 . 0 5 . 0 0 1 .</source>
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>D.</given-names>
            <surname>Lehmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Magidor</surname>
          </string-name>
          ,
          <article-title>What does a conditional knowledge base entail?</article-title>
          ,
          <source>Artificial Intelligence</source>
          <volume>55</volume>
          (
          <year>1992</year>
          )
          <fpage>1</fpage>
          -
          <lpage>60</lpage>
          . doi:h t t p : / / d x .
          <source>d o i . o r g / 1 0 . 1 0</source>
          <volume>1 6 / 0 0 0 4 - 3 7 0 2 ( 9 2 ) 9 0 0 4</volume>
          <fpage>1</fpage>
          -
          <lpage>U</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>F.</given-names>
            <surname>Riguzzi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Bellodi</surname>
          </string-name>
          , E. Lamma,
          <string-name>
            <given-names>R.</given-names>
            <surname>Zese</surname>
          </string-name>
          ,
          <article-title>Reasoning with probabilistic ontologies</article-title>
          , in: Q.
          <string-name>
            <surname>Yang</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          Wooldridge (Eds.),
          <source>Proceedings of IJCAI</source>
          <year>2015</year>
          , AAAI Press,
          <year>2015</year>
          , pp.
          <fpage>4310</fpage>
          -
          <lpage>4316</lpage>
          . URL: http://ijcai.org/proceedings/2015.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Hampton</surname>
          </string-name>
          ,
          <article-title>Inheritance of attributes in natural concept conjunctions</article-title>
          ,
          <source>Memory &amp; Cognition</source>
          <volume>15</volume>
          (
          <year>1987</year>
          )
          <fpage>55</fpage>
          -
          <lpage>71</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>A.</given-names>
            <surname>Lieto</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. L.</given-names>
            <surname>Pozzato</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Striani</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Zoia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Damiano</surname>
          </string-name>
          ,
          <article-title>Degari 2.0: A diversity-seeking, explainable, and afective art recommender for social inclusion</article-title>
          ,
          <source>Cognitive Systems Research</source>
          <volume>77</volume>
          (
          <year>2023</year>
          )
          <fpage>1</fpage>
          -
          <lpage>17</lpage>
          . URL: https://www.sciencedirect.com/science/article/pii/S1389041722000456.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>