<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Identification and quantification of colours in children's drawings Christelle Cocco1, Raphaël Ceré2, Aris Xanthos3, Pierre-Yves Brandt1</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Christelle Cocco</string-name>
          <email>ccocco@unil.ch</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Raphaël Ceré</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Aris Xanthos</string-name>
          <email>axanthos@unil.ch</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Pierre-Yves Brandt</string-name>
          <email>pbrandt@unil.ch</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Geography and Sustainability, University of Lausanne</institution>
          ,
          <country country="CH">Switzerland</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Department of Language and Information Sciences, University of Lausanne</institution>
          ,
          <country country="CH">Switzerland</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Institute for Social Sciences of Religions, University of Lausanne</institution>
          ,
          <country country="CH">Switzerland</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2018</year>
      </pub-date>
      <fpage>11</fpage>
      <lpage>21</lpage>
      <abstract>
        <p>Researchers in social sciences and humanities disciplines are confronted with the need to analyse increasing amounts of visual data, which calls for the development of new computational methods. This paper focuses on the problem of identifying the colours used in children's drawings, notably in the perspective of assessing their diversity. It describes a simple, effective, and flexible algorithm for performing this task. This methodology is applied to a subset of more than 1000 drawings taken from the “Drawings of gods” database. The first results show that this approach makes it possible to address meaningful research questions concerning the patterns of colour usage in these data.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 Introduction</title>
      <p>
        Social sciences and humanities (SSH) have a rich
tradition of using computational methods for
analysing text data. In contrast, although visual media
have an increasing importance in many disciplines
and a central role in some of them, researchers in
SSH have only just begun to explore the
methodological opportunities offered by computerized
image analysis. Rooted in developmental psychology
and psychology of religion, the “Drawings of gods”
project1 is an example of an SSH project in which
image is the primary data type: its main goals are
the collection and analysis of drawings of gods
produced by children in various countries and cultures
        <xref ref-type="bibr" rid="ref11 ref12 ref6">(see, e.g., Brandt et al., 2009; Dandarova, 2013;
Dandarova Robert et al., 2016)</xref>
        . In this context, an
important class of research questions is related to
1. This project is supported by the Swiss National Science
Foundation (SNSF), grant no. 156383. The database of the
project is available at http://ddd.unil.ch/.
colour usage in the drawings, e.g. “Which colours
are used to draw god?”, “Are the colours used
preferentially to answer the task of drawing god the
same in each country?”, or “Do older children use
a larger array of colours than younger ones?”.
Answering such questions presupposes the ability to
identify the colours used in each of the thousands of
drawings in the “Drawings of gods” database. This
paper attempts to give a formal characterisation of
this problem, proposes a computational
methodology for solving it, and discusses the first results of
its application to a subset of the project’s drawings.
      </p>
      <p>Processes for capturing colours and providing
numerical representations of them have been
standardised long ago by such institutions as the
Commission Internationale de l’Eclairage (CIE).
Arguably, the most well-known scheme for digital
colour representation is the RGB colour space: a
colour is described by a triplet of values, each of
which corresponds to the intensity of a primary
colour light beam (red, green, or blue); each value is
encoded with one octet, so that there are 2563 =
16; 777; 216 possible RGB colour triplets. This
representation, which is the one in which the
drawings of our dataset are converted by the digitisation
process, is vastly too fine-grained for answering
research questions of the kind stated above, as a
single pencil stroke on a sheet of paper typically
contains dozens of RGB shades when digitised.
The challenge of colour identification, then,
consists in defining a consistent mapping from a
standard digital colour space (in our case, RGB) to a
much more coarse-grained colour set, adapted to
the research purposes of the widest possible range
of SSH disciplines.</p>
      <p>
        This task is rendered significantly more difficult
by the fact that colour perception is a complex
phenomenon which varies from one person to another
on the basis of neurobiological factors, as well as
cultural factors such as language
        <xref ref-type="bibr" rid="ref34">(Pastoureau, 2017,
pp. 35 and 87)</xref>
        . This was confirmed by a
preliminary experiment where we asked five human experts
of various languages and cultures to look at 21
children’s drawings and indicate the presence or
absence of colours in a list (in French) based on
the five principal and the five intermediate hues
of the Munsell colour system
        <xref ref-type="bibr" rid="ref33">(Munsell, 1912)</xref>
        and
completed by four colours (namely, brown, black,
white and grey).2 Recognizing the difficulty (if not
the impossibility) to define universal human colour
categories, we settled in this work on a set of 10
categories (red, orange, yellow, green, cyan, blue,
purple, pink, white, and achromatic) which proved
relevant for addressing the “Drawings of gods”
research questions, and which our method is able to
identify consistently. Most colours in this set are
also present in those proposed by
        <xref ref-type="bibr" rid="ref3">Berlin and Kay
(1969)</xref>
        and
        <xref ref-type="bibr" rid="ref34">Pastoureau (2017)</xref>
        . The main
differences with those lie in the absence of brown, which
the proposed method fails to identify consistently,
the fusion of black and grey, whose distinction is
not relevant for characterizing the drawings of our
dataset, and the addition of cyan. It is worth noting,
however, that this particular colour set is but one
possible configuration of the method, which can be
easily adapted to fit different user needs.
      </p>
      <p>The remainder of the paper is organized as
follows. Section 2 offers a brief overview of related
work in the computer vision literature. After a
synthetic presentation of the data used in this study (a
sample of about 1200 drawings extracted from the
“Drawings of gods” dataset), section 3 proposes a
detailed, formal account of the proposed algorithm
for colour identification, and describes two ways
of quantifying colour diversity based on the results
of colour identification. Section 4 discusses the
results of colour identification and colour diversity
quantification applied to our data, and section 5
draws a brief conclusion.
2</p>
    </sec>
    <sec id="sec-2">
      <title>State of the art</title>
      <p>
        Research about colours in computer vision mostly
focuses on image segmentation
        <xref ref-type="bibr" rid="ref10 ref21 ref8">(see, e.g., Cheng
and Sun, 2000; Chen et al., 2005; Hanmandlu et al.,
2013)</xref>
        and image retrieval
        <xref ref-type="bibr" rid="ref15 ref35 ref44">(see, e.g., Deng et al.,
2001; Rao et al., 2015; Zhang et al., 2016)</xref>
        . In
either case, the problem typically consists in
assess2. The agreement between annotators for each colour, as
measured by Fleiss’s Kappa
        <xref ref-type="bibr" rid="ref19">(Fleiss, 1971)</xref>
        , varied between
0:0512 and 0:876. It was even negative for white, since part
of the subjects did not consider the background of the page as
a colour.
ing colour similarity rather than assigning pixels to
predefined colour categories. Colour names have
also been used in the framework of object
recognition
        <xref ref-type="bibr" rid="ref27">(see, e.g., Khan et al., 2013)</xref>
        , but this task is
essentially irrelevant for answering SSH research
questions such as illustrated in section 1.
Furthermore, these methods are usually adapted for
processing photographic sources rather than drawings.
      </p>
      <p>
        However, other studies in computer vision have
proposed promising descriptors such as colour
histograms
        <xref ref-type="bibr" rid="ref37">(see, e.g., Sun et al., 2006)</xref>
        , colour names
acquired using machine learning techniques
        <xref ref-type="bibr" rid="ref32 ref39">(Van de
Weijer et al., 2009; Lindner and Süsstrunk, 2013)</xref>
        ,
or parametric models for automatic colour
naming, where each colour category is modelled as a
fuzzy set with a parametric membership function
        <xref ref-type="bibr" rid="ref1">(Benavente et al., 2008)</xref>
        . In both cases of colour
naming, colour palettes are learned from annotated
data collected from Google Images for the former
and from psychophysical experiments for the latter.
These palettes could be used as the starting point
of the method presented in section 3.2, although
they are too fine-grained for our purpose.
      </p>
      <p>
        The K-means algorithm is often used to find
colour groups
        <xref ref-type="bibr" rid="ref23 ref29 ref30 ref41">(see, e.g., Yendrikhovskij, 2001;
Konyushkova et al., 2015; Hu and Lee, 2007)</xref>
        . However,
there are two main drawbacks with this method:
(i) it is necessary to define a priori the number of
clusters (K), i.e. the number of colours; (ii) the
output of the method is the mean colour (i.e. the
centroid) of each cluster, which can be difficult to
relate to predefined colour categories. The article
of
        <xref ref-type="bibr" rid="ref30">Konyushkova et al. (2015)</xref>
        provides an example
of the application of this technique to the analysis
of the “Drawings of gods” images.
      </p>
      <p>
        Finally,
        <xref ref-type="bibr" rid="ref29">Kim et al. (2007)</xref>
        describe a method for
identifying colours in drawings which is very
similar to the one proposed here. The main differences
are that their method starts with images in another
colour space, namely HVC (“hue–value–chroma”,
also known as the Munsell colour system) and,
more importantly, that it does not rely on a formal
distinction between micro- and macro-colours (see
section 3.2), since they define macro-colours
directly and classify each pixel into one of these
colours.
      </p>
    </sec>
    <sec id="sec-3">
      <title>Method</title>
      <sec id="sec-3-1">
        <title>Data and preprocessing</title>
        <p>The dataset used in this study is a subset of N =
1211 drawings collected in three countries (Japan,
plained at the end of this section.</p>
        <p>Red
Switzerland and Russia) between 2003 and 2016
and extracted from the complete “Drawings of
gods” database (which contains over 6600
drawings from nine countries and which is constantly
growing). Small groups of compulsory school
aged children were sat in a way that discouraged
copying from each other and were asked to draw
“god”, according to the procedure described in
Dandarova Robert et al. (2016). Specifically, each
child received a blank A4 paper sheet, a grey
pencil, a ten-colour set of wax pastels and an eraser. In
some cases, such as in Russia, children employed
ordinary coloured pencils due to the lack of
available material.</p>
        <p>Each drawing k 2 1; : : : ; N has been digitised
and, for the purpose of this study, resized using
the imresize module of the scipy.misc Python
package, in such fashion that the length of the
drawing’s longest side is normalised to 320 pixels.
Note that with this procedure, there remains a small
amount of variability in the length of the drawings’
shortest side.</p>
        <p>In what follows, each normalised drawing is
represented formally as a matrix S := (~si j) of I J
pixels (~s), where each pixel is a triplet of values
corresponding to red, green, and blue intensity
respectively, i.e. ~s := fsR; sG; sBg.</p>
      </sec>
      <sec id="sec-3-2">
        <title>3.2 Identification of colours</title>
        <p>
          The proposed colour identification method draws
on the work of
          <xref ref-type="bibr" rid="ref29">Kim et al. (2007)</xref>
          , who associate
each pixel of an image with the most similar colour
of a set of colours that they defined in the Munsell
colour system. Besides the adoption of another
colour space3 and of another colour set, the
particularity of our approach is that it uses a two-stage
assignment process. Each pixel is first associated
with a “micro-colour” (represented by one of the
117 small rectangular areas in Figure 1), which
in turn belongs to a “macro-colour” (red, orange,
yellow, green, cyan, blue, purple, pink, white, and
achromatic).4 Decomposing colour identification
in this way offers two advantages. First,
microcolours are more fine-grained and permit thus to
grasp more shades of each colour. Secondly, it
is possible to create a new set of macro-colours
without modifying the set of micro-colours as
ex3. Using the RGB colour space instead of the Munsell colour
system allows us to avoid an additional transformation step.
4. The Python source code implementing our method
is available at https://github.com/ChrisCocco/ddd_
colours.
(1)
(2)
(3)
Orange
        </p>
        <p>Yellow</p>
        <p>Green</p>
        <p>Blue</p>
        <p>Pink
Cyan</p>
        <p>cR; clG; slBg with l 2 1; : : : ; L</p>
        <p>Formally, let ~cl := f l
denote each micro-colour. For each pixel ~si j in an
image, we find the micro-colour whose squared
Euclidean dissimilarity with the pixel is minimal:
c(~si j) := argmin k~si j ~clk2</p>
        <p>l2[1;L]
The pixel is then associated with one out of G =
10 macro-colours, according to the groupings of
micro-colours delineated in Figure 1. This
macrocolour, denoted by C(~si j), is ultimately considered
to be the pixel’s colour.</p>
        <p>For each colour g 2 1; : : : ; G we then define a
binary matrix Bg := (bigj), of the same dimensions
as the considered drawing and whose components
are 1 iff g is the colour assigned to the pixel in
question: 5</p>
        <p>bigj := 1(C(~si j) = g)
This enables us to define the pixel count (i.e. the
number of pixels) of each colour g in a given image
as:
g
ng := å bi j
i j</p>
        <p>Pixel counts can be used to compute the proportion
of each colour in a given image or in a set of
images, in order to answer the first type of research
questions mentioned in section 1. In section 4.1
below, we show the resulting proportions for the
5. Here and in the sequel, 1(A) denotes the indicator function
of event A, taking on the value 1 if A is true, and 0 otherwise.
N = 1211 drawings of our sample, along with the
decomposition into binary matrices of a couple
drawings.</p>
        <p>
          It is important to note that while the set of
L = 117 micro-colours used in this study is defined
by a particular RGB colour chart, 6 it could have
been easily substituted with another one. The same
holds for the set of G macro-colours used here,
which is the result of discussions in the “Drawing
of gods” project’s team. Since it is complicated for
computers and for human to differentiate black and
grey (or which pencil was used by the children),
they were grouped into a single “achromatic”
category. Moreover, this distinction is not necessary
to study a child’s colour choice. Brown, which is
considered as a colour of the second rank by
          <xref ref-type="bibr" rid="ref34">Pastoureau (2017)</xref>
          and not as a principal or
intermediate hue in the Munsell colour system for instance,
is not included in the colour list. Indeed, brown is a
shade of red or orange (eventually green) in colour
spaces such as HSV or HSL, with a high saturation
and a relatively low lightness or value. It would be
possible to group some of the 117 micro-colours
into a new “brown” group, however there was no
consensus in the project team on how to do so.
        </p>
        <p>In summary, the proposed method for identifying
colours can be configured in various ways,
depending on two levels of choice, first regarding
microcolours and secondly regarding macro-colours; the
particular configuration described in this paper and
used for producing the results presented in section 4
below is the result of discussions with the
“Drawing of gods” project’s team and it is specifically
adapted to this project’s research purposes.
3.3</p>
      </sec>
      <sec id="sec-3-3">
        <title>Quantification of colour diversity</title>
        <p>
          There are a number of ways of quantifying the
diversity associated with a discrete distribution, such
as the distribution of colours in a drawing obtained
with the identification method described in
section 3.2 above. All diversity measures are, to a
certain extent, dependent on the size of the sample
from which the considered distribution has been
obtained
          <xref ref-type="bibr" rid="ref38">(see, e.g., Tweedie and Baayen, 1998)</xref>
          ,
however the impact of this dependence is lessened
in our case by the (partial) normalisation of
drawing size (see section 3.1 above). In the present
study, we experiment with two diversity measures,
namely the variety or number of distinct colours in
6. Namely the one available at https://www.rapidtables.
com/web/color/RGB_Color.html
a drawing, and the Shannon entropy of the colour
distribution.
        </p>
        <p>In the case of variety, an additional
preprocessing step is performed: in order to reduce the
amount of noise – anomalous pixels resulting from
the digitisation process – a median filter of 3 3
pixels is applied to each binary colour matrix Bg.
The filtered matrix, B˜g, is then used to compute new
˜g
counts n˜g := åi j bi j, which in turn make it possible
to calculate the colour variety as:</p>
        <p>
          Following
          <xref ref-type="bibr" rid="ref36">Shannon (1948)</xref>
          , the colour entropy
is defined as:
        </p>
        <p>V := å 1(n˜g &gt; 0)</p>
        <p>g
H :=
å f g log f g
g
(4)
(5)
where f g := ng= åk nk stands for the (unfiltered)
colour relative frequency (computed on the basis
of Bg). H varies between 0 and log G: H = 0
corresponds to a deterministic configuration where
a single colour occurs with relative frequency f g =
1, while the maximum H = log G is reached when
the colour distribution is uniform (8g : f g = 1=G).</p>
        <p>In section 4.2 below, we will discuss the results
obtained when applying these two ways of
quantifying colour diversity to the drawings of our sample.
In particular, we will show how they can be used
to characterise the strategies adopted by children
for the task of drawing god, which is an important
result for the psychologists of the project’s team.
4</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Results</title>
      <p>In this section, we present the first results obtained
by applying the methods for colour identification
and colour diversity assessment described in
section 3 to the selected subset of the “Drawings of
gods” database.
4.1</p>
      <sec id="sec-4-1">
        <title>Colour identification</title>
        <p>The first outcome of the proposed colour
identification method is the decomposition of each
image into a set of G binary matrices, one matrix
Bg := (bi j) per colour g. One way of visualising
these matrices consists in using them as an
inverted “mask”, in the sense of image processing, and
applying them to the original image. Formally, for
each colour g, we construct a new image Sg := (~sigj),
where each pixel is defined as:</p>
        <p>(~si j if bigj = 1
~sigj :=
(6)
(0; 0; 0) otherwise</p>
        <sec id="sec-4-1-1">
          <title>White Red</title>
        </sec>
        <sec id="sec-4-1-2">
          <title>Orange</title>
        </sec>
        <sec id="sec-4-1-3">
          <title>Yellow</title>
        </sec>
        <sec id="sec-4-1-4">
          <title>Green</title>
        </sec>
        <sec id="sec-4-1-5">
          <title>Cyan</title>
        </sec>
        <sec id="sec-4-1-6">
          <title>Blue Purple Pink Achromatic</title>
          <p>The result is a set of G images filled with black
except for the pixels that have been identified as
belonging to a given colour g. Figure 2 shows
three examples of this way of visualising the colour
configuration detected in an image.</p>
          <p>These examples were selected to illustrate
various (and decreasing) degrees of concordance
between the automated colour identification and
the human intuition. In the first example, all
colours are identified as expected by the project’s team,
which is what visual inspection of the results
generally reveals. All colours are also identified correctly
and as expected in the second example, considering
that brown is not part of the selected colour set; as
a result it is divided into orange and red. Also, and
it is coherent, the mixing of blue and yellow around
the centre of the drawing creates nuances that are
identified as green. The third example illustrates a
weakness of the method, namely the identification
of colours with a low saturation and a low lightness,
in particular green.</p>
          <p>s
l
e
x
i
p
f
o
n
o
i
t
r
o
p
o
r
P
0.33% 0.59%
iknP lrepu</p>
          <p>P</p>
          <p>
            Besides the visualisation of colour
decomposition, the method allows us to compute the
proportion of each colour g in the selected dataset, based
on the summation of each colour’s pixel counts
(with the exception of white) over all drawings.
The resulting histogram, represented in Figure 3
shows that the most frequently identified “colour”
is achromatic, followed by blue and yellow.
Orange, red, green and cyan have a moderate
representation, while pink and purple are clearly
underrepresented. Studies on colour preference
            <xref ref-type="bibr" rid="ref20 ref25 ref42">(see, e.g.,
Granger, 1955; Zentner, 2001; Jonauskaite et al.,
2016)</xref>
            have shown that shades of blue and green,
such as cyan, as well as red (especially for female
and 3- to 4-year old children) are the most preferred
colours, while the least preferred ones are yellow
and orange (and sometimes red). The distribution
of identified colours in our data shows that children
certainly do not use their preferred colours to draw
god, but specific colours for this task. Assuming
that they employ blue to depict the sky and yellow
for the light or the sun, the results are compatible
with the hypothesis that children imagine god as
something or someone shining in the sky. The
proposed method will also make it possible to compare
the colour distribution across countries, age groups,
and so on, and thus to test various psychological
hypotheses.
4.2
4.2.1
          </p>
        </sec>
      </sec>
      <sec id="sec-4-2">
        <title>Quantification of colour diversity Variety and entropy</title>
        <p>Based on the output of the colour
identification method, the variety and entropy of colours
were computed as described in section 3.3.
Figure 4 shows the distribution of colour variety in
the dataset, which reveals that a majority of
drawings (about 70%) have between 5 and 8 identified
colours. The distribution deviates slightly from
normality, in the sense that drawings with 7 and 8
colours are particularly frequent, and there is also
a small peak of drawings with a single non-white
colour (V = 2). The box plots in Figure 5 depict the
variability of colour entropy for a given amount of
colour variety. While the median of entropy is
consistently increasing with variety, as expected, the
spread of individual entropy values is quite large
regardless of the corresponding variety.</p>
        <p>In order to get a better idea of the interpretation
of colour entropy variations for a given amount of
variety, we have designed a visualisation in which
1.5
y
p
o
r
t
en1.0
r
u
o
l
o
C0.5
0.0
1
2
3
4</p>
        <p>5 6
Colour variety
7
8
9
10
a sample of drawings are plotted on a grid with 9
rows corresponding to colour variety (between 2
and 10, excluding empty drawings) and 5 columns
corresponding to specific points in the distribution
of colour entropy (minimum, first quartile, median,
third quartile, and maximum), as represented in
Figure 6. In practice, this visualisation was
constructed one row after another, by extracting all
drawings with a given amount of colour variety in
the dataset, then finding in this subset the
drawings with the minimum and maximum colour
entropy as well as those that are closest to the desired
quantiles. This representation shows that colour
entropy seems to correspond well with the intuitive
notion of drawing completeness: the higher the
entropy, the more the colours are covering the page.
Also, entropy and variety seem to concur to create a
gradual distinction between drawings with a white
background and single object or character
(bottomleft) and drawings representing one or more objects
in a more contextualised fashion (top-right). Thus,
besides operationalising the basic notion of colour
diversity, colour variety and entropy enable us to
characterise certain aspects of drawing strategy and
of the spatial organisation of colours in a drawing.
4.2.2</p>
      </sec>
      <sec id="sec-4-3">
        <title>Concordance with human judgement</title>
        <p>To conclude this section, we discuss the results of
an attempt to compare the colour variety obtained
using the proposed colour identification method
with the human perception of colour variety. We
asked five human experts (the same ones as
mentioned in section 1) to write down all the colours
they saw in each drawing k˜ in a sample of N˜ = 10
drawings. Annotators had at their disposal a paper
sheet with 15 areas for writing colour names. Since
only two of them mentioned white, this colour was
removed altogether (both in human and automated
colour identification results). The colour variety
perceived by an annotator in a drawing was then
defined as the number of non-empty areas on their
sheet. Thus, if an annotator described a colour
using several colour or shade names in a single area,
it was counted as a single colour.</p>
        <p>Figure 7 shows that the difference between the
colour variety V (k˜) automatically detected in a
drawing k˜ and the average V h(k˜) of the
corresponding human-perceived variety over the five experts
is no greater than 2. This result is quite
impressive considering the limitations of the automatic
attributions discussed previously as well as the
human perception bias. The scatter plot in Figure
8 confirms that there is a considerable degree of
concordance between V (k˜) and V h(k˜).</p>
        <p>
          Figure 9 shows the range of disagreement
between the two variety estimates using the
socalled Bland and Altman graphic
          <xref ref-type="bibr" rid="ref4">(Bland and
Altman, 1986)</xref>
          . For each drawing k˜, the difference
d(k˜) := V (k˜) V h(k˜) (on the vertical axis) is
represented as a function of their mean d(k˜) :=
V (k˜)+V h(k˜) (on the horizontal axis). The more d(k˜)
2
is distant of 0, the higher the disagreement between
the two variety estimates, and d := 1=N˜ åk˜ d(k˜) =
0 indicates a perfect concordance between them if
d(k˜) = 0 8 k˜, i.e. 1=N˜ åk˜ d(k˜) = 0. In this case,
although the sample is too small to be representative,
the mean disagreement d = 0:74 is reasonably
low (1=N˜ åk˜ d(k˜) = 1:3). That more colours are
found by humans than by the algorithm on average
is consistent with the fact that brown is not part of
the automatically identified colour set and that grey
and black are aggregated.
5
        </p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Conclusion</title>
      <p>In this paper, we have introduced a simple and
effective method for the identification of colours in
children’s drawings (and other types of images).
We have shown how the results of this method
can be used, in conjunction with classical diversity
measures, to tackle meaningful research questions
in the context of “Drawings of gods”, a large SSH
project. The proposed methodology will be
systematically employed in future research within this
framework to address various research questions
based on such features as children’s age, gender, or
country of residence. Unlike the inter-rater
methodology traditionally used in psychology, which
min. 1st quartile
median 3rd quartile
max.</p>
      <p>Colour entropy
2
1
0
1
s
lruoo 8
c
f
rebo 6 ●
m
u
N 4
●
●</p>
      <p>●
2 ● NMuemanbenruomfbceorlsouorfsc(oalolguorrsith(hmu)mans) ± sd
1
2
3
4
●</p>
      <p>●
5 6
Drawings
●
7
●
8
●
9
●
10
requires human experts to annotate the data (a
tedious and error-prone task), the proposed method
has the advantage of being objective and being able
to provide consistent results on large visual
databases. Moreover, as illustrated in section 4.2.1,
the methodology allows us to explore complex
research questions such as the characterisation of
children’s strategies for the task of drawing god,
e.g., filling the entire page versus drawing only a
main character or object without background.</p>
      <p>The proposed colour identification method has
also the advantage of being adaptable, as explained
in section 3.2, since the set of micro- and
macrocolours can be easily modified to fit different
research purposes. For instance, as suggested in
section 2, one of these colour sets could be replaced by
a set acquired using machine learning techniques.</p>
      <p>While the methodology was illustrated on data
extracted from the “Drawings of gods” project, it
is in principle applicable to a wide range of visual
databases in other areas of digital humanities, such
as film studies, art history, and so on. For instance,
it would be possible to study the colours used by
a painter during various periods of their life; or to
monitor the evolution of colour variety in cover
pages of a magazine across the seasons.</p>
      <p>
        As a next step, it would be interesting to apply
a filter at the beginning of the process, such as
the Mumford-Shah regulariser proposed by
        <xref ref-type="bibr" rid="ref17">Erdem
and Tari (2009)</xref>
        , which transforms a set of noisy
pixels to a uniform patch. Indeed, when children
(or adults) fill in an area of the sheet with one
colour, the application is not regular and consequently
only part of the pixels of this area are coloured.
      </p>
      <p>●</p>
      <p>Thus, standardising colours by area could be
useful to avoid underestimating a particular colour’s
representation.</p>
    </sec>
    <sec id="sec-6">
      <title>Acknowledgements</title>
      <p>We would like to thank the reviewers for their
constructive feedback. We would also like to thank
Zhargalma Dandarova Robert, Grégory Dessart,
●
●
●
●
●
●
●
●
●
9
●
Olga Serbaeva and Zahra Astaneh for their help in
the definition of the set of macro-colours, as well as
Christine Mohr and Domicele Jonauskaite for the
stimulating discussions about colours in general
and colour definition in particular.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Benavente</surname>
            , Robert,
            <given-names>Maria</given-names>
          </string-name>
          <string-name>
            <surname>Vanrell</surname>
          </string-name>
          , and
          <string-name>
            <surname>Ramon Baldrich</surname>
          </string-name>
          (
          <year>2008</year>
          ).
          <article-title>Parametric fuzzy sets for automatic color naming</article-title>
          .
          <source>J. Opt. Soc. Am. A</source>
          ,
          <volume>25</volume>
          (
          <issue>10</issue>
          ):
          <fpage>2582</fpage>
          -
          <lpage>2593</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <source>doi:10</source>
          .1364/JOSAA.25.002582.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Berlin</surname>
            , Brent and
            <given-names>Paul</given-names>
          </string-name>
          <string-name>
            <surname>Kay</surname>
          </string-name>
          (
          <year>1969</year>
          ).
          <article-title>Basic Color Terms: their Universality and Evolution</article-title>
          . Berkeley and Los Angeles: University of California Press.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Bland</surname>
            , John Martin and
            <given-names>Douglas G.</given-names>
          </string-name>
          <string-name>
            <surname>Altman</surname>
          </string-name>
          (
          <year>1986</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <article-title>Statistical methods for assessing agreement between two methods of clinical measurement</article-title>
          .
          <source>The Lancet</source>
          ,
          <volume>327</volume>
          (
          <issue>8476</issue>
          ):
          <fpage>307</fpage>
          -
          <lpage>310</lpage>
          . doi:
          <volume>10</volume>
          .1016/S0140-
          <volume>6736</volume>
          (
          <issue>86</issue>
          )
          <fpage>90837</fpage>
          -
          <lpage>8</lpage>
          . Originally published as Volume
          <volume>1</volume>
          , Issue 8476.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Brandt</surname>
          </string-name>
          ,
          <string-name>
            <surname>Pierre-Yves</surname>
          </string-name>
          ,
          <article-title>Yuko Kagata Spitteler, and Christiane Gillièron Paléologue (</article-title>
          <year>2009</year>
          ).
          <article-title>La représentation de dieu : Comment les enfants japonais dessinent dieu</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <surname>Archives de Psychologie</surname>
          </string-name>
          ,
          <volume>74</volume>
          :
          <fpage>171</fpage>
          -
          <lpage>203</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Chen</surname>
            , Junqing,
            <given-names>Thrasyvoulos N.</given-names>
          </string-name>
          <string-name>
            <surname>Pappas</surname>
            , Aleksandra Mojsilovic´, and
            <given-names>Bernice E.</given-names>
          </string-name>
          <string-name>
            <surname>Rogowitz</surname>
          </string-name>
          (
          <year>2005</year>
          ).
          <article-title>Adaptive perceptual color-texture image segmentation</article-title>
          .
          <source>IEEE Transactions on Image Processing</source>
          ,
          <volume>14</volume>
          (
          <issue>10</issue>
          ):
          <fpage>1524</fpage>
          -
          <lpage>1536</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <source>doi:10</source>
          .1109/TIP.
          <year>2005</year>
          .
          <volume>852204</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <surname>Cheng</surname>
            , Heng-Da and
            <given-names>Ying</given-names>
          </string-name>
          <string-name>
            <surname>Sun</surname>
          </string-name>
          (
          <year>2000</year>
          ).
          <article-title>A hierarchical approach to color image segmentation using homogeneity</article-title>
          .
          <source>IEEE Transactions on Image Processing</source>
          ,
          <volume>9</volume>
          (
          <issue>12</issue>
          ):
          <fpage>2071</fpage>
          -
          <lpage>2082</lpage>
          . doi:
          <volume>10</volume>
          .1109/83.887975.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>Dandarova</surname>
          </string-name>
          ,
          <string-name>
            <surname>Zhargalma</surname>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>Le dieu des enfants: Entre l'universel et le contextuel</article-title>
          .
          <source>In Pierre-Yves Brandt and James</source>
          Meredith Day, eds.,
          <article-title>Psychologie du développement religieux: Questions classiques et perspectives contemporaines</article-title>
          , pages
          <fpage>159</fpage>
          -
          <lpage>187</lpage>
          . Genève: Labor et Fides.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <given-names>Dandarova</given-names>
            <surname>Robert</surname>
          </string-name>
          , Zhargalma, Grégory Dessart, Olga Serbaeva, Camelia Puzdriac, Mohammad Khodayarifard, Saeed Akbari Zardkhaneh, Saeid Zandi, Elena Petanova, Kevin L.
          <string-name>
            <surname>Ladd</surname>
          </string-name>
          , and
          <string-name>
            <surname>Pierre-Yves Brandt</surname>
          </string-name>
          (
          <year>2016</year>
          ).
          <article-title>A web-based database for drawings of gods.</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <source>Archive for the Psychology of Religion</source>
          ,
          <volume>38</volume>
          (
          <issue>3</issue>
          ):
          <fpage>345</fpage>
          -
          <lpage>352</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <source>doi:10</source>
          .1163/
          <fpage>15736121</fpage>
          -
          <lpage>12341326</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <string-name>
            <surname>Deng</surname>
            , Yining,
            <given-names>B. S.</given-names>
          </string-name>
          <string-name>
            <surname>Manjunath</surname>
          </string-name>
          , Charles Kenney, Michael S. Moore, and
          <string-name>
            <surname>Hyundoo Shin</surname>
          </string-name>
          (
          <year>2001</year>
          ).
          <article-title>An efficient color representation for image retrieval</article-title>
          .
          <source>IEEE Transactions on Image Processing</source>
          ,
          <volume>10</volume>
          (
          <issue>1</issue>
          ):
          <fpage>140</fpage>
          -
          <lpage>147</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <source>doi:10.1109/83</source>
          .892450.
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <string-name>
            <surname>Erdem</surname>
          </string-name>
          , Erkut and Sibel
          <string-name>
            <surname>Tari</surname>
          </string-name>
          (
          <year>2009</year>
          ).
          <article-title>MumfordShah regularizer with contextual feedback</article-title>
          .
          <source>Journal of Mathematical Imaging and Vision</source>
          ,
          <volume>33</volume>
          (
          <issue>1</issue>
          ):
          <fpage>67</fpage>
          -
          <lpage>84</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          <source>doi:10</source>
          .1007/s10851-008-0109-y.
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          <string-name>
            <surname>Fleiss</surname>
            ,
            <given-names>Joseph L</given-names>
          </string-name>
          (
          <year>1971</year>
          ).
          <article-title>Measuring nominal scale agreement among many raters</article-title>
          .
          <source>Psychological bulletin</source>
          ,
          <volume>76</volume>
          (
          <issue>5</issue>
          ):
          <fpage>378</fpage>
          -
          <lpage>382</lpage>
          . doi:
          <volume>10</volume>
          .1037/h0031619.
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          <string-name>
            <surname>Granger</surname>
            ,
            <given-names>G. W.</given-names>
          </string-name>
          (
          <year>1955</year>
          ).
          <article-title>An experimental study of colour preferences</article-title>
          .
          <source>The Journal of General Psychology</source>
          ,
          <volume>52</volume>
          (
          <issue>1</issue>
          ):
          <fpage>3</fpage>
          -
          <lpage>20</lpage>
          . doi:
          <volume>10</volume>
          .1080/00221309.
          <year>1955</year>
          .
          <volume>9918340</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          <string-name>
            <surname>Hanmandlu</surname>
            , Madasu, Om Prakash Verma, Seba Susan, and
            <given-names>V.K.</given-names>
          </string-name>
          <string-name>
            <surname>Madasu</surname>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>Color segmentation by fuzzy co-clustering of chrominance color features</article-title>
          .
          <source>Neurocomputing</source>
          ,
          <volume>120</volume>
          :
          <fpage>235</fpage>
          -
          <lpage>249</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          <source>doi:10</source>
          .1016/j.neucom.
          <year>2012</year>
          .
          <volume>09</volume>
          .043.
          <article-title>Image Feature Detection and Description</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          <string-name>
            <surname>Hu</surname>
          </string-name>
          ,
          <article-title>Yu-Chen and</article-title>
          <string-name>
            <surname>Ming-Gong Lee</surname>
          </string-name>
          (
          <year>2007</year>
          ).
          <article-title>K-meansbased color palette design scheme with the use of stable flags</article-title>
          .
          <source>Journal of Electronic Imaging</source>
          ,
          <volume>16</volume>
          (
          <issue>3</issue>
          ):
          <fpage>033003</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          <source>doi:10.1117/1</source>
          .2762241.
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          <string-name>
            <surname>Jonauskaite</surname>
          </string-name>
          , Domicele, Christine Mohr,
          <string-name>
            <surname>Jean-Philippe</surname>
            <given-names>Antonietti</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Peter M. Spiers</surname>
          </string-name>
          , Betty Althaus, Selin Anil, and
          <string-name>
            <surname>Nele Dael</surname>
          </string-name>
          (
          <year>2016</year>
          ).
          <article-title>Most and least preferred colours differ according to object context: New insights from an unrestricted colour range</article-title>
          .
          <source>PLOS ONE</source>
          ,
          <volume>11</volume>
          (
          <issue>3</issue>
          ):
          <fpage>1</fpage>
          -
          <lpage>22</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          <source>doi:10</source>
          .1371/journal.pone.
          <volume>0152194</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          <string-name>
            <surname>Khan</surname>
          </string-name>
          , Rahat, Joost Van de Weijer, Fahad Shahbaz Khan, Damien Muselet, Christophe Ducottet, and
          <string-name>
            <surname>Cecile Barat</surname>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>Discriminative color descriptors</article-title>
          .
          <source>In 2013 IEEE Conference on Computer Vision and Pattern Recognition</source>
          , pages
          <fpage>2866</fpage>
          -
          <lpage>2873</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          <source>doi:10</source>
          .1109/CVPR.
          <year>2013</year>
          .
          <volume>369</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          <string-name>
            <surname>Kim</surname>
            , Seong-in, Jun Bae, and
            <given-names>Youngho</given-names>
          </string-name>
          <string-name>
            <surname>Lee</surname>
          </string-name>
          (
          <year>2007</year>
          ).
          <article-title>A computer system to rate the colorrelated formal elements in art therapy assessments</article-title>
          .
          <source>The Arts in Psychotherapy</source>
          ,
          <volume>34</volume>
          (
          <issue>3</issue>
          ):
          <fpage>223</fpage>
          -
          <lpage>237</lpage>
          . doi:
          <volume>10</volume>
          .1016/j.aip.
          <year>2007</year>
          .
          <volume>02</volume>
          .002.
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          <string-name>
            <surname>Konyushkova</surname>
          </string-name>
          , Ksenia, Nikolaos Arvanitopoulos, Zhargalma Dandarova Robert,
          <string-name>
            <surname>Pierre-Yves Brandt</surname>
          </string-name>
          , and
          <string-name>
            <surname>Sabine Süsstrunk</surname>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>God(s) know(s): Developmental and cross-cultural patterns in children drawings</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>URL http://arxiv.org/abs/1511.03466.</mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          <string-name>
            <surname>Lindner</surname>
          </string-name>
          , Albrecht and Sabine
          <string-name>
            <surname>Süsstrunk</surname>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>Automatic color palette creation from words</article-title>
          .
          <source>In Society for Imaging Science</source>
          and Technology, eds.,
          <source>Proceedings of the IS&amp;T 21st Color and Imaging Conference</source>
          , pages
          <fpage>69</fpage>
          -
          <lpage>74</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          <string-name>
            <surname>Munsell</surname>
            ,
            <given-names>Albert H.</given-names>
          </string-name>
          (
          <year>1912</year>
          ).
          <article-title>A pigment color system and notation</article-title>
          .
          <source>The American Journal of Psychology</source>
          ,
          <volume>23</volume>
          (
          <issue>2</issue>
          ):
          <fpage>236</fpage>
          -
          <lpage>244</lpage>
          . doi:
          <volume>10</volume>
          .2307/1412843.
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          <string-name>
            <surname>Pastoureau</surname>
          </string-name>
          ,
          <string-name>
            <surname>Michel</surname>
          </string-name>
          (
          <year>2017</year>
          ).
          <article-title>Une couleur ne vient jamais seule : journal chromatique 2012-2016</article-title>
          .
          <article-title>La librairie du XXIe siècle</article-title>
          . Paris: Éditions du Seuil.
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          <string-name>
            <surname>Rao</surname>
            ,
            <given-names>Nitta</given-names>
          </string-name>
          <string-name>
            <surname>Gnaneswara</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          <string-name>
            <surname>Ramakrishna Sajja</surname>
            , and
            <given-names>V.</given-names>
          </string-name>
          <string-name>
            <surname>Vijaya Kumar</surname>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>An innovative approach of retrieval of people images</article-title>
          .
          <source>International Journal of Applied Engineering Research</source>
          ,
          <volume>10</volume>
          (
          <issue>8</issue>
          ):
          <fpage>21175</fpage>
          -
          <lpage>21184</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          <string-name>
            <surname>Shannon</surname>
            ,
            <given-names>Claude E.</given-names>
          </string-name>
          (
          <year>1948</year>
          ).
          <article-title>A mathematical theory of communication</article-title>
          .
          <source>Bell Systems Technical Journal</source>
          ,
          <volume>27</volume>
          :
          <fpage>379</fpage>
          -
          <lpage>423</lpage>
          . doi:
          <volume>10</volume>
          .1002/j.1538-
          <fpage>7305</fpage>
          .
          <year>1948</year>
          .tb01338.x.
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          <string-name>
            <surname>Sun</surname>
          </string-name>
          , Junding, Ximin Zhang, Jiangtao Cui, and
          <string-name>
            <surname>Lihua Zhou</surname>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>Image retrieval based on color distribution entropy</article-title>
          .
          <source>Pattern Recognition Letters</source>
          ,
          <volume>27</volume>
          (
          <issue>10</issue>
          ):
          <fpage>1122</fpage>
          -
          <lpage>1126</lpage>
          . doi:
          <volume>10</volume>
          .1016/j.patrec.
          <year>2005</year>
          .
          <volume>12</volume>
          .014.
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          <string-name>
            <surname>Tweedie</surname>
            ,
            <given-names>Fiona J.</given-names>
          </string-name>
          and
          <string-name>
            <given-names>R.</given-names>
            <surname>Harald Baayen</surname>
          </string-name>
          (
          <year>1998</year>
          ).
          <article-title>How variable may a constant be? Measures of lexical richness in perspective</article-title>
          .
          <source>Computer and the Humanities</source>
          ,
          <volume>32</volume>
          :
          <fpage>323</fpage>
          -
          <lpage>352</lpage>
          . doi:
          <volume>10</volume>
          .1023/A:
          <fpage>1001749303137</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref39">
        <mixed-citation>
          <string-name>
            <surname>Van de Weijer</surname>
          </string-name>
          , Joost, Cordelia Schmid, Jakob Verbeek, and
          <string-name>
            <surname>Diane Larlus</surname>
          </string-name>
          (
          <year>2009</year>
          ).
          <article-title>Learning color names for real-world applications</article-title>
          .
          <source>IEEE Transactions on Image Processing</source>
          ,
          <volume>18</volume>
          (
          <issue>7</issue>
          ):
          <fpage>1512</fpage>
          -
          <lpage>1523</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref40">
        <mixed-citation>
          <source>doi:10</source>
          .1109/TIP.
          <year>2009</year>
          .
          <volume>2019809</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref41">
        <mixed-citation>
          <string-name>
            <surname>Yendrikhovskij</surname>
            ,
            <given-names>Sergej N.</given-names>
          </string-name>
          (
          <year>2001</year>
          ).
          <article-title>Computing color categories from statistics of natural images</article-title>
          .
          <source>Journal of Imaging Science and Technology</source>
          ,
          <volume>45</volume>
          (
          <issue>5</issue>
          ):
          <fpage>409</fpage>
          -
          <lpage>417</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref42">
        <mixed-citation>
          <string-name>
            <surname>Zentner</surname>
          </string-name>
          ,
          <string-name>
            <surname>Marcel</surname>
            <given-names>R.</given-names>
          </string-name>
          (
          <year>2001</year>
          ).
          <article-title>Preferences for colours and colour-emotion combinations in early childhood</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref43">
        <mixed-citation>
          <string-name>
            <given-names>Developmental</given-names>
            <surname>Science</surname>
          </string-name>
          ,
          <volume>4</volume>
          :
          <fpage>389</fpage>
          -
          <lpage>398</lpage>
          . doi:
          <volume>10</volume>
          .1111/
          <fpage>1467</fpage>
          -
          <lpage>7687</lpage>
          .
          <fpage>00180</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref44">
        <mixed-citation>
          <string-name>
            <surname>Zhang</surname>
            , Liang, Liqiang Zhang, Xiaojing Yao,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Takis Mathiopoulos</surname>
          </string-name>
          , and Chunming Han (
          <year>2016</year>
          ).
          <article-title>Joint shape and color descriptors for 3D urban model retrieval</article-title>
          .
          <source>International Journal of Digital Earth</source>
          ,
          <volume>9</volume>
          (
          <issue>11</issue>
          ):
          <fpage>1117</fpage>
          -
          <lpage>1134</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref45">
        <mixed-citation>
          <source>doi:10.1080/17538947</source>
          .
          <year>2016</year>
          .
          <volume>1171404</volume>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>