<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Learning Embeddings for Product Size Recommendations</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Kallirroi Dogani∗</string-name>
          <email>kallirroi.dogani@asos.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Matteo Tomassetti∗</string-name>
          <email>matteo.tomassetti@asos.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sofie De Cnudde</string-name>
          <email>sofiede.cnudde@asos.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Saúl Vargas</string-name>
          <email>saul.vargassandoval@asos.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ben Chamberlain</string-name>
          <email>ben.chamberlain@asos.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Recommender Systems, Representation Learning, Transfer Learn-</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>ASOS.com</institution>
          ,
          <addr-line>London</addr-line>
          ,
          <country country="UK">UK</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>ing</institution>
          ,
          <addr-line>E-Commerce</addr-line>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2019</year>
      </pub-date>
      <abstract>
        <p>Despite significant recent growth in online fashion retail, choosing product sizes remains a major problem for customers. We tackle the problem of size recommendation in fashion e-commerce with the goal of improving customer experience and reducing financial and environmental costs from returned items. We propose a novel size recommendation system that learns a latent space for product sizes using only past purchases and brand information. Key to the success of our model is the application of transfer learning from a brand to a product level. We develop a neural collaborative filtering model that is applicable to every product, without requiring specific customer or product measurements or explicit customer feedback on the purchased sizes, which are not available for most customers or products. Ofline experiments using data from a major retailer show improvements of between 4-40 % over the matrix factorisation baseline.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>INTRODUCTION</title>
      <p>
        Providing customers with accurate size guidance is one of the main
challenges in the online fashion industry. Since customers can not
try garments before purchasing them, e-commerce platforms often
adopt free return policies to motivate customers to purchase items
regardless of concerns about size. This effectively turns homes into
fitting rooms and encourages customers to order multiple sizes of
the same product and return the items that do not fit. According
to a recent estimate [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], 15-40 % of online purchases are returned,
∗Both authors contributed equally to this research.
with an even higher average return rate of 30-40 % for fashion
products. It is desirable to minimise returns as the process incurs
high operational and environmental costs.
      </p>
      <p>
        The size problem can not be solved by simply mapping between
diferent sizing schemes such as mapping a EUR shoe size 45 to a
UK size 11. There are two reasons for this: (1) inconsistent sizes, for
example a men’s US size 8 shoe is 10 inches for a Nike trainer [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]
while an Adidas trainer measures 10.2 inches [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], (2) simple sizes
mask the complexity of the underlying products. For instance, a
t-shirt will be sold as small, medium or large, but the size is at
least seven dimensional∗ and there is no standardisation of these
dimensions, even for a given brand.
      </p>
      <p>Personalised size recommendations provide a general solution
to the size and fit problem. However, the development of a size
recommendation system is accompanied by a number of challenges,
which we address in our model. Firstly, physical measurements of
customers and products are generally not available. Secondly, data
indicating that a return was due to incorrect sizing is often missing
or unreliable, as it is optionally collected from customers without
verification. Thirdly, the presence of an additional size variable
makes the data sparser than would be expected in the equivalent
product recommendations problem. Finally, the existence of
diferent sizing schemes (e.g. EU, UK, US etc.) introduces heterogeneous
data, which must be compared in some way.</p>
      <p>We propose the Product Size Embedding (PSE) model, which
is a neural collaborative filtering approach that learns a latent
representation for all the possible size variations of products and
customers’ sizing preferences using solely purchase data. By doing
so we handle problems with missing physical measurements or
returns reasons. We map all sizes into a common continuous latent
space, which neatly overcomes heterogeneity in sizing schemes and
addresses the inconsistency in sizes that would be hard to address
with a discrete combinatorial representation†. To deal with sparsity,
we first solve the problem at a brand level by accepting the loose
assumption that sizing within the same brand is consistent. Then,
we transfer this knowledge onto a product level, where sizes of
products within the same brand now have separate representations.
Our main contributions are:
• A novel size recommendation system that maps sizes into a
single latent space without requiring customer or product
∗neck circumference, arm circumference, arm length, height, chest circumference,
waist circumference, shoulder width
†such as mapping products to a discrete platonic size scale
physical measurements or explicit customers’ feedback on
returned items (e.g. too big/small). Our model leads to an
improvement of between 4-40 % when compared to the matrix
factorisation baseline.
• We show that transferring knowledge learned from a higher
level (brands) leads to improved and generalised solutions
at a lower level (products).
• We introduce a method to filter out multiple personas from
our dataset. Our solution is independent of fixed thresholds
or empirically-tuned hyperparameters.</p>
      <p>The rest of the paper is structured as follows: Section 2 presents
previous related work, Section 3 introduces our proposed model
and Section 4 describes how we handle accounts used by multiple
personas. Finally, in Section 5 we discuss our experiments and the
performance of our model.
2</p>
    </sec>
    <sec id="sec-2">
      <title>RELATED WORK</title>
      <p>
        The size recommendation problem has been previously studied in
[
        <xref ref-type="bibr" rid="ref13 ref18 ref19 ref20 ref4 ref8">4, 8, 13, 18–20</xref>
        ]. Specifically, [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] models the size prediction task
as an ordinal regression problem, where the customer and
product true sizes are learned by taking their diferences and feeding
them into a linear model. [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ] extends the work of [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] with a
Bayesian logit and probit regression model with ordinal categories.
The posterior distribution over customer and product true sizes
is based on mean-field variational inference with Polya-Gammma
augmentation. The Bayesian approach allows the use of priors for
handling data sparsity and the computation of confidence intervals
for dealing with noisy data. Both [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] and [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ] generate ordinal
categorical variables based on explicit customer feedback on
returned items (e.g. too small, too big or no return). [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] proposes a
Bayesian model that learns the joint probability of a customer
purchasing a given product size and the resulting return status being
either too small, too big or no return. The probability distribution
over sizes is conditioned on the return status and the probability
over return statuses is modeled as the empirical distribution over
the three possible return events along with a Dirichlet prior based
on the counts at the brand and category level. [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] learns a latent
space for customers and products by applying ordinal regression.
A fitness score is computed for each purchase and size ordering is
enforced based on customer’s feedback on the purchased size (i.e.
too small, too big or a good fit). In order to handle class imbalances,
metric learning techniques are applied to transform data into a
space where purchases of the same class are closer and purchases
of diferent classes are separated by a margin.
      </p>
      <p>
        There are two additional studies [
        <xref ref-type="bibr" rid="ref20 ref4">4, 20</xref>
        ] that tackle the size and
ift problem. [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] learns latent product features using Word2Vec [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]
and feeds them into a Gradient Boosting classifier along with
additional product features (e.g physical measurements, colour, etc.).
However, additional product features are often dificult to obtain
[
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. Finally, [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ] extends [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] to the specific case of footwear size
recommendations and also proposes a probabilistic graphical approach
that exploits brand similarities.
      </p>
      <p>
        In literature covering the size recommendation problem, multiple
approaches have been employed to reduce noise by identifying
multiple personas. The approaches vary from using empirically
determined thresholds on the range of purchased sizes to more
complex statistical models. [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] filters out users where the mean and
standard deviation of the purchased sizes exceeds a category-level
threshold. [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] uses a hierarchical clustering method where clusters
are iteratively merged as long as the standard deviation of the
cluster does not exceed an empirically determined threshold. Each
persona is then treated as a separate customer in the subsequent
prediction problem. An improvement to the latter work is made
in [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ], where a persona distribution is drawn from a Dirichlet
distribution. Latent variables related to the specific persona are
then appended to each purchase transaction. Finally, [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] follows
a Gaussian kernel density estimation approach which is further
refined to a Gaussian mixture model. Two assumptions are made
here: (i) the maximum number of personas is fixed at four, and (ii)
the case where only one persona is active is deemed more likely.
Each identified persona is subsequently retained in the dataset.
A similar problem is tackled in literature focused on identifying
active household members in online rental services [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Contextual
variables such as day of week or time of day are used to identify
which member is responsible for which actions and which member
is active at a certain point in time.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>THE PRODUCT SIZE EMBEDDING MODEL</title>
      <p>
        The Product Size Embedding (PSE) model follows a neural
collaborative filtering approach to learn embeddings for each product-size
combination. The main advantage of the PSE over related latent
variable models (e.g. [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]) is that it does not rely on noisy and sparse
customer feedback on the returned items (i.e. customers optionally
reporting that the item was too big / small). Instead, only implicit
signals are used; the products that are purchased and the subset
that are returned.
      </p>
      <p>
        Collaborative filtering [
        <xref ref-type="bibr" rid="ref17 ref9">9, 17</xref>
        ] uses customer-product interactions
and is based on the assumption that customers buying similar
products have similar tastes. This principle naturally translates into the
size and fit domain as "customers with similar body shapes tend
to buy clothes in similar sizes". Matrix factorisation approaches,
such as the one proposed by Hu et al. [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], have been proposed to
capture the latent taste/preference/style space as reflected by the
interactions between customers and products. Matrix factorisation
decomposes customer-product interaction matrices into low-rank
user and item matrices that represent, respectively, customers and
products as vectors in a latent space that captures preferences and
styles. Our proposed PSE model similarly represents customers and
product sizes in a vector space. However, there are two important
diferences between our approach and most matrix factorisation
approaches. Firstly, we learn a latent space at a product size level
instead of at a product level i.e. we have a diferent vector for every
possible size of a product. Secondly, we adopt an asymmetric
framework [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] so that users are not represented explicitly, but as the
aggregate of the product vectors with which they have interacted.
Accordingly, we train diefrent models for each product category
(tops, bottoms or shoes), so all trained embeddings belong to the
same category and the learned latent space represents the same
body part. The asymmetric approach eliminates learning an
embedding layer for customers, which greatly reduces the number of
parameters. For example, the symmetric approach for menswear
shoes requires ∼ 780K product size and ∼ 3M customer
parameters, therefore the asymmetric model is approximately vfie times
smaller. Another advantage of the asymmetric approach is that the
model does not require retraining for new customers since their
representations can be inferred from their purchase history. The
architecture for the PSE model is shown in Figure 1.
      </p>
      <p>We model size recommendation as a multi-class classification
task. Given a user u and a product p, the task is to predict the
customers’ size in that product, ps∗. This difers from standard
multiclass classification as each product is only available in a small subset
of all possible size classes (t-shirts don’t come in shoe sizes etc.).</p>
      <p>The input to the model is a set of user purchase histories, Hu .
For every customer we create a sequence of previously purchased
(and not returned) product sizes {ps1, ps2, ...psn }. For a sequence
on length n, the nth product-size is the target and the previous n − 1
products are used to construct a customer vector. Each product-size
in the history indexes into an embedding matrix using a neural
network embedding layer to produce a product-size vector Vps ∈
Rk . User vectors Vu ∈ Rk are constructed by taking the first n −
1 product-sizes in the Hu , retrieving the associated product-size
vectors and taking the mean</p>
      <p>Vu =</p>
      <p>1
n − 1</p>
      <p>Õ
ps ∈Hu\n</p>
      <p>Vps ,
(1)
where Hu\n is the history minus the target size-product. In practice,
to increase the amount of training data, for each Hu we will create
user and product vectors from all contiguous subsequences of length
k where the first (k-1) elements form a customer vector and the
kth is the target product-size. The similarity τ between customers
and product-sizes is given by the dot product between the user and
product vectors</p>
      <p>τu,ps = VTu Vps ,
and product size probabilities are computed as the softmax of the
similarity scores normalised over all sizes of the given product
f (τ )u,pi = P (s = i |u, p) =</p>
      <p>eτu,pi
Íj eτu,pj
where the index j runs over all possible sizes of product p. To
evaluate this softmax we require the product-size vectors for ps ∀s,
which are stored in a key-value stored keyed on the product id.</p>
      <p>
        The PSE is trained in Keras using the Adam optimiser [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] with
parameters α = 0.001, b1 = 0.9, b2 = 0.999 and the categorical
cross-entropy loss
      </p>
      <p>L = −
Õ Õ
j</p>
      <p>tj log(f (τ )u,pj ) , tj =</p>
      <p>D
where D is the extended set of purchase histories and s is the
purchased size.
3.1</p>
    </sec>
    <sec id="sec-4">
      <title>Transfer from Brands to Products</title>
      <p>
        As we model product-size combinations instead of just products,
our product-size interaction matrix is roughly ten times sparser (e.g.
( 1 if j = s
0 otherwise
(2)
(3)
(4)
from ∼ 3×10−4 to ∼ 4×10−5 for menswear shoes) than the data used
for product recommendations. As a result, learning representations
for all possible product-size combinations is challenging. Transfer
learning is a popular technique to generalise from small datasets to
larger ones [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. We assume that each brand has consistent sizes
and we learn latent representations Vbs for every combination of
brand b = {p} and size s. Then, we transfer this knowledge to a
product level by initialising
      </p>
      <p>Vps = Vbs , ∀ps ∈ bs .
(5)</p>
      <p>As shown in Figure 2, we train the model at a brand size level,
then we initialise the product size vectors Vps with the trained
brand size vectors Vbs and finally we train the model at a product
size level to fine tune the product size vectors. Applying the
pretrained brand size vectors at a product level improves generalisation,
boosts performance and leads to faster convergence. In Section 5.3,
we demonstrate the improvements transfer learning ofers over
random initialisation of latent vectors.
4</p>
    </sec>
    <sec id="sec-5">
      <title>DETECTING MULTIPLE PERSONAS</title>
      <p>
        A major challenge in the design of recommender systems is
identifying accounts that are shared across multiple users. Some services,
such as Netflix [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], solve this problem by creating explicit user
profiles for each persona. In our work, user profiles are not viable
and so we detect multiple personas as a preprocessing step.
      </p>
      <p>
        To detect multiple personas we employ a Gaussian Mixture
Model (GMM) [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] that predicts the number of individuals
using an account and identifies each persona’s purchases. Our
proposed method is independent of assumption-based thresholds or
empirically-tuned hyperparameters. When we detect an account
with multiple personas, we subsequently remove it from both
training and test sets.
      </p>
      <p>Our GMM approach is based on the assumption that the
purchases of every persona are centred around a core size. Customers
with at least two purchases and with a size diference ‡ larger than
one, are potential candidates for the multiple persona detection
process. The output of the GMM consists of a mixture of components,
each representing a diferent persona in the purchase history. Each
component (or persona) is represented by a Gaussian distribution,
whose mean µ corresponds to the persona’s core size.</p>
      <p>
        Since the number of personas λ using an account is unknown, we
employ the silhouette score sλ [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] to find the optimal number of
mixture components λopt (see Algorithm 1). The silhouette score is
a cluster evaluation metric that measures how well each purchased
size is clustered with similar purchased sizes. An sλ ≈ 1 implies
non-overlapping clusters with high density, while sλ = 0 points to
overlapping clusters.
      </p>
      <p>Algorithm 1 Algorithm for multiple persona detection
Input: purchase history Hu
Output: λopt persona
λ ← 2
sλ−1 ← 0
sλ = getSilhouetteScore(GMM(Hu , λ))</p>
      <p>λ
while sλ &gt; sλ−1 and i, jm=1i;ni,j |µ i − µ j | &gt; 1 do
λ = λ + 1
sλ ← getSilhouetteScore(GMM(Hu , λ))
end while
λopt = λ − 1</p>
      <p>The process of identifying multiple personas consists of running
the GMM to detect λ personas within Hu and calculating the
silhouette score sλ associated with that mixture. The parameter λ
‡We have ordered each sizing scheme from the smallest to the largest size found in our
dataset and defined a set of sizing indexes. For examples, the sizing index for the sizing
scheme CAT ranges from 0 (3XS) to 25 (8XL). When referring to the size diference
between two sizes, we mean their diference when mapped to the sizing index.
is iteratively increased as long as (i) sλ is higher than sλ−1, and
(ii) the core size of each mixture component difers by at least 1
size unit. When the iterative process is finished, λopt is set to λ
and if λopt &gt; 1 that customer is identified as buying for multiple
personas.</p>
      <p>While dealing with the multiple persona problem, two additional
issues arise: i) the problem of resellers, and ii) the issue of purchases
in multiple sizing schemes. Resellers are customers who purchase
products with the intention of reselling them, so it is likely that
their purchases cover a wider range of sizes. In that case, a Gaussian
mixture model is not suitable for detecting them, as their purchases
are not centred around a core size, but instead have a uniform
distribution. Therefore, prior to performing multiple persona detection,
we eliminate all customers with a uniform purchase history.</p>
      <p>To apply the GMM model, we first need to convert all sizes into
a single sizing scheme. Since most existing conversion tables are
incomplete and inaccurate, we have used the data to approximate
size conversions. Specifically, we build a co-purchase matrix per
product category between two sizing schemes and we convert sizes
according to the highest co-purchase frequency. Note that this
conversion is only an approximation for data cleaning purposes
and is not used in the final size prediction model.</p>
      <p>Table 1 lists examples of purchase histories that are flagged as
either multiple personas or resellers.</p>
    </sec>
    <sec id="sec-6">
      <title>EXPERIMENTS AND RESULTS</title>
      <p>In this section, we first describe the experimental setup, then detail
the baselines for comparison and finally present our results. Our
experiments are based on data from a major online retailer collected
over one year. We have grouped all products into three categories
(Tops, Bottoms and Shoes), two genders (menswear (MW) and
womenswear (WW)), and six sizing schemes (see Table 2).</p>
      <p>The size recommendation problem is solved independently for
each product category-gender combination e.g. menswear-tops.
Table 3 shows example product types that comprise each product
category as well as the supported sizing schemes and high-level
statistics. Products originate from a large and diverse network of
international suppliers, with thousands of new items added weekly
and so in general, physical measurements of products are not
available.
5.1</p>
    </sec>
    <sec id="sec-7">
      <title>Experimental Setup</title>
      <p>Since we solve the size prediction problem separately for each
product category, the purchase history Hu has been computed
using all previous purchases of customer u from the same product
category (i.e. we do not use past purchases of shoes to predict sizes
for tops). We exclude any returned products from the purchase
history as there is no data specifying whether items are returned
due to poor fit or for other reasons.</p>
      <p>Table 4 shows examples of the same purchase history computed
at diferent levels. In this case, applying transfer learning from
the brand level to the product level means that we initialise the
product size vector id43498_W34inL32in with the brand size vector
Levis_W34inL32in.</p>
      <p>We divide the dataset for each product category into a training
and a test set using an 80:20 split.
5.2</p>
    </sec>
    <sec id="sec-8">
      <title>Comparison Methods</title>
      <p>
        We compare the performance of the following personalised
methods:
• MCS-SS. This method predicts the user’s most common size
(MCS) given the sizing scheme (SS) of product p. For instance,
if Hu = (id1432_UK8, id1564_UK8, id1055_UK9, id1453_EU36)
is the purchase history of user u, this method predicts UK8
for products available in UK sizes and EU36 for products
available in EU sizes. If there is a tie, MCS-SS predicts the
most recent purchased size.
• ALS. This is a symmetric matrix factorisation model
optimized through alternating least squares [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ].
• LR. This is a multi-class Logistic Regression classifier that
takes as input the normalised counts of the purchased sizes
and one-hot encoded features for the product type, brand
and sizing scheme.
• PSE-B. Version of the PSE model where the size embeddings
are learned at a brand level.
• PSE-BPT. Version of the PSE model where the size
embeddings are learned at a brand and product type level.
• PSE. The size embeddings are learned at a product level.
• t-PSE-BPT. The size embeddings are learned at a brand and
product type level and the embedding layer is initialised with
the latent space learned from PSE-B.
• t-PSE. This is our proposed PSE model. The size embeddings
are learned at a product level and the embedding layer is
initialised with the latent space learned from PSE-B.
      </p>
      <p>We cannot compare our model against other size
recommendation algorithms recently published as they require extra data
sources that are not always available (i.e. the return reason). Our
model is more generic and could be applied to any fashion dataset.</p>
      <p>All PSE experiments have been run with a fixed latent space
dimension k = 10. We have explored the dependency of this
parameter on our results and found no statistically significant diference
when adopting a higher k (see Fig. 4).
5.3</p>
    </sec>
    <sec id="sec-9">
      <title>Results</title>
      <p>The results of our experiments are summarised in Table 5. All
variations of the PSE model outperform the baselines. We observe that
the accuracy increases when the size embeddings are learned at a
brand and product type level (PSE-BPT) as opposed to the brand
level (PSE-B). However, when latent representations are learned
at a product size level (PSE), the accuracy drops for some product
categories. If we consider the case of menswear shoes, the
number of latent vectors we need to train increases from 1.4K (PSE-B)
to 77.9K (PSE), therefore the latent space becomes sparser which
makes the model prone to overfitting (Figure 5). To overcome this
issue, we have used latent representations learned from PSE-B to
initialise the embedding layer in tPSE-BPT and tPSE. The results
show that transfer learning improves generalisation and leads to
more accurate predictions.</p>
      <p>Table 7 shows examples where the tPSE model successfully
predicts sizes that are not included in the purchase history, illustrating
the benefits of learning latent size representations.</p>
      <p>To better understand how tPSE performs in diferent scenarios,
we have evaluated the model on purchase histories of diferent</p>
      <p>Product Category</p>
      <p>Hitrate@2</p>
      <p>Hitrate@3
lengths. Figure 6a shows that the accuracy for menswear shoes
increases as more items are present in the purchase history. We
observe that the accuracy of the model for purchase histories with
six or more items is more than 75%. However, this occurs for less
than 10% of the data (Figure 6b). The same figure shows that more
than 50% of the customers only have one item in their purchase
history, which is not suficient to accurately learn the customer’s
true size. We observe similar trends for all other product categories.</p>
      <p>To confirm that our model does not deviate significantly from the
purchased size, we have also evaluated the Hitrate@K, defined as
the fraction of times the correct size is within the top K predictions.
To retrieve the top K recommended sizes, we rank the predictions
based on the similarity scores between the user vector Vu and the
product size vectors Vps . Hitrate@2 ranges between 85-92% for all
product categories (Table 6) and can explain cases where customers
may be in between two sizes. For instance, both sizes S and M could
ift well, but the customer has to pick just one when completing a
purchase.
5.4</p>
    </sec>
    <sec id="sec-10">
      <title>Analysis on the Latent Space</title>
      <p>
        Figures 7 and 8 show instances of the latent representations mapped
onto a 3D space using the t-SNE technique for dimensionality
reduction [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]. Specifically, Figure 7 shows the menswear shoes graph
constructed by retrieving the closest vectors to redtape_UK8. The
area around redtape_UK8 contains brands of size UK8. The
neighbourhood in the upper-left corner consists of UK7 sizes, while the
area in the bottom-right corner is constructed mainly with UK9
sizes. In the gap between these three big clusters, we observe the
half sizes UK7.5 and UK8.5, which show the transitions from the
UK8 cluster to the UK7 and UK8 neighbourhood, respectively. In a
similar context, Figure 8 shows the latent space of sizes for
womenswear tops. The size representations are sorted in ascending
order, starting with XS sizes in the upper-right corner and ending
with the cluster of XL sizes in the bottom-right corner. Additionally,
we observe that same or similar sizes from diferent sizing schemes
(e.g. XS and UK6) are mapped into the same neighbourhoods of
the latent space. Both figures confirm the assumption that similar
purchased sizes correspond to customers with similar body
measurements. Based on this assumption, we can use customer-product
interactions to learn a latent space for size representations.
6
      </p>
    </sec>
    <sec id="sec-11">
      <title>CONCLUSION</title>
      <p>We introduced the Product Size Embedding (PSE) model, a novel
approach to solve the size recommendation problem in fashion
e-commerce. The PSE model requires only customer-product
interactions and brand information without needing explicit customer
(a) Accuracy of tPSE as a function of the number of items in (b) Distribution of the length of the purchase history Hu .
the purchase history. The dataset is dominated by customers with only one
purchased item.
feedback on the returned items (i.e the item was too big or too
small). Our ofline evaluation on a large-scale e-commerce dataset
shows that mapping product sizes into a single latent space leads
to more accurate size predictions over a range of diferent
baselines. In addition, we have demonstrated the advantages of transfer
learning and how knowledge learned at a brand level boosts the
performance of the model at a product level. Finally, we have
proposed a technique to identify multiple personas in the purchase
history and applied it to reduce the noise in our data.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <fpage>2019</fpage>
          .
          <article-title>Adidas Size Chart for Men's Shoes | adidas UK</article-title>
          . https://www.adidas.co.uk/ help/size_charts. Accessed:
          <fpage>2019</fpage>
          -01-20.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <fpage>2019</fpage>
          .
          <article-title>Finding a Fix for Retail's Trillion-Dollar Problem: Returns</article-title>
          . https://www.cnbc.com/
          <year>2019</year>
          /01/10/growing-online
          <article-title>-sales-means-morereturns-and-trash-for-landfills</article-title>
          .html. Accessed:
          <fpage>2019</fpage>
          -01-20.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <fpage>2019</fpage>
          .
          <article-title>Nike.com Size Fit Guide - Men's Shoes</article-title>
          . https://www.nike.com/us/en_us/c/ size-fit
          <article-title>-guide/mens-shoe-sizing-chart</article-title>
          .
          <source>Accessed: 2019-01-20.</source>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>G. Mohammed</given-names>
            <surname>Abdulla</surname>
          </string-name>
          and
          <string-name>
            <given-names>Sumit</given-names>
            <surname>Borar</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Size Recommendation System for Fashion E-Commerce</article-title>
          .
          <source>In KDD Workshop on Machine Learning Meets Fashion.</source>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>Pedro</surname>
            <given-names>G.</given-names>
          </string-name>
          <string-name>
            <surname>Campos</surname>
            , Alejandro Bellogin, Fernando Díez, and
            <given-names>Iván</given-names>
          </string-name>
          <string-name>
            <surname>Cantador</surname>
          </string-name>
          .
          <year>2012</year>
          .
          <article-title>Time Feature Selection for Identifying Active Household Members</article-title>
          .
          <source>In Proceedings of the 21st International Conference on Information and Knowledge Management (CIKM '12)</source>
          . ACM, pp.
          <fpage>2311</fpage>
          -
          <lpage>2314</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>Ângelo</given-names>
            <surname>Cardoso</surname>
          </string-name>
          , Fabio Daolio, and
          <string-name>
            <given-names>Saúl</given-names>
            <surname>Vargas</surname>
          </string-name>
          .
          <year>2018</year>
          .
          <article-title>Product Characterisation towards Personalisation: Learning Attributes from Unstructured Data to Recommend Fashion Products</article-title>
          .
          <source>In Proceedings of the 24th International Conference on Knowledge Discovery &amp; Data Mining (KDD '18)</source>
          . ACM, pp.
          <fpage>80</fpage>
          -
          <lpage>89</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>Carlos</surname>
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Gomez-Uribe</surname>
            and
            <given-names>Neil</given-names>
          </string-name>
          <string-name>
            <surname>Hunt</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>The Netflix Recommender System: Algorithms, Business Value, and Innovation</article-title>
          .
          <source>ACM Transactions on Management Information Systems (TMIS) 6</source>
          ,
          <issue>4</issue>
          (
          <year>2016</year>
          ), pp.
          <fpage>13</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>Romain</given-names>
            <surname>Guigourès</surname>
          </string-name>
          , Yuen King Ho, Evgenii Koriagin,
          <string-name>
            <surname>Abdul-Saboor</surname>
            <given-names>Sheikh</given-names>
          </string-name>
          , Urs Bergmann, and
          <string-name>
            <given-names>Reza</given-names>
            <surname>Shirvany</surname>
          </string-name>
          .
          <year>2018</year>
          .
          <article-title>A Hierarchical Bayesian Model for Size Recommendation in Fashion</article-title>
          .
          <source>In Proceedings of the 12th Conference on Recommender Systems (RecSys '18)</source>
          . ACM, pp.
          <fpage>392</fpage>
          -
          <lpage>396</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>Yifan</given-names>
            <surname>Hu</surname>
          </string-name>
          , Yehuda Koren, and
          <string-name>
            <given-names>Chris</given-names>
            <surname>Volinsky</surname>
          </string-name>
          .
          <year>2008</year>
          .
          <article-title>Collaborative Filtering for Implicit Feedback Datasets</article-title>
          .
          <source>In Proceedings of the 8th International Conference on Data Mining (ICDM '08)</source>
          . IEEE, pp.
          <fpage>263</fpage>
          -
          <lpage>272</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Diederik</surname>
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Kingma</surname>
            and
            <given-names>Jimmy</given-names>
          </string-name>
          <string-name>
            <surname>Ba</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>Adam: A Method for Stochastic Optimization</article-title>
          .
          <source>arXiv preprint arXiv:1412.6980</source>
          (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Bruce</surname>
            <given-names>G.</given-names>
          </string-name>
          <string-name>
            <surname>Lindsay</surname>
          </string-name>
          .
          <year>1995</year>
          .
          <article-title>Mixture Models: Theory, Geometry and Applications</article-title>
          . Institute of Mathematical Statistics.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>Tomas</surname>
            <given-names>Mikolov</given-names>
          </string-name>
          , Kai Chen, Greg Corrado, and
          <string-name>
            <given-names>Jefrey</given-names>
            <surname>Dean</surname>
          </string-name>
          .
          <year>2013</year>
          .
          <article-title>Eficient Estimation of Word Representations in Vector Space</article-title>
          .
          <source>arXiv preprint arXiv:1301.3781</source>
          (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>Rishabh</surname>
            <given-names>Misra</given-names>
          </string-name>
          , Mengting Wan, and
          <string-name>
            <surname>Julian McAuley</surname>
          </string-name>
          .
          <year>2018</year>
          .
          <article-title>Decomposing Fit Semantics for Product Size Recommendation in Metric Spaces</article-title>
          .
          <source>In Proceedings of the 12th Conference on Recommender Systems (RecSys '18)</source>
          . ACM, pp.
          <fpage>422</fpage>
          -
          <lpage>426</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>Sinno</given-names>
            <surname>Jialin</surname>
          </string-name>
          Pan and
          <string-name>
            <given-names>Qiang</given-names>
            <surname>Yang</surname>
          </string-name>
          .
          <year>2010</year>
          .
          <article-title>A Survey on Transfer Learning</article-title>
          .
          <source>IEEE Transactions on Knowledge and Data Engineering</source>
          <volume>22</volume>
          (
          <year>2010</year>
          ),
          <fpage>1345</fpage>
          -
          <lpage>1359</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>Arkadiusz</given-names>
            <surname>Paterek</surname>
          </string-name>
          .
          <year>2007</year>
          .
          <article-title>Improving Regularised Singular Value Decomposition for Collaborative Filtering</article-title>
          .
          <source>In Proceedings of KDD Cup and Workshop</source>
          . ACM, pp.
          <fpage>5</fpage>
          -
          <lpage>8</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <surname>Peter</surname>
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Rousseeuw</surname>
          </string-name>
          .
          <year>1987</year>
          .
          <article-title>Silhouettes: A Graphical Aid to the Interpretation and Validation of Cluster Analysis</article-title>
          .
          <source>Journal of Computational and Applied Mathematics</source>
          <volume>20</volume>
          ,
          <issue>1</issue>
          (
          <year>1987</year>
          ), pp.
          <fpage>53</fpage>
          -
          <lpage>65</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <surname>Badrul</surname>
            <given-names>Sarwar</given-names>
          </string-name>
          , George Karypis, Joseph Konstan,
          <string-name>
            <given-names>and John</given-names>
            <surname>Riedl</surname>
          </string-name>
          .
          <year>2001</year>
          .
          <article-title>Item-Based Collaborative Filtering Recommendation Algorithms</article-title>
          .
          <source>In Proceedings of the 10th International Conference on World Wide Web (WWW '01)</source>
          . ACM, pp.
          <fpage>285</fpage>
          -
          <lpage>295</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <surname>Vivek</surname>
            <given-names>Sembium</given-names>
          </string-name>
          , Rajeev Rastogi, Atul Saroop, and
          <string-name>
            <given-names>Srujana</given-names>
            <surname>Merugu</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Recommending Product Sizes to Customers</article-title>
          .
          <source>In Proceedings of the 11th Conference on Recommender Systems (RecSys '17)</source>
          . ACM, pp.
          <fpage>243</fpage>
          -
          <lpage>250</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <surname>Vivek</surname>
            <given-names>Sembium</given-names>
          </string-name>
          , Rajeev Rastogi, Lavanya Tekumalla, and
          <string-name>
            <given-names>Atul</given-names>
            <surname>Saroop</surname>
          </string-name>
          .
          <year>2018</year>
          .
          <article-title>Bayesian Models for Product Size Recommendations</article-title>
          .
          <source>In Proceedings of the 27th World Wide Web Conference (WWW '18)</source>
          . ACM, pp.
          <fpage>679</fpage>
          -
          <lpage>687</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>Shreya</given-names>
            <surname>Singh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Mohammed</surname>
          </string-name>
          <string-name>
            <surname>Abdulla</surname>
          </string-name>
          , Sumit Borar, and
          <string-name>
            <given-names>Sagar</given-names>
            <surname>Arora</surname>
          </string-name>
          .
          <year>2018</year>
          .
          <article-title>Footwear Size Recommendation System</article-title>
          . arXiv preprint arXiv:
          <year>1806</year>
          .
          <volume>11423</volume>
          (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>L.J.P. van der Maaten and G.E.</given-names>
            <surname>Hinton</surname>
          </string-name>
          .
          <year>2008</year>
          .
          <article-title>Visualizing High-Dimensional Data Using t-SNE</article-title>
          . (
          <year>2008</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>