=Paper=
{{Paper
|id=Vol-2328/session2_paper1
|storemode=property
|title=The CL-Aff Happiness Shared Task: Results and Key Insights
|pdfUrl=https://ceur-ws.org/Vol-2328/2_paper.pdf
|volume=Vol-2328
|authors=Kokil Jaidka,Saran Mumick,Niyati Chhaya,Lyle Ungar
|dblpUrl=https://dblp.org/rec/conf/aaai/JaidkaMCU19
}}
==The CL-Aff Happiness Shared Task: Results and Key Insights==
https://ceur-ws.org/Vol-2328/2_paper.pdf
The CL-Aff Happiness Shared Task: Results and
Key Insights
Kokil Jaidka1,2 , Saran Mumick2,3 , Niyati Chhaya4 , and Lyle Ungar2
1
Nanyang Technological University, Singapore
2
University of Pennsylvania, USA
3
Megagon Labs, USA
4
Adobe Research, India
jaidka@ntu.edu.sg
Abstract. This overview describes the official results of the CL-Aff
Shared Task 2019 – in Pursuit of Happiness. The dataset comprised
a semi-supervised classification task and an open-ended knowledge mod-
eling task on a dataset of over 80,000 brief autobiographical accounts
of happy moments, crowdsourced from Amazon Mechanical Turk. The
Shared Task was organized as a part of the 2nd Workshop on Affective
Content Analysis @ AAAAI-19, held in Honolulu, USA on January 27,
2019. This paper compares the participating systems in terms of their
accuracy and F-1 scores at predicting two facets of happiness. The com-
plete annotated dataset is available on Harvard Dataverse at https:
//goo.gl/3rcZqf. The annotation instructions and the scripts used for
evaluation are available at the Git repository at https://github.com/
kj2013/claff-happydb.
1 Introduction
The purpose of the CL-Aff Shared Task is to challenge the current understanding
of emotion through a task that models the experiential, contextual and agen-
tic attributes of happy moments. It has long been known that human affect is
context-driven, and that labeled datasets should account for these factors in gen-
erating predictive models of affect. The Shared Task is organized in collaboration
with researchers at Megagon Labs and builds upon the HappyDB dataset [1],
comprising human accounts of ‘happy moments’. The Shared Task comprised of
two sub-tasks for analyzing happiness and well-being in written language, on a
corpus of over 80,000 descriptions of happy moments, as described here:
Given: An account of a happy moment, marked with individual’s demographics,
recollection time and relevant labels.
– Task 1: Semi-Supervised classification task - Predict thematic labels (Agen-
cy/Sociality) on unseen data, based on a small labeled and large unlabeled
training data.5
5
In the annotation task and the Shared Task, the label names we provided were
‘Agency’ and ‘Social’. We have since renamed ‘Social’ to ‘Sociality’ so that both
Agency and Sociality can be grammatically consistent.
– Task 2: Suggest interesting ways to automatically characterize the happy
moments in terms of affect, emotion, participants and content.
The task, given its predictive and open-ended interpretive aspects is relevant
for the computational linguistics, natural language processing, artificial intel-
ligence and the psycholinguistics communities. The aim is to engage scholarly
interest and crowdsource new ideas and linguistic approaches to define happi-
ness. Details on the psycholinguistic underpinnings of the annotation task are
provided in a different, forthcoming paper [5].
Evaluation: The performance of Systems was compared based on their Ac-
curacy and F-1 measure at predicting the Agency and Sociality labels on the
unseen test dataset. This was done using an automatic evaluation script, avail-
able on Github 6 .
1.1 Dataset description
The CL-Aff corpus comprises the following:
– Labeled training set (N = 10,560): Single-sentence happy moments
from the available HappyDB corpus, annotated with demographic labels of
the author, as well as labels that identify the ’agency’ of the author and the
’social’ characteristic of the moment, as well as concept labels describing its
theme.
– Unlabeled training set (N = 59,846: The remaining single-sentence
HappyDB happy moments with only the demographic labels of the author.
– Test set: (N = 17,215) Previously unreleased, single-sentence happy mo-
ments, freshly collected in the same manner as the original HappyDB data.
Authors’ demographic labels were available to the Shared Task participants
but not the ‘agency’ or ‘social’ characteristics.
The Agency and Sociality characteristics of each happy moment were decided
by a simple majority agreement between three independent annotators using a
binary (yes/no) coding.
2 Corpus development
2.1 Collecting the happy moments
We followed the format of the original HappyDB AMT task[1] to collect a second
dataset of 20,000 happy moments, which was to be the unseen test data in the
CL-Aff Shared Task. The following instructions were provided to the workers.
Instructions
6
https://github.com/kj2013/claff-happydb/
What made you happy? Reflect on the past , and recall three ac-
tual events that happened to you that made you happy. Describe your happy
moments with a complete sentence. Write three such moments. You will also
be asked to note for how long each event made you happy. This task also has
post-task questions. Please be sure to answer the questions. Examples of happy
moments we are NOT looking for (e.g., events in distant past, incomplete sen-
tence): The day I married my spouse; My dog.
< Enter moment here >
For how long did that event make you happy? Select the answer that is most
appropriate.
Each AMT worker was required to enter three happy moments experienced
within a specific time period. Half of the questionnaires specified a time period
of 24 hours, while the other half with a of 3 months. The op-
tions provided for the follow-up question about the duration (i.e., the length)
of happiness were ‘All day, I’m still feeling it,’ ‘Half a day,’ ‘At least one hour,’
‘A few minutes’ or ‘Not Applicable.’ After the participant answered these ques-
tions, demographic information was collected about their country, age, gender
(‘Male‘,‘Female‘,‘Other‘,‘Not Applicable‘), marital status (‘single’, ‘married’, ‘di-
vorced’, ‘separated’, ‘widowed’ or ‘Not Applicable‘), and whether or not they
have children (‘yes’,‘no’).
3 Annotation
Annotators were required to annotate each moment along two binary dimen-
sions – Agency and Sociality. We draw from Paulhas’ conceptualization of self-
presentation according to the two factors of Agency and Communion [7]. Previ-
ous work exploring the evidence of agency in writing has adapted it to mean their
locus of control, or the degree to which an author in control of their surroundings
[9]. Sociality conceptualizes interpersonal engagement, evinced in writing as the
description of any activity performed with or in the company of others[6].
Instructions Read the following happy moment. Choose any of the following
that applies:
Agency: Is the author in control? YES/NO
Examples of sentences where the author is in control (Answer is YES):
– “I ran on the treadmill for 20 minutes straight when I could barely do 5
minutes 3 months ago.”
– “Going out to a special birthday lunch for my great-grandmother in law’s
birthday.”
Examples of sentences where the author is not in control (Answer is NO):
– “My youngest daughter got accepted to many prestigious universities and
accepted an offer to attend college in San Diego.”
– “A small business deal change over for small profit.”
Social: Does this moment involve other people other than the author?
YES/NO
Please note that objects (e.g., bus, work) should not be counted as social.
Examples of sentences which involve other people (Answer is YES):
– “Going out to a special birthday lunch for my great-grandmother in law’s
birthday.”
– “My youngest daughter got accepted to many prestigious universities and
accepted an offer to attend college in San Diego.”
Note that sometimes a person is implicitly involved although not explicitly
mentioned. In this case, we still wish to label the happy moment as social.
E.g., “I received compliments on my tattoo.”
Examples of sentences which are not social (Answer is NO):
– “I ran on the treadmill for 20 minutes straight when I could barely do 5
minutes 3 months ago.”
– “The bus came on time, so I reached work early.”
Agency: Is the author in control? YES/NO
Social: Does this moment involve other people other than the author?
YES/NO
3.1 Topic labeling
Annotators were presented with a happy moment, and a set of four potential
topics which it was likely describing. Annotators were asked to mark all the tags
which referred to what it was about. Each moment could score a maximum of
four tags if at least two annotators agreed on them.
Instructions Read the following text. Select all categories that are relevant
to the text from among those provided. If none of the categories is a great fit,
select ”none of the above”
4 Overview of Approaches
Eleven teams participated in the Shared Task. The following paragraphs discuss
the approaches followed by the participating systems, sorted in the order in
which they signed up to participate in the task.
– Arizona State University (ASU) [10]: The team from ASU proposed a Word
Pair Convolutional Model (WoPCoM) to accomplish Task 1. The proposed
model is motivated by the hypothesis that a small set of word-pair features
are important to capturing the agency/social nature of happy moments.
They trained a convolutional neural network (CNN) to predict on the unla-
beled data.
– University of California Santa Cruz (UCSC) [15]: The UCSC team partici-
pated in both tasks. For Task 1, they explored the use of syntactic, emotional,
and survey features with semi-supervised learning, specifically experiment-
ing with XGBoosted Forest and CNN models. For Task 2, the team trained
similar models to predict concepts, and based on the difficulty of doing so,
hypothesized about the nature of the themes in the happy moments.
– International Institute of Information Technology Hyderabad (IIIT-H) [12]:
The IIIT-H team employed an inductive transfer learning technique (ITL).
They pre-trained a AWD-LSTM neural net on the WikiText-103 corpus, and
then introduced an extra step to adapt the model to Happy moments.
– Gyrfalcon [11]: The team from Gyrfalcon Technology, California, proposed
an algorithm to map English words into squared glyphs images. Then, they
applied a 2D-CNN model over these images in order to capture the sentiment.
– A*STAR [4]: The IHPC-A*STAR team participated in both tasks. For Task
1, they used emotion intensity in happy moments to predict agency and
sociality labels. They defined a set of five emotions (valence, joy, anger, fear,
sadness) and use a previously developed tool, CrystalFeed, to label each
moment with the corresponding five emotion intensities. Combining these
features with additional word-embedding features, they trained a logistic
regression model. For Task 2, the team explored how these different emotions
are manifested across the different concept labels.
– University of British Columbia (UBC) [8]: The UBC team primarily exper-
imented with different embedding methods, such as CoVe and ELMo, on
deep neural networks. They modeled their neural networks as long short-
term memory networks and BiLSTM, with and without attention.
– University of Ottawa (UOttawa) [16]: The University of Ottawa team also
proposed a deep learning CNN solution. They experimented using different
kind of word embeddings, and also experimented with training a multi-task
classifier to see whether performance could be enhanced by shared knowledge
between agency and sociality.
– Escuela Superior Politecnica del Litoral (ESPOL) [14]: The ESPOL team
proposed a semi-supervised adaptation to traditional k-means clustering us-
ing neural networks.
– Sungkyunkwan team (SKKU) [2]: The SKKU team used a semi-supervised
approach. They built four one-class autoencoder models, one for social, non-
social, agentic, and non-agentic moments. Each autoencoder model had a
deep learning architecture consisting of two neural networks, one for encoding
the the input, and the other for reconstructing the compressed vector.
– Jordan University of Science and Technology (JUST) [13]: The JUST team
proposed used a Recurrent Convolutional Neural Network, and combined
words with their context in order to get a more precise word embedding.
– Fraunhofer (FKIE) [3]: The team from Fraunhofer FKIE trained a three-layer
CNN. They experimented with using different embeddings including Fast-
Text and GloVe. Additionally, they experimented with splitting the dataset
by demographic location of the author, and showed that training separate
classifiers on the splits enhanced performance.
5 Results
5.1 Task 1: Predicting Agency and Sociality
This section compares the participating systems in terms of their performance.
Four of the eleven systems that did Task 1 also did the bonus Task 2. The results
are provided in Table 1. The detailed implementation of the individual runs are
described in the system papers included in this proceedings volume.
Fig. 1: Accuracy scores for the best performing system runs on CL-Aff Task 1
for each of the participating teams
5.2 Task 2: Happiness Insights
Some of the systems used their neural models of happiness for Task 1 to pro-
duce visual knowledge representations [11], and general insights about happiness
[10,8,15,3]. Most notably, Gyrfalcon [11] transformed textual moments into vi-
sualizations to explore whether they could encode more multi-dimensional infor-
mation in this manner. UBC [8] provided a visualization for “attention” in their
bi-directional long short-term memory networks which highlights the patterns
that were considered important by the neural network while predicting Agency
and Sociality when a sequence of words was input into the model. ASU [10]
showed the codependence of the individual Agency and Sociality labels across
the dataset through a t-SNE visualization. Team 33 [3] and UCSC [15] both at-
tempted to capture the linguistic patterns in the construction of happiness and
their potential cultural underpinnings.
6 Error Analysis
In this section, we present a meta-analysis of system performances for Task 1
over all the (a) topics and (b) moments in the test set. Furthermore, in their
Table 1: Systems’ performance in Task 1, ordered by their accuracy on predicting
Agency.
Agency Sociality
System Accuracy F1 Accuracy F1
UBC [8] .85 .9 .92 .93
ASU [10] .85 .89 .91 .92
IIIT-H [12] .84 .89 .92 .93
JUST [13] Run 10 .83 .89 .91 .92
UCSC [15] Run 1 .83 .88 .89 .9
UCSC [15] Run 2 .83 .88 .89 .9
UCSC [15] Run 3 .83 .88 .89 .9
JUST [13] Run 1 .83 .88 .91 .91
JUST [13] Run 4 .83 .88 .91 .92
JUST [13] Run 5 .83 .88 .9 .91
JUST [13] Run 7 .82 .88 .91 .92
JUST [13] Run 3 .82 .88 .9 .91
JUST [13] Run 2 .82 .88 .91 .92
ESPOL [14] .82 .87 .9 .91
JUST [13] Run 6 .82 .87 .9 .91
UCSC [15] Run 4 .82 .87 .89 .9
UOttawa [16] Run 1 .82 .88 .9 .91
A*STAR [4] Run 3 .81 .88 .89 .9
UOttawa [16] Run 2 .81 .87 .89 .91
JUST [13] Run 8 .81 .87 .89 .91
UOttawa [16] Run 3 .81 .86 .88 .9
UOttawa [16] Run 4 .8 .86 .88 .9
JUST [13] Run 9 .8 .85 .9 .91
UOttawa [16] Run 5 .8 .86 .89 .9
UOttawa [16] Run 6 .8 .87 .89 .9
UOttawa [16] Run 7 .8 .86 .88 .89
UOttawa [16] Run 8 .8 .86 .89 .9
GYRFALCON [11] .8 .86 .82 .83
UOttawa [16] Run 9 .79 .85 .88 .9
UCSC [15] Run 5 .79 .86 .59 .62
UOttawa [16] Run 10 .79 .85 .88 .89
UCSC [15] Run 6 .79 .86 .7 .74
A*STAR [4] Run 2 .78 .83 .89 .9
A*STAR [4] Run 1 .78 .83 .89 .9
FRAUNHOFER [3] Run 4 4 .77 .84 .65 .73
FRAUNHOFER [3] Run 1 .76 .85 .59 .62
UCSC [15] Run 7 .76 .85 .89 .9
UCSC [15] Run 8 .76 .85 .89 .9
FRAUNHOFER [3] Run 3 3 .76 .84 .65 .74
FRAUNHOFER [3] Run 5 .76 .82 .62 .68
SKKU [2]7 Run 1 .76 .84 .87 .88
SKKU [2] Run 2 .76 .84 .87 .88
FRAUNHOFER [3] Run 2 .75 .82 .59 .62
FRAUNHOFER [3] Run 6 .75 .84 .61 .65
UCSC [15] Run 9 .74 .83 .61 .66
SKKU [2] Run 4 .39 .49 .87 .88
SKKU [2] Run 3 .39 .49 .87 .88
Table 2: Legend for Task 1 System Runs.
System No. Run No. Description
UCSC [15] Run 1 Supervised CNN (2,3,4,5) on GloVe features
UCSC [15] Run 2 Semi-Supervised CNN (2,3,4) on GloVe features
UCSC [15] Run 3 Semi-Supervised CNN (2,3,4,5) on GloVe features
UCSC [15] Run 4 Supervised CNN (2,3,4) on GloVe features
UCSC [15] Run 5 Supervised CNN (2,3,4) on GloVe, syntactic and emotionl features
UCSC [15] Run 6 Semi-Supervised CNN (2,3,4,5) on GloVe features
UCSC [15] Run 7 Supervised XGBoosted Forest on syntactic and emotion features
UCSC [15] Run 8 Semi-Supervised SGBoosted Forest on syntactic and emotion features
UCSC [15] Run 9 Semi-Supervised CNN (2,3,4) on GloVe, syntactic and emotion features
UOttawa [16] CNN Multi-task learning on GloVe embeddings
UOttawa [16] Run 1 50 dimensions, 10 epochs
UOttawa [16] Run 2 100 dimensions, 10 epochs
UOttawa [16] Run 3 25 dimensions, 10 epochs
UOttawa [16] Run 4 200 dimensions, 10 epochs
UOttawa [16] Run 5 25 dimensions, 50 epochs
UOttawa [16] Run 6 50 dimensions, 50 epochs
UOttawa [16] Run 7 100 dimensions, 50 epochs
UOttawa [16] Run 8 200 dimensions, 50 epochs
UOttawa [16] Run 9 50 dimensions, 200 epochs
UOttawa [16] Run 10 200 dimensions, 100 epochs
data pre-processing step, the team from Fraunhofer [3] identified that in the
subset of happy moments contributed by authors from India alone, there were
duplicate or near-duplicate happy moments in the data, which reduced the total
number of training samples by 25%. We will include data cleaning as an extra
preprocessing step in future data releases.
Topic-level analysis: We expect that happiness in different situations
would be experienced and expressed differently. Table 3 aggregates the failures
produced by each of the approaches (out of the set of best approaches submitted
by each of the teams).
Moment-level meta-analysis: We suspect that some of the errors in our
data may occur due to mislabeling or the coding scheme not being applicable to
the moment. In Table 4 we provide the happy moments for which 100% of the
best approaches submitted by each of the teams reported failure. We observe
that in some of the cases, (e.g., “Topanga running away to Cory”), the happy
moment was actually mislabeled and thus the systems actually did have the
correct prediction. Overall, many of the happy moments in this Table describe a
single moment in the author’s life, which seem ordinary when considered in the
context of regular living. In some cases, the authors have attempted to explain
why this moment was special to them (e.g., the second part of the moment “I
finally got a hold of my auto mechanic, and that enabled me to schedule a time
to bring in my car to get my custom exhaust installed” only serves to explain
the significance of the moment to the author.)
Table 3: Topic-level error Analysis: % of the approaches that failed on predicting
Agency and Sociality in different topics.
% Failure % Failure
Concept N (Agency) (Sociality)
Career 2186 27.27 27.27
Party 839 27.27 36.36
Education 985 18.18 27.27
Family 5149 18.18 27.27
Animals 882 18.18 36.36
Religion 105 18.18 36.36
Conversation 1336 18.18 27.27
Romance 1325 18.18 27.27
Weather 251 18.18 18.18
Vacation 1061 9.09 27.27
Entertainment 2284 9.09 27.27
Food 2402 9.09 18.18
Shopping 1290 9.09 18.18
Technology 477 9.09 18.18
Exercise 842 9.09 18.18
Table 4: Moment-level error Analysis: 100% of the best approaches submitted
by each of the eleven teams, failed at predicting Agency and Sociality in these
happy moments.
Agency (10% noise)
I was given off phone work for the day.
i was promoted in my job and i felt so appreciated and happy.
Children of different races playing together at pool.
I spoke to a friend on the phone that I hadn’t heard from in two months.
I realized earlier today that last month I made twice as much as my income for the same month the previous year.
I won a new lawnmower, which I desperately needed, at a local event.
My son singing songs with me.
seeing a co worker
I was able to talk to my boyfriend on the phone for an hour even though he is on vacation.
i slept well last night - no nightmares
I got a raise at work
My father gifted me a car on my birthday that left me surprised and extremely happy.
I won a lucky draw two weeks back to a five star resort for two days, which made me really exiting and joyfull.
Social (5% noise)
I was applying for jobs for many months and finally got an interview and a offer later.
I learned that we’re moving into a bigger, better apartment for less money.
I won the first prize in cricket match.
I was happy when I was offered to work on a new television show
Having my hair cut and it turning out just the way I wanted it to look.
I had a job interview this morning and I think it went well.
Topanga running away to Cory.
Being brought McDonald’s for lunch.
I was gifted a very nice bottle of wine.
I got an iphone 7 as gift
I forgot my credit card and was given a free chicken biscuit and drink anyway.
A package I ordered that I was anticipating was delivered to me.
I received approval to take a month off of work to go on a backpacking trip.
Got a small raise at work and even it doesn’t amount to much per check, it’s still something.
When i return home my house was very clean and nice,and the yard was mowed.
7 Conclusion and Future Work
Eleven teams participated in the inaugural CL-Aff Shared Task AAAI-19. We
have published the complete dataset to Harvard Dataverse 8 . Furthermore, we
expect to release other resources complementary to the challenges of modeling
affect and emotion language from language.
In summary, our meta-analysis of system performance identifies the following
key takeaways and recommendations:
– Predictive modeling approaches are greatly improved when modeled as a
semi-supervised task, enriched with unlabeled data or by knowledge or fea-
ture vectors trained from a different domain. This also highlights the gener-
alizability of the Shared Task to other domains.
– Syntactic knowledge is important for modeling Agency and Sociality (and
hence, for modeling happiness). Participants incorporated the importance of
the head noun and subject-verb-object word order in their language mod-
els either through interacting layers in convolution neural networks, or by
mining it using lexical pattern analyses methods.
– The CL-Aff dataset offers replicability of more traditional emotion modeling
approaches. It was feasible to apply the models developed on other annotated
emotion datasets to improve the predictive modeling performance on the
Shared Task [4]. We anticipate that language models from the CL-Aff dataset
will also generalize well to other problems and datasets for emotion and affect
analysis.
– In future work, scholars could consider training their classifiers based on
domain-specific word embeddings derived from the Shared Task dataset it-
self.
– Findings support the emerging notion about the English language as a con-
textualized emotional vector space, with the best performances reported by
approaches that incorporated task-specific embeddings from other language
models, such as ELMo and CoVe.
Acknowledgement. We thank Dr. Wang-Chiew Tan for her feedback
and Megagon Labs for contributing funds towards the CL-Aff dataset.
References
1. Asai, A., Evensen, S., Golshan, B., Halevy, A., Li, V., Lopatenko, A., Stepanov,
D., Suhara, Y., Tan, W.C., Xu, Y.: Happydb: A corpus of 100,000 crowdsourced
happy moments. In: Proceedings of LREC 2018. European Language Resources
Association (ELRA), Miyazaki, Japan (May 2018)
2. Cheong, Y.G., Song, Y., Bae, B.C.: [cl-aff shared task] modeling happiness using
one-class autoencoders. In: Proceedings of the 2nd Workshop on Affective Content
Analysis @ AAAI (AffCon2019). Honolulu, Hawaii (January 2019)
8
DOI:10.7910/DVN/JZAS66; https://goo.gl/3rcZqf
3. Claeser, D.: Affective content classification using convolutional neural networks.
In: Proceedings of the 2nd Workshop on Affective Content Analysis @ AAAI (Af-
fCon2019). Honolulu, Hawaii (January 2019)
4. Gupta, R.K., Bhattacharya, P., Yang, Y.: What constitutes happiness? predicting
and characterizing the ingredients of happiness using emotion intensity analysis.
In: Proceedings of the 2nd Workshop on Affective Content Analysis @ AAAI (Af-
fCon2019). Honolulu, Hawaii (January 2019)
5. Jaidka, K., Chhaya, N., Mumick, S., Killingsworth, M., Halevy, A., Ungar, L.:
Towards a typology of happiness: The cl-aff annotated dataset of happy moments
(2019)
6. Paulhus, D.L., Robinson, J.P., Shaver, P.R., Wrightsman, L.S.: Measures of person-
ality and social psychological attitudes. Measures of social psychological attitudes
series 1, 17–59 (1991)
7. Paulhus, D.L., Trapnell, P.D.: Self-presentation of personality. Handbook of per-
sonality psychology 19, 492–517 (2008)
8. Rajendran, A., Zhang, C., Abdul-Mageed, M.: Happy together: Learning and un-
derstanding appraisal from natural language. In: Proceedings of the 2nd Workshop
on Affective Content Analysis @ AAAI (AffCon2019). Honolulu, Hawaii (January
2019)
9. Rouhizadeh, M., Jaidka, K., Smith, L., Schwartz, H.A., Buffone, A., Ungar, L.:
Identifying locus of control in social media language. In: Proceedings of the 2018
Conference on Empirical Methods in Natural Language Processing (2018)
10. Saxon, M., Bhandari, S., Ruskin, L., Honda, G.: Word pair convolutional model
for happy moment classification. In: Proceedings of the 2nd Workshop on Affective
Content Analysis @ AAAI (AffCon2019). Honolulu, Hawaii (January 2019)
11. Sun, B., Yang, L., Chi, C., Zhang, W., Lin, M.: [cl-aff shared task] squared english
word: A method of generating glyph to use super characters for sentiment analy-
sis. In: Proceedings of the 2nd Workshop on Affective Content Analysis @ AAAI
(AffCon2019). Honolulu, Hawaii (January 2019)
12. Syed, B., Indurthi, V., Shah, K., Gupta, M., Varma, V.: Ingredients for happiness:
Modeling constructs via semi-supervised content driven inductive transfer learn-
ing. In: Proceedings of the 2nd Workshop on Affective Content Analysis @ AAAI
(AffCon2019). Honolulu, Hawaii (January 2019)
13. Talafha, B., Al-Ayyoub, M.: Ioh-rcnn: Pursuing the ingredients of happiness using
recurrent convolutional neural networks. In: Proceedings of the 2nd Workshop
on Affective Content Analysis @ AAAI (AffCon2019). Honolulu, Hawaii (January
2019)
14. Torres, J., Vaca, C.: Neural semi-supervised learning for short-texts. In: Proceed-
ings of the 2nd Workshop on Affective Content Analysis @ AAAI (AffCon2019).
Honolulu, Hawaii (January 2019)
15. Wu, J., Compton, R., Rakshit, G., Walker, M., Anand, P., Whittaker, S.: Cruzaf-
fect at affcon 2019 shared task: A feature-rich approach to characterize happiness.
In: Proceedings of the 2nd Workshop on Affective Content Analysis @ AAAI (Af-
fCon2019). Honolulu, Hawaii (January 2019)
16. Xin, W., Inkpen, D.: [cl-aff shared task] happiness ingredients detection using
multi-task deep learning. In: Proceedings of the 2nd Workshop on Affective Con-
tent Analysis @ AAAI (AffCon2019). Honolulu, Hawaii (January 2019)