The 3rd Workshop on Making Sense of Microposts (#MSM2013) was held in Rio de Janeiro, Brazil, on the 13th of May 2013, as part of the 22nd International Conference on the World Wide Web (WWW'13). #MSM2013 is the third in a series of successful workshops. The #MSM workshop was rst held at the 8th Extended Semantic Web Conference (ESWC 2011), and with approximately 50 participants, was the most popular workshop at ESWC 2011. The second workshop was held at the 21st International Conference on the World Wide Web (WWW'12), and had approximately 60 participants, as did this year's workshop.
result, the use of non-standard abbreviations, informal language and grammar. With each workshop we have found that our research community continues to open exciting new possibilities for constructing increasingly intelligent and useful services.
New to this year’s workshop is the Concept Extraction Challenge , sponsored by eBay. Existing concept extraction tools are intended for use over news corpora and similar document-based corpora with relatively long length. The aim of the challenge was to foster research into novel, more accurate concept extraction for (much shorter) Micropost data. The keen interest in concept extraction that is shared by our community motivated this challenge, focused for this rst time on a rather general task. The interest shown in the challenge by both academia and industry has conrmed its relevance. We aim to pursue the challenge in the future editions of #MSM, and are investigating new challenge tasks and the use of dierent collections of data, prompted by the challenge results and further research it continues to foster.
This rst run of the challenge has been a learning curve, with contributions from participants, not just in their formal submissions, but also to corrections in the training data that fed into the cycle of updates that resulted in the nal gold standard. The #MSM2013 Concept Extraction Challenge received 22 complete submissions, out of which 6 were accepted for presentation at the workshop, and a further 7 for presentation as posters. Submissions came from institutions across 12 countries, with 13% of submitting authors from Brazilian institutions.
Many hearty thanks to all our contributors and participants, and also the Programme Committees whose valued feedback resulted in a rich collection of work, each of which adds to the state of the art in leading edge research in the challenging task of information extraction from Microposts. Especial thanks to Andrea Varga, who was largely responsible for generating the challenge dataset, and Pablo Mendes who gave us very useful suggestions on collaborative annotation of the data. We are condent that the #MSM series of workshops will continue to foster a vibrant community, and target the rich body of information generated by the many and varied authors whose social and working lives span the physical and online worlds.
Matthew Rowe Lancaster University, UK Milan Stankovic UniversitØ Paris-Sorbonne, France Aba-Sah Dadzie The University of Sheeld, UK #MSM2013 Concept Extraction Challenge Organising Committee, May ’13 ii Summary of Other Contributions to #MSM2013 Published with ACM as a companion volume to the WWW’13 proceedings, the main track3 received 13 paper submissions, out of which 4 full and 2 short papers were accepted. This was in addition to a poster and demo session, to exhibit practical application in the eld, and foster further discussion about the ways in which data extracted from Microposts is being reused. The accepted submissions cover an array of topics, including a variety of approaches to concept extraction again reinforcing its importance with respect to research on Microposts, among these, rule-based, machine learning and hybrid methods. Other topics covered range from research from a social science perspective, on the use of Microposts to publicise and discuss trending events and topics, and the extraction of intent, meaning and sentiment. Submissions came from 9 countries, with 29% of all authors from institutions in Brazil. Thanks to our local chair, Bernardo Pereira Nunes, who helped, among other things, to promote the workshop and challenge to local institutions.
The main track proceedings include also the keynote abstract, ‘ Urban*: Crowdsourcing for the good of London ’4, presented by Daniele Quercia, of the Cambridge Networks Network at the University of Cambridge, England, UK.
The #MSM2013 award for the best paper, based on nominations by the reviewers and conrmed by the workshop chairs, was awarded to: Lisa Posch, Claudia Wagner, Philipp Singer & Markus Strohmaier for the paper:
Meaning as Collective Use: Predicting Hashtag Semantics on Twitter5 Introduction to the #MSM2013 Challenge Proceedings This volume includes rst a challenge report, with a summary of the state of the art and a comparison of the performance of the approaches taken for the 13 submissions accepted. This provides an overview of the capability of the state of the art in Concept Extraction approaches to date. This introductory paper details the challenge objectives and task, and the dataset construction and validation processes. We also provide a comprehensive description of the 3 #MSM2013 welcome: http://dl.acm.org/citation.cfm?id=2490000.2487998 4 #MSM2013 keynote: http://dl.acm.org/citation.cfm?id=2487788.2488000 5 Best paper, main track: http://dl.acm.org/citation.cfm?id=2487788.2488008 iii quantitative evaluation methodology followed and the performance and ranking metrics used.
Participants’ descriptions of the systems implemented complete the proceedings. Each submission was peer reviewed, to provide the authors with feedback on their approach and to identify interesting and promising work to present at the workshop. The quantitative evaluation described in the report was also carried out to rank submission runs this was the nal criterion, with a cut-o for acceptance, and the key measure for the challenge award.
eBay6 sponsored the challenge award: US$ 1,500, for the best submission. Nominations were sought from the reviewers, and a nal decision agreed by the challenge chairs, based on their nominations, review scores and the results of the quantitative evaluation. The #MSM2013 Concept Extraction Challenge Award went to:
for their submission entitled:
University of Twente at #MSM2013
iv
scar Corcho Universidad PolitØcnica de Madrid, Spain Danica Damljanovic Kuato Studios, London, UK Anna Lisa Gentile The University of Sheeld, UK Diana Maynard The University of Sheeld, UK Peter Mika Yahoo! Research, Spain Enrico Motta KMi, The Open University, UK Daniel Preotiuc The University of Sheeld, UK Alan Ritter University of Washington, USA Guiseppe Rizzo Eurecom, France Raphaºl Troncy Eurecom, France Victoria Uren Aston Business School, UK Andrea Varga The University of Sheeld, UK
The call for participation and all challenge abstracts, in addition to those for the main workshop track, are available on the #MSM2013 website 7. The full challenge proceedings are also available on the CEUR-WS server, as Vol-1019 8. The proceedings for the main track are available as part of the WWW’13 Proceedings Companion9. The proceedings for the 1st and 2nd workshops are available as CEUR Vol-71810 and Vol-83811 respectively. 7 Challenge web pages: http://oak.dcs.shef.ac.uk/msm2013/ie_challenge.html 8 #MSM2013 Challenge proceedings: http://ceur-ws.org/Vol-1019 9 WWW’13 Proceedings Companion: http://dl.acm.org/citation.cfm?id= 2487788 10 #MSM2011 proceedings: http://ceur-ws.org/Vol-718 11 #MSM2012 proceedings: http://ceur-ws.org/Vol-838