<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>The Helsinki Digital Humanities Hackathon: Two Perspectives on Multidisciplinary Historical Newspapers Research in a Hackathon Context.</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Universiteit Utrecht</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Utrecht</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>The Netherlands ruben@rubenros.nl</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Universitat Innsbruck</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Innsbruck</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Austria sarah.oberbichler@uibk.ac.at</string-name>
        </contrib>
      </contrib-group>
      <pub-date>
        <year>2020</year>
      </pub-date>
      <fpage>66</fpage>
      <lpage>74</lpage>
      <abstract>
        <p>This paper describes the 2019 edition of the Helsinki Digital Humanities Hackathon from the perspective of two of its participants. As (digital) historians they were part of the group that investigated the history of medical advertisements in British nineteenth-century newspapers. The paper describes the research process, as well as the data and methods used during the research. The paper also considers the Hackathon as a laboratory for Digital Humanities research and re ects on the nature of the collaboration as experienced during the Hackathon. As such, the paper describes the challenges of multidisciplinary research and identi es the factors that hinder and foster collaboration in a Digital Humanities context.</p>
      </abstract>
      <kwd-group>
        <kwd>Hackathon Multidiscilinary Collaboration Historical Newspapers Text Mining</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>Helsinki DHH o ers a chance to experience an interdisciplinary research project
from start to nish within the span of 1.5 weeks. For researchers and students
with a computer science or data science background, the Hackathon gives the
opportunity to test abstract knowledge against complex historical problems. For
people from the humanities and social sciences, the DHH shows the potential of
computational methods and multidisciplinary research.</p>
      <p>Every edition, around forty participants are divided into four groups. The
group themes are established in advance and the participants can indicate their
prefered group. This year, the group titles were: Newspapers &amp; Capitalism, Genre
and Style in Early Modern Publications, The Many Voices of the European
Parliament and Brexit in Transnational Social Media.</p>
      <p>In earlier years the Hackathon was visited predominantly by Finnish and
European students and researchers. Recently, the Hackathon has widened its
scope with the help of Common Language Resources and Technology
Infrastructure (CLARIN) and Digital Research Infrastructure for the Arts and
Humanities (DARIAH), and the Hackathon participants now include students and
researchers from all over the world.</p>
      <p>The team whose work is reported in this paper focused on the history of
nineteenth century British newspapers and consisted of historians (7), linguists
(2), computer scientists (3), data scientists (1) and literary scholars (1).</p>
      <p>In the remainder of this paper we describe the research in the Newspapers
&amp; Capitalism group. We discuss the research topics and questions, as well as
the data and methods used in the research. Lastly, we re ect on the Hackathon
as a laboratory for DH-research and we identify factors that challenge and/or
promote multidisciplinary collaboration.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Research Topics and Questions</title>
      <p>During the rst days the group decided to develop several lines of research based
on the personal interests, individual expertise and academic background of the
group members. To develop research questions, the whole team got together
and collected ideas. This process was supported by literature research and close
reading of the newspapers. The group decided to focus on the topic of
nineteenthcentury medical advertisements and the language of persuasion employed in
those advertisements.</p>
      <p>
        Throughout the century, medical advertisements occupied an important place
in periodical culture [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ][
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Pills, lotions and ointments were regularly promoted,
not seldom by so-called \quacks": charlatans who promised to cure every disease
imaginable. The link between sellers of patient medicines and the publishing
industry was intimate. Without the steady demand for advertisement space many
newspapers would have gone bankrupt, and without constant advertising, the
patient medicine industry would not have been able to sustain itself [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>
        In the early nineteenth century, the well-organized patent medicines
industry had replaced the small-scale quacks, who lacked the skills and resources to
67/143
take part in a market that became increasingly national in scope. The
literature identi es four categories of nineteenth-century advertisers: market leaders,
tradesmen, medical practitioners, elite and locals [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. During the Victorian
period there were four leading pill-makers who together represented most of the
newspaper advertising; James Morison, the creator of Universal Pills, a
`venerable' Salopian called Thomas Parr who sold \Parr's Life Pills" to increase the
beauty of women, Thomas Holloway who is also identi ed as the rst world-wide
advertiser, and Thomas Beecham who invented \Beecham's Pills" and claimed
to cure \bilious and nervous disorders" [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. During the nineteenth century,
quackery slowly disappeared from the newspaper pages as scienti c insights reached
the broader public and legal action against health fraud was organized [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ][
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
This transformation of medical advertising thus ties in with broader questions
about the rise of consumer society, the professionalization of medicine and the
newspaper industry itself.
      </p>
      <p>For the group, the literature also provoked several questions, such as: what
diseases and cures were advertised, whether the advertisers distinguished
between di erent (gendered) publics, and how the cures were rhetorically marketed
in the advertisements. These questions formed the basis for the Hackathon
research in the Newspapers &amp; Capitalism group. They were chosen because they
invited for the use of computational methods, but also bene ted from
`traditional' close reading.</p>
      <p>
        Later in the research process, several other group members explored another
signi cant group of advertisements: job ads. Using the HISCO classi cation of
jobs, they were able to shed light on the long-term evolution of jobs that were
marketed in advertisements [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ].
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Data</title>
      <p>
        The project used the British Library Nineteenth Century Newspapers collection,
provided by Gale Cengage. The data consist of 304 unique newspapers, 270.744
issues, 26.295.841 articles and 1.560.916 advertisements. The data was indexed
by the HELDIG team and made accessible through an API. In light of the
limited amount of time, the group chose to focus on a speci c newspaper:\The
Morning Post", a British newspaper that was successfully established in 1772 and
existed until 1937 [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. The Morning Post advertisements, that ran throughout
the century, were used for the questions on diseases/cures, persuasion and gender.
The statistical analysis was applied to all newspapers in the dataset.
      </p>
      <p>
        The newspapers were accessible in machine-readable form and through an
API developed by the HELDIG researchers. Since the quality of the photographed
pages varies, the quality of the so-called "Optical Character Recognition" (OCR)
as provided by Gale does so as well. Especially in the rst two decades of the
nineteenth century, the OCR con dence levels (included in the metadata) proved
to be relatively low (Figure 1). Another pressing problem was the article
segmentation. Because advertisements appear in all forms and sizes, it is hard to
draw boundaries between advertisements and articles, and between individual
68/143
advertisements. In the process of segmenting newspaper pages, advertisements
are often grouped together, resulting in low-quality segmentation. In order to
reduce the e ect of lacking segmentation and low-quality OCR the analysis used
issue-based frequency, meaning that for example the frequency of a word was
not normalized by the number of advertisements in a newspaper but by the
number of newspaper issues. In response to lower OCR con dence levels in the
rst decade of the century, keyword frequency was broadened by taking into
account potential \alternatives" that were automatically generated with word
embeddings (\fchool", \schoof, when searching for \school") [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
After de ning the research questions and research topics, the group divided
itself in subgroups that would work on speci c tasks. First, two computer
scientists set out to gather metadata statistics. Three aspects were particularly
important: the `quality' of the data as measured with OCR (Optical
Character Recognition) con dence levels, the changing composition of newspapers as
measured through the share of categories such as \Advertisements and Notices"
or \Business News", and, lastly, the original locations of the newspapers. The
statistical insights were presented in Tableau, an online interface that allowed
the group to explore the results.
      </p>
      <p>Informed by the features of the data as presented in Tableau, a group of
historians and data scientists set out to investigate advertisements by using
frequency analysis. First, they inquired into the relation between advertisements
and gender by creating subsets of male- and female-oriented ads. The
historians manually composed a vocabulary of gender-related keywords (e.g. \male",
\female", \boy", \girl") and a vocabulary of cures (e.g. \pills", \ointments",
69/143
\balsam"). These vocabularies were used to extract a subset of medical
advertisements from the digitized Morning Post and to extract ads that mentioned
gender-related terms. Ads that did not mention any of the vocabulary terms were
excluded. The subset that emerged from this pipeline showed how the ratio of
male- and female-oriented ads changed signi cantly during the century (Figure
2).</p>
      <p>
        The group then investigated the relation between gender and medicine by
extracting cures and diseases from the ads. To do so, the group employed word
embeddings, a method used to embed words in a 'vector space' that is
subsequently used to inquire into semantic relations between words [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. Embeddings
were trained on samples from the Morning Post for every decade by using the
popular Python library word2vec [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. This allowed the group to lter words
that were semantically close to words such as \disease", \cough" and \pain". In
this way, a typology of diseases could be created. A similar method was used to
extract the advertised cures.
      </p>
      <p>
        By combining the extracted information on cures and diseases with the
vocabularies of gender-related keywords, the ads could be classi ed into groups
of male- and female-oriented ads. This allowed us to inquire into two di
erent aspects of nineteenth-century medical advertising. First, we could track the
changes in the target audience. Especially later in the century, female-oriented
ads became more present in the corpus. Also, we could investigate whether di
erent cures and diseases appeared in advertisement aimed at di erent publics. By
looking separately at male- and female-oriented ads, we were able to nd di
erences between the targeted diseases. Mental illnesses, for example, were slightly
more associated with women. We related this trend to existing literature on the
history of female \hysteria" [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ].
      </p>
      <p>
        These data-driven insights were veri ed by historians in the group who
systematically collected samples of newspapers through the Gale Search Engine
and its keyword search interface [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. For each decade, twenty newspapers were
subjected to close reading. This allowed the group not only to complement the
frequency analysis, but also pointed at potential problems, such as ads that
were not speci cally aimed at men or women, or ads that consisted primarily of
images.
      </p>
      <p>
        A similar iterative approach was taken to the strand of research that looked
into the language of persuasion. The literature on the language of early-modern
advertising provided several insights into the linguistic features of advertising
in the eighteenth century [
        <xref ref-type="bibr" rid="ref16 ref17 ref18">16,17,18</xref>
        ]. Several linguists in the group investigated
these features in the nineteenth century, hereby focusing on modal verbs (w.g.
"wishes highly to recommend") and the use of repetition to draw attention
and testimony. During the research, it appeared that many of these ne-grained
rhetorical tropes were hard to quantify as a result of lacking article segmentation
and OCR-errors. For this reasons, the digital methods in this line of research
were restricted to the relative frequency of speci c parts-of-speech such as modal
verbs and adjectives.
70/143
      </p>
      <p>The last subquestion, on the changing prominence of occupations in job
advertisements was investigated by using a list of English-language job titles and
comparing those to the full-text advertisements. Using the associated classi
cation codes as a way to cluster speci c occupations together, we were able to shed
a light on the changing job market: low-skilled and production-related jobs rose
in prominence, a pattern that was also visible in the category of professional and
technical workers.
5</p>
    </sec>
    <sec id="sec-4">
      <title>Results</title>
      <p>The Hackathon research yielded surprising outcomes given the limited amount of
time. With regard to the medical advertisements, the changing proportion and
character of male- and female-oriented advertisements was a striking nding.
In the rst decades of the nineteenth century, ads were mainly targeted at a
male audience. Gradually, female-oriented ads advanced. Especially in the last
two decades of the century, the proportion of those advertisements increased
signi cantly.</p>
      <p>The advertisements also di ered in terms of their contents. Although
distant reading techniques were not able to fully capture the complexity of this
issue, close reading revealed the gendered nature of speci c illnesses and cures.
The investigation of persuasiveness in newspaper language similarly produced
surprising results. Computational analysis was not very important for the
outcomes, but the results invite for further analysis into for example modal verbs
71/143
and the repetition of speci c product names. Lastly, the research into job
advertisement made good use of the HISCO-classi cation and was able to gain an
insight in nineteenth-century transformations on the job market with relatively
simple methods.
6</p>
    </sec>
    <sec id="sec-5">
      <title>Experiences</title>
      <p>The Hackathon was rst and foremost a learning experience. Humanists learnt
new skills and methods to do research computationally and computer/data
scientists were confronted with the complexities of messy historical data.
Throughout the week, the group formed a comprehensive understanding what kind of
multidisciplinary research could be done, and how such research should be
designed and executed. The group also learned about the challenges of
collaboration within an interdisciplinary projects; How can I communicate what I need
and what I want and how can I explain digital tools and methods to humanities
researchers?</p>
      <p>
        If we look back at the Hackathon experience from the perspective of broader
questions about collaboration in Digital Humanities research one aspect stands
out. During the Hackathon, crossing disciplinary boundaries remained a constant
e ort for all the researchers. Despite the favourable \geography of practice" and
the unique circumstances o ered by the Hackathon format, practically all the
group members frequently `drifted' back to methods and traditions that were
familiar to them [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]. Computer scientists and data scientists reverted to data
curation and visualization while for the humanists close reading the newspapers
and surveying the literature was something they could and would do easily. The
short time span pressured the group members to come up with clear results, and
resorting to familiar research practices was considered to be an easy way out.
For example, if the data harmonization or model training would take longer than
planned, going back to close reading was a tempting solution. The design of the
research questions to a large extent facilitated this re ex to return to familiar
territory. Because the questions posed could be answered by both computational
methods and close reading, splitting those tasks was tempting.
      </p>
      <p>This dynamic of \disciplinary isolationism" surfaced frequently. Three
factors can be identi ed as having a positive e ect on promoting collaboration and
preventing this re ex of \methodological isolationism". First, a shared
vocabulary: throughout the Hackathon, researchers visibly (and audibly) integrated
their methodological vocabularies. Initially, terms such as \modelling" and \data
cleaning" put the humanists at a distance from the computer scientists'
practices. Similarly, the latter group had a completely di erent understanding of the
language of hermeneutics employed by historians and linguists. Towards the end
of the Hackathon, however, terms such as \harmonization", \close reading" and
\language models" were used by historians and computer scientists alike.</p>
      <p>
        Second, a group of what could be called \bridge-builders", \intermediaries"
or \translators" proved essential in facilitating and actually doing the research
[
        <xref ref-type="bibr" rid="ref20">20</xref>
        ][
        <xref ref-type="bibr" rid="ref21">21</xref>
        ][
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]. A small number historians in the group who had worked in
multi72/143
disciplinary research groups before or were pro cient in coding and data
management themselves formed important links between the disciplines. After two
to three days, a work ow emerged that evolved around these (coding)
bridgebuilders who had access to the data and were able to translate historical
questions into for example statistical tests. Whereas this inter-disciplinary group
members were important, the Hackathon also showed how vital steps in the
analysis could be easily outsourced to this limited number of \specialists",
ultimately preventing integration and collaboration. For example the mass-scale
extraction of diseases and cures from the digitized ads was an essential task, but
was done by programming historians.
      </p>
      <p>Lastly, leadership was an vital factor in promoting collaboration. The group
leaders were especially important in the rst stage of designing the research plan.
Because they had experience with DH-research, they were able to indicate the
limits of what was possible. During the research itself, the group leaders provided
focus. Because the Hackathon provided the participants with an full arsenal of
tools and method, it proved important to decide on what was not to be done.
Additionally, the group leaders were also the key links between the computer
scientists and the humanists. They di ered from the earlier mentioned category
of "bridge-builders" in the sense that they remained at a distance, not doing the
research themselves.
7</p>
    </sec>
    <sec id="sec-6">
      <title>Conclusion</title>
      <p>The Helsinki Digital Humanities Hackathon is a fascinating laboratory for Digital
Humanities research. Participants from a diverse range of backgrounds engage
in cutting-edge research. Professors and bachelor students, humanities
scholars and computer scientists worked together on the same research question and
learned from each other. The research done in the Newspapers &amp; Capitalism
group crossed borders but the group also encountered challenges. The mixing
of the di erent disciplines was slow and it would have taken even more time
to establish collaboration that truly integrates existing traditions and methods.
Given the impressive results and the increase in mutual understanding,
however, the Hackathon gives cause for optimism when it comes to the future of
multidisciplinary Digital Humanities research.
73/143</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1. Helsinki Centre for Digital Humanities, HELDIG, https://www.helsinki. /en/helsinki-centre
          <article-title>-for-digital-humanities</article-title>
          .
          <source>Last accessed 20 Feb</source>
          .
          <year>2020</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Hindley</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Hindley</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <year>1972</year>
          . Advertising in Victorian England,
          <fpage>1837</fpage>
          -
          <lpage>1901</lpage>
          . Wayland, London.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Church</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <year>2000</year>
          .
          <article-title>Advertising consumer goods in nineteenth-century Britain: reinterpretations</article-title>
          .
          <source>Economic History Review 53.4</source>
          ,
          <fpage>621</fpage>
          -
          <lpage>645</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Carter</surname>
            ,
            <given-names>K. C.</given-names>
          </string-name>
          ,
          <year>1993</year>
          .
          <article-title>The concept of quackery in early nineteenth century British medical periodicals</article-title>
          .
          <source>Journal of Medical Humanities 14.2</source>
          ,
          <fpage>89</fpage>
          -
          <lpage>97</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Mackintosh</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <year>2017</year>
          .
          <article-title>The Patent Medicines Industry in Late Georgian England: A Respectable Alternative to Both Regular Medicine</article-title>
          and
          <string-name>
            <given-names>Irregular</given-names>
            <surname>Practice</surname>
          </string-name>
          .
          <source>Social History of Medicine 30. 1</source>
          ,
          <issue>22</issue>
          {
          <fpage>47</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Porter</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <year>1989</year>
          .
          <article-title>Health for sale:</article-title>
          quackery in England,
          <fpage>1660</fpage>
          -
          <lpage>1850</lpage>
          . Manchester University Press, Manchester.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Barker</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <year>2009</year>
          .
          <article-title>Medical advertising and trust in late Georgian England</article-title>
          .
          <source>Urban History</source>
          ,
          <volume>36</volume>
          .3,
          <fpage>379</fpage>
          -
          <lpage>398</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>Sackville</given-names>
            <surname>Turner</surname>
          </string-name>
          ,
          <string-name>
            <surname>E.</surname>
          </string-name>
          ,
          <year>1965</year>
          . The Shocking History of Advertising, Great Britain,
          <fpage>61</fpage>
          -
          <lpage>64</lpage>
          . Ballantine, New York.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>Van</given-names>
            <surname>Leeuwen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. H.</given-names>
            ,
            <surname>Maas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I.</given-names>
            , &amp;
            <surname>Miles</surname>
          </string-name>
          ,
          <string-name>
            <surname>A.</surname>
          </string-name>
          ,
          <year>2002</year>
          . HISCO:
          <article-title>Historical international standard classi cation of occupations</article-title>
          . Leuven, Leuven University Press.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Hindle</surname>
            ,
            <given-names>W. H.</given-names>
          </string-name>
          ,
          <year>1937</year>
          . The Morning post,
          <fpage>1772</fpage>
          -
          <lpage>1937</lpage>
          :
          <article-title>portrait of a newspaper</article-title>
          .
          <source>Routlegde</source>
          , London.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Hladek</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stas</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ondas</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Juhar</surname>
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Kovacs</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <year>2017</year>
          .
          <article-title>Learning string distance with smoothing for OCR spelling correction</article-title>
          .
          <source>Multimedia Tools Application</source>
          <volume>76</volume>
          ,
          <issue>24549</issue>
          {
          <fpage>24567</fpage>
          . https://doi.org/https://doi.org/10.1007/s11042-016-4185-5
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Mikolov</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chen</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Corrado</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Dean</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <year>2013</year>
          .
          <article-title>E cient estimation of word representations in vector space</article-title>
          .
          <source>arXiv:1301.3781v3 [cs.CL].</source>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Kutuzov</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>vrelid</surname>
          </string-name>
          , L.,
          <string-name>
            <surname>Szymanski</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Velldal</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <year>2018</year>
          .
          <article-title>Diachronic word embeddings and semantic shifts: a survey</article-title>
          .
          <source>arXiv:1301.3781v3 [cs.CL].</source>
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Arnaud</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <year>2015</year>
          .
          <article-title>On Hysteria: The Invention of a Medical Category between 1670 and 1820</article-title>
          . The University of Chicago Press, Chicago.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15. Gale Search Engine, http://gdc.galegroup.com.
          <source>Last accessed 17 Feb</source>
          <year>2020</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Leech</surname>
            ,
            <given-names>G. N.</given-names>
          </string-name>
          ,
          <year>1966</year>
          .
          <article-title>English in advertising: A linguistic study of advertising in Great Britain</article-title>
          . Longmans, London.
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Gotti</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <year>2005</year>
          .
          <article-title>Advertising discourse in eighteenth-century English newspapers</article-title>
          . In: Ska ari, J.,
          <string-name>
            <surname>Peikola</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Carroll</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hiltunen</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Warvik</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <year>2005</year>
          .
          <source>Opening Windows on Texts and Discourses of the Past</source>
          , pp.
          <fpage>23</fpage>
          -
          <lpage>38</lpage>
          . John Benjamins, Amsterdam.
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Percy</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <year>2012</year>
          .
          <article-title>Early Advertising and Newspapers as Sources of Sociolinguistic Investigation</article-title>
          . In:
          <string-name>
            <surname>Hernandez-Campoy</surname>
            ,
            <given-names>J.M.</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Conde-Silvestre</surname>
            ,
            <given-names>J.C.</given-names>
          </string-name>
          ,
          <source>The Handbook on Historical Sociolinguistics</source>
          , pp.
          <fpage>191</fpage>
          -
          <lpage>211</lpage>
          . Blackwell, Hoboken.
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Kemman</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <year>2019</year>
          ,
          <article-title>Boundary Practices of Digital Humanities Collaborations</article-title>
          .
          <source>Digital Humanities Benelux</source>
          <year>2019</year>
          ,
          <volume>1</volume>
          ,
          <fpage>1</fpage>
          -
          <lpage>24</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Edmond</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <year>2005</year>
          .
          <article-title>The role of the professional intermediary in expanding the humanities computing base</article-title>
          .
          <source>Literary and Linguistic Computing 20.3</source>
          ,
          <fpage>367</fpage>
          -
          <lpage>380</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Siemens</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cunningham</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Du</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Warwick</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <year>2011</year>
          .
          <article-title>A tale of two cities: implications of the similarities and di erences in collaborative approaches within the digital libraries and digital humanities communities</article-title>
          .
          <source>Literary and Linguistic Computing 26.3</source>
          ,
          <fpage>335</fpage>
          -
          <lpage>348</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Edmond</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <source>Collaboration and Infrastructure</source>
          . In: Schreibman,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Siemens</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            and
            <surname>Unsworth</surname>
          </string-name>
          ,
          <string-name>
            <surname>J.</surname>
          </string-name>
          ,
          <year>2015</year>
          .
          <article-title>A New Companion to the Digital Humanities</article-title>
          . Wiley, Hoboken.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>