<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Varieties of crowdsourcing legislation practices</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Ana Luisa de Moraes Azenha</string-name>
          <email>moraesan@hu-berlin.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Humboldt-Universität zu Berlin</institution>
          ,
          <addr-line>Unter den Linden 6, 10117, Berlin</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Proceedings EGOV-CeDEM-EPart2023</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>Crowdsourcing experiences in the lawmaking cycle have grown significantly in the past fifteen years. Crowdsourcing legislation practices aim at engaging the public in lawmaking to improve the legislative process and its outcomes, as well as enhance legitimacy and transparency in the conventional legislative process. Different efforts have been made to map cases, identify core characteristics, and assess results. Despite these contributions, a more comprehensive understanding of the universe of crowdsourcing legislation practices and core components is still lacking. This paper provides a deeper look into this phenomenon through a review of crowdlaw classification criteria, influential attributes mentioned by the CrowdLaw initiative and others identified in e-participation and crowdsourcing literature. Finally, it proposes a taxonomy with key features of crowdsourcing legislation initiatives and their respective variables through which these initiatives can be analyzed and compared.</p>
      </abstract>
      <kwd-group>
        <kwd>1 Crowdlaw</kwd>
        <kwd>crowdsourcing legislation</kwd>
        <kwd>e-participation</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Technology offers numerous opportunities to democratize the lawmaking cycle. It promises to improve
regulatory decisions and compliance, as well as decrease administrative burdens such as face-to-face
meetings. Furthermore, it provides more possibilities and new forms of public participation, through which
more effective, efficient and legitimate regulations, legislation, and constitutions can be created [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. One
such possibility is through crowdsourcing, “an online, distributed problem-solving and production model
that leverages the collective intelligence of online communities to serve specific organizational goals” [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
Crowdsourcers determine specific goals and tasks that the online crowd should undertake to achieve them.
This outsourced problem-solving method is generally open to any person who is interested and has the
means to participate. In crowdsourced policy and lawmaking, collective knowledge is gathered and applied
to the policy and lawmaking process according to the crowdsourcers’ filters.
      </p>
      <p>
        The term "crowdlaw" combines the ideas of "crowdsourcing" and "law". It encompasses more
institutionalized digitally enhanced initiatives which seek more than just opinions and aim at improving the
quality of the lawmaking process and its outcomes [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. The term was coined in the context of the CrowdLaw
project led by Beth Noveck, the coordinator of the Governance Lab at New York University. The initiative
aims at “supporting legislative bodies in investigating, designing, implementing, and testing crowdlaw
initiatives”2. Noveck claims that to create comprehensive and impactful policies and laws that can
effectively safeguard the public, foster innovation and job creation, and effectively address intricate
concerns like climate change, it is necessary to access more information on the causes behind new and
pressing challenges [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Examples of crowdlaw are government-led consultations that promote expertise or
experience-based discussions to generate valuable input for future laws and constitutions.
      </p>
      <p>
        While crowdsourcing in public decision-making processes promises to convey economic, democratic,
and epistemic value [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], there are several challenges e-participation initiatives face in lawmaking, from the
stages of development and implementation to the processing of public input and the effective application of
outputs to lawmaking. These include skepticism and resistance from government officials, the
incompatibility of new technology with existing lawmaking practices and structure, securing the necessary
human, financial and technological resources as well as collecting useful contributions for the law in
question. Moreover, barriers to participation prevent those without internet access or required skills or
knowledge from engaging, an even greater challenge in lawmaking since it often requires participants to
know sufficient legal terminology.
      </p>
      <p>Throughout the past years, crowdsourcing practices in lawmaking have become more popular. While
some efforts were made to map, assort, and assess crowdsourcing experiences, the field would benefit from
a closer look into the variety of their formats. This paper intends to make a contribution to this gap. In
section 2, it identifies key elements and variables proposed by the CrowdLaw initiative in different
publications and repositories. In section 3, these elements are supplemented by other relevant features
identified in e-participation and crowdsourcing literature. Finally, in section 4, a taxonomy with the final
criteria for the broader concept of crowdsourcing legislation is presented. The table is intended to be a useful
tool to analyze and compare cases, determine typologies, and, in future research, identify influencing factors
in crowdsourcing legislation processes and their results for future improvement.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Key crowdlaw features</title>
    </sec>
    <sec id="sec-3">
      <title>2.1. Classification criteria adopted for crowdlaw cases</title>
      <p>The CrowdLaw project made two efforts to map and classify crowdlaw cases: the CrowdLaw
Repository3 and the CrowdLaw Catalog4. The Repository, the first of the two, compiled twenty cases on
Google sheets, while the Catalog contains over one hundred on its own webpage, displays links to more
information on the cases, shares some details on the CrowdLaw initiative and the classification criteria used.
The CrowdLaw Playbook5 is a more recent publication with selected cases that are further described and
analyzed. Some criteria used to classify cases is common to all three, while other elements were only used
in one or two of these efforts.</p>
      <p>The Repository, Catalog, and Playbook all provide basic information on the cases, such as the name of
the initiative, its owner, and its location. They also classify cases according to three attributes: the
implementation level (local, regional or national), the stage of the lawmaking cycle (agenda-setting/problem
definition, proposal-making/solution identification, drafting, implementation or evaluation) and the
participant task (ideas &amp; proposals, expertise, opinions, actions and evidence &amp; facts). The variables used,
however, slightly differ, e.g., the repository uses “agenda-setting” while the other two distinguish between
the “problem definition” phase and the “solution identification” one.</p>
      <p>Both the Repository and Playbook classify the cases according to the type(s) of platform used, web,
mobile and offline. Finally, the Repository assesses whether they were subject to a formal legal process
(legal framework), while the Playbook includes the method implemented by each initiative. There are six
methods attributed to cases: collaborative drafting, open innovation, AI-based insight generation, pairwise
wikisurveys, online brainstorming, prize-backed challenges and social auditing.</p>
      <p>
        A publication released by the CrowdLaw initiative highlights the importance of assessing some of these
features in order to understand the impacts they may have on the results of crowdlaw practices [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. The
authors of the publication claim, for example, that the owner of the initiative is a key attribute because
initiatives administrated by parliaments are already integrated into the workflow of the legislature and can
thereby have improved outcomes. They also defend tracking the stage of lawmaking in which the
crowdsourcing practice is being implemented to understand in which cases they engender more
participation. While today crowdlaw takes place mainly at the proposal-making or drafting stage, Capone
3Source:https://docs.google.com/spreadsheets/d/1Eaw3-rpi8wyANCKvM37F4SqOGF3TSUyTmqkY1ky31h0/edit#gid=0
4 Source: https://catalog.crowd.law/
5 Source: https://congress.crowd.law/files/crowdlaw_playbook_Oct2020.pdf
et al. hypothesize that more robust forms of participation may take place when the public monitors and
evaluates the impact of legislation, for instance.
      </p>
      <p>The publication also highlights the relevance of studying the impact of different participatory tasks in
the crowdsourcing exercise to understand the ones that function better. Finally, regarding the criteria applied
to classify crowdlaw cases, Capone et al. believe it is important to know which kind of platform, from
webbased to SMS-based, are more often used and what results they have prompted so far.</p>
      <p>
        There are no explanations or more details regarding the value in assessing the implementation level, legal
framework or methods in these publications and repositories, although an important article by Alsina &amp;
Martí [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] defend that "(…) building a comparative analysis of the current CrowdLaw statutes—legislation
institutionalizing and mandating the use of citizen engagement in lawmaking at the local, regional and
national level can be the first step to (…) formalize a legal framework for CrowdLaw initiatives and promote
their structural institutionalization."
2.2.
      </p>
    </sec>
    <sec id="sec-4">
      <title>Other important attributes according to the CrowdLaw initiative</title>
      <p>
        The CrowdLaw initiative also defends the inclusion of other so-called “salient features of crowdlaw
initiatives” in the analysis of cases [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. They stress that the assessment of the audience, incentives, law type,
topic, feedback, timing, and training can help draw generalizable conclusions linking participation formats
to results and base this assumption on some hypotheses.
      </p>
      <p>Firstly, they hypothesize that participation is mainly male and upper middle class if active measures to
diversify the audience are not taken. Therefore, it is key to develop a form of assessing and connecting the
demographics and features to the input of crowdlaw participants.</p>
      <p>
        Uncovering the most effective incentives to engage the public in lawmaking is also crucial because
guidance (“clearly defined rules of procedure”), relevance (“an understanding of the relevance of one’s
participation to the ultimate outcome”), and impact (“the ability to make a difference”) can be key
motivators for repeated engagement [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>The type of law in question, whether it is a regulation, legislation or constitution, can also have distinct
impacts. Capone et al. propose that the results of the same participatory tasks for different law types be
compared.</p>
      <p>The topic being discussed matters because more controversial themes can generate different levels and
qualities of engagement. The authors also stress the relevance of identifying if and how the parliament
provides feedback to participants and its impact on participation and repeated engagement. They
hypothesize that the more responsive and interactive a government is, the more it will increase participation
and frequency.</p>
      <p>Timing, referring to the time available for participation and the number of phases, can also be linked to
the results of participation. Finally, Capone et al. sustain that providing training before the participation
exercise can increase the quality of participation and usefulness of inputs received from the public.</p>
    </sec>
    <sec id="sec-5">
      <title>3. More design and process features of crowdsourcing legislation</title>
      <p>Apart from the elements mentioned by the CrowdLaw initiative, I hypothesize that other design and
process features can be relevant to a deeper understanding of the wide array of crowdsourcing legislation
initiatives and their results. These are drawn from the literature on e-participation and crowdsourcing, and
studies on crowdsourced policy and lawmaking cases.</p>
      <p>
        First, the presence of crowdsourcing partners can impact participation and the legitimacy of the process.
Partners can be government officials in bottom-up initiatives, or well-known and respected academic and
civil society organizations, for example. The Center for Technology and Society (Fundação Getúlio Vargas),
a well-known think tank in the field of Law and Technology, collaborated in a federal government-led
consultation that drafted the bill for today's Brazilian Internet Bill of Rights and was key to promoting and
involving more participants in the process [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
      </p>
      <p>
        The frequency of the initiative is potentially connected to its degree of institutionalization. Single cases
tend to be experiences that often do not produce outcomes, while ongoing cases are more likely to do so.
The vTaiwan initiative, for instance, an ongoing multistakeholder consultation process which promotes
discussions between experts, government officials, stakeholders, and citizens to elaborate recommendations
for national legislation, had an 80% responsiveness rate by 2018 [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>
        Another important element is the presence of moderation during discussions. While active moderation
can stimulate the debate and ensure respect and civility in online consultations [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], it can also be claimed to
bar freedom of speech when excluding comments. Kies [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] also argues that moderation can sometimes limit
the discussion of controversial topics and consequently diminish participation.
      </p>
      <p>
        Like other participation practices, some promote discussions, while others do not include instances for
deliberation. Deliberative formats can generate a series of benefits such as promoting epistemic gains for
participants and crowdsourcers [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ].
      </p>
      <p>
        Crowdsourcing legislation practices can include one or more channels of participation. They are also
sometimes connected, for example, to social networks, and frequently function as another source of
participant contribution [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. Having different channels of participation can increase participation.
      </p>
      <p>
        Like other crowdsourcing projects, they can differ according to their IT structure [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], which can be
either episodic or collaborative. In episodic forms of IT, participants often do not interact with each other
for the crowdsourcer to collect their contribution, while in collaborative ones, they do. This element is often
connected to whether they have deliberative formats or not, although the interaction between participants
does not necessarily take place through the exchange of arguments.
      </p>
      <p>Finally, crowdsourcing practices generally involve the collection of large quantities of data. The
processing method involved, whether automatic, human or both, can have several implications, including
whether the input is adopted by governments or not. In the crowdsourcing of the update to the Palo Alto
city plan, Chen &amp; Aitamurto find that civic data overload led the government to rely heavily on a human
filter, the citizen advisory committee, to synthesize and absorb public input. They conclude that this
hindered equality and inclusiveness in the process [13].</p>
    </sec>
    <sec id="sec-6">
      <title>4. A taxonomy for crowdsourcing legislation initiatives</title>
      <p>
        In order to propose a taxonomy of crowdsourcing legislation initiatives (Table 1), I first included the
features applied in existing crowdlaw case classifications and those hypothesized as valuable by Capone et
al. [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. “Audience” was not included due to the diversity of variables it could contain, although the
importance of assessing this feature is also recognized. I then proceeded to incorporate the new features
proposed in section 3. In a third step, the variables for each feature were added or created according to the
alternatives provided by the CrowdLaw initiative and/or pinpointed in the literature. Finally, additional
variables were included by incorporating suitable ones from Participedia6, a global crowdsourcing platform
on public participation and democratic innovations. Apart from the proposed features and variables, the
table also shows the source of the different features.
      </p>
    </sec>
    <sec id="sec-7">
      <title>5. Final remarks</title>
      <p>While new challenges of technology for policy- and lawmaking are constantly emerging, crowdsourcing
legislation projects are growing and diversifying their formats. The purpose of this paper was to advance
the criteria to better identify and analyze them. Eighteen key attributes were identified.</p>
      <p>The table includes features that can be contrasted amongst different initiatives within different contexts.
The specific institutional, legislative context the initiative is inserted within of course affects its dynamics,
as well as eventual external happenings.</p>
      <p>The criteria proposed do not configure an exhaustive list of features nor variables. Several variables
could also present other, hybrid, alternatives. This paper will be further developed to apply the taxonomy to
an in-depth analysis of crowdsourcing legislation cases. Hopefully, this will lead to a larger variety and
more precise features and variables.</p>
    </sec>
    <sec id="sec-8">
      <title>6. References</title>
      <p>[13] Chen, K., &amp; Aitamurto, T. (2019). Barriers for crowd’s impact in crowdsourced policymaking: Civic
data overload and filter hierarchy. International Public Management Journal, 22(1), 99-126.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Coglianese</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2004</year>
          ). E-Rulemaking:
          <article-title>Information technology and the regulatory process</article-title>
          . Admin. L. Rev.,
          <volume>56</volume>
          , 353.https://doi.org/10.2139/ssrn.500122
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>Brabham</surname>
            ,
            <given-names>D.C.</given-names>
          </string-name>
          (
          <year>2013</year>
          )
          <article-title>Crowdsourcing</article-title>
          . Mit Press. https://doi.org/10.7551/mitpress/9693.001.0001
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Alsina</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ; &amp;
          <string-name>
            <surname>Martí.</surname>
            ,
            <given-names>J. L.</given-names>
          </string-name>
          (
          <year>2018</year>
          ):
          <article-title>The Birth of the CrowdLaw Movement: Tech-Based Citizen Participation, Legitimacy and the Quality of Lawmaking</article-title>
          .
          <source>In: Analyse and Kritik</source>
          <volume>40</volume>
          (
          <issue>2</issue>
          ), S.
          <fpage>337</fpage>
          -
          <lpage>358</lpage>
          . DOI:
          <volume>10</volume>
          .1515/auk-2018
          <source>-0019</source>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Noveck</surname>
            ,
            <given-names>B. S.</given-names>
          </string-name>
          (
          <year>2018</year>
          ).
          <article-title>Forging smarter cities through CrowdLaw</article-title>
          .
          <source>Media and Communication</source>
          ,
          <volume>6</volume>
          (
          <issue>4</issue>
          ),
          <fpage>123</fpage>
          -
          <lpage>126</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>Aitamurto</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Chen</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          (
          <year>2017</year>
          ).
          <article-title>The value of crowdsourcing in public policymaking: Epistemic, democratic and economic value</article-title>
          .
          <source>The theory and practice of legislation</source>
          ,
          <volume>5</volume>
          (
          <issue>1</issue>
          ),
          <fpage>55</fpage>
          -
          <lpage>72</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>Capone</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Noveck</surname>
            ,
            <given-names>B. S.</given-names>
          </string-name>
          , G.kalp,
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Knox</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            , &amp;
            <surname>Murdter</surname>
          </string-name>
          ,
          <string-name>
            <surname>D.</surname>
          </string-name>
          (
          <year>2017a</year>
          ).
          <source>Online Public Participation in Lawmaking.</source>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>Silveiras</surname>
            ,
            <given-names>R. D. S.</given-names>
          </string-name>
          (
          <year>2014</year>
          ).
          <article-title>Consultas públicas para o Marco Civil da Internet e Reforma da Lei de Direito Autoral: a relação entre direito, Internet e Estado na contemporaneidade</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>Wright</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Street</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2007</year>
          ).
          <article-title>Democracy, deliberation and design: the case of online discussion forums</article-title>
          .
          <source>New media &amp; society, 9(5)</source>
          ,
          <fpage>849</fpage>
          -
          <lpage>869</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>Kies</surname>
            ,
            <given-names>R</given-names>
          </string-name>
          . (Ed.). (
          <year>2016</year>
          ).
          <article-title>Is Europe listening to us?: Successes and failures of EU citizen consultations</article-title>
          .
          <source>Routledge.</source>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Aitamurto</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          (
          <year>2016</year>
          ,
          <article-title>July)</article-title>
          .
          <article-title>Crowdsourced democratic deliberation in open policymaking: Definition, promises, challenges</article-title>
          .
          <source>International Reports on Socio-Informatics.</source>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Capone</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ituassu</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lifschitz</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Mannheimer</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          (
          <year>2017b</year>
          ).
          <article-title>Superposters, especialização e serviço: a Primeira Consulta Pública do Marco Civil da Internet no Twitter</article-title>
          .
          <source>Revista Fronteiras</source>
          ,
          <volume>19</volume>
          (
          <issue>2</issue>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>Prpić</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Taeihagh</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Melton</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>The fundamentals of policy crowdsourcing</article-title>
          .
          <source>Policy &amp; Internet</source>
          ,
          <volume>7</volume>
          (
          <issue>3</issue>
          ),
          <fpage>340</fpage>
          -
          <lpage>361</lpage>
          . https://doi.org/10.1002/poi3.102
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>