<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>and accountability
challenges in third-party governance is published in the Journal of Public Administration Research and
Theory</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Citizen Engagement in Technically Dynamic Environments</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Angie Westover-Muñoz</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>David Landsbergen</string-name>
          <email>Landsbergen.1@osu.edu</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Amanda M. Girth</string-name>
          <email>Girth.1@osu.edu</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>John Glenn College of Public Affairs, Ohio State University. 1810 College Rd. Columbus</institution>
          ,
          <addr-line>Ohio, 43210.</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <fpage>79</fpage>
      <lpage>87</lpage>
      <abstract>
        <p>Cities around the world are implementing technology-based solutions to make better the high volumes of data collected but also need to design and implement strategies to engage with citizens. This study explores why and how cities engage citizens in their smart city initiatives by analyzing the results of a nationwide survey of US cities. Results show that cities view the purpose of citizen engagement as more informative or to generate support for smart city efforts. Cities appear to use a diverse combination of mechanisms to engage citizens with smart city initiatives with an emphasis on simple, one-way communications from government to citizens.</p>
      </abstract>
      <kwd-group>
        <kwd>citizen engagement</kwd>
        <kwd>smart cities</kwd>
        <kwd>participation</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Cities around the world are implementing technology-based solutions to address a variety of
challenges, including those related to transportation, clean air and water, energy consumption, and
health. These technological "smart city" solutions rely on a significant volume of data, created or
collected by public institutions
        <xref ref-type="bibr" rid="ref8">(Janssen et al., 2012)</xref>
        . While there is no agreed upon definition of a
smart city
        <xref ref-type="bibr" rid="ref6">(Chouraby et al., 2012; Gil-Garcia et al., 2015)</xref>
        , this study takes the view that smart cities
are those that use of information and information technology to make better decisions and improve
quality of life
        <xref ref-type="bibr" rid="ref12">(Nam &amp; Pardo, 2011)</xref>
        . This perspective reflects a set of related trends or currents within
society. One current is the increased interest by cities in using data and new information
technologies. The increased use is driven by the internal needs of cities to respond to complex
- t is that there should
      </p>
      <p>
        Citizens are engaged in smart cities in any number of ways. They are engaged to the extent that
they are consumers of these services; for example, in Columbus, Ohio the public is informed about
the availability of new technologies like electric vehicles and how they can use these services. Also,
citizens and private, public, and non-profit organizations can passively receive the high volume of
data cities collect and make publicly available
        <xref ref-type="bibr" rid="ref14">(Paskaleva-Shapira, 2006)</xref>
        . Citizens can also be
involved in strategic or operational decision making of smart technologies (Thompson, 2016). For
example, Portland, Oregon has developed a city charter that places citizen engagement at the center
of all of its smart city efforts (The city of Portland, n.d.). This approach says that Portland is smart to
the extent that its citizens are smart and can meaningfully participat
role and importance of citizen engagement can vary widely from being a central goal that smart city
efforts are designed to advance or it can be viewed as one of many instrumental goals towards
ectives.
      </p>
      <p>The purpose of this study is to generally understand why and how cities engage citizens in smart
city initiatives. To do this, a nationwide survey was conducted of smart city officials in the US to
gather their perceptions of the purposes of citizen engagement and the mechanisms they use to
engage citizens. Preliminary results show that cities view citizen engagement as a means to inform
combination of participatory, consultative, and communicative mechanisms to engage citizens in
smart initiatives.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Citizen Engagement in the Complicated Smart City Environment</title>
      <p>Cities face an especially difficult task of building internal capacity for data-based decision-making.
While a central role of data and analysis in smart cities is to improve quality of life, technological
efforts can contribute to undermining the goal of equitable civic engagement unless there are strong
and explicit efforts to correct for the inequitable capacity to make use of the data.</p>
      <p>
        Citizens willingness and ability to be part of the process depends on multiple factors. Some of
these factors are related to the individuals' profile including educational level, digital literacy; as
well as the characteristics of the smart initiative itself
        <xref ref-type="bibr" rid="ref19">(Yeh, 2017)</xref>
        . Moreover, citizens may not
understand a smart city effort, how to participate, in addition to lacking minimal technical or
analytical skills
        <xref ref-type="bibr" rid="ref13">(Olphert &amp; Damodaran, 2007)</xref>
        . This may require efforts from the government to close
the gap through its design of an engagement plan. The public may not fully realize the value of the
data being provided and not be able to use that information to become fully involved in smart city
efforts in the absence of wider civic engagement. As a result, one concern is that data-based policy
recommendations may reflect the needs of technological experts and elites even more, excluding
other groups of the population from the benefits of being in a smart city
        <xref ref-type="bibr" rid="ref7">(Hollands, 2008)</xref>
        unless
there is a robust citizen engagement plan.
      </p>
      <p>
        Even as citizens are continually improving their digital literacy, this improvement is not
homogeneous across the population. Moreover, the digital literacy and analytical skills of citizens
can determine their ability to understand the information they are receiving, and frame their
perceptions regarding the technology that cities are trying to implement, leading to fear, rejection
        <xref ref-type="bibr" rid="ref10">(Lytras &amp; Visvizi, 2018)</xref>
        , or self-exclusion from the process
        <xref ref-type="bibr" rid="ref9">(Kvasny &amp; Keil, 2006)</xref>
        .
      </p>
      <p>
        Whether it is citizens overall or particular subpopulations, citizens could develop negative
attitudes towards the use of the smart technologies, determining their frequency of use, their
perceived value added and their willingness to participate in and support smart city projects.
        <xref ref-type="bibr" rid="ref10">Lytras
&amp; Visvizi (2018)</xref>
        find that most citizens support smart city initiatives but very carefully select the
services they will use due to their concerns about security and reliability of the systems. Different
kinds of citizen engagement may have differential effects on the degree to which citizens are
apathetic, concerned, or advocates for the initiative.
      </p>
      <p>
        There may also be a deficit of technical skills within the city that make it difficult to generate and
implement innovation
        <xref ref-type="bibr" rid="ref4">(Dunleavy, 2006)</xref>
        . The introduction of robust citizen engagement mechanisms
such as citizens co-creating a strategic vision, may exhaust the capacity of cities to execute projects
properly. Significant citizen engagement can compound complexity and the risk of projects. As
governments now move to agile management techniques that call for quick simple solutions this
may also work against the longer timelines needed for robust citizen engagement. Finally, cities may
not have the funds to implement engagement strategies, because resources can be allocated to
alternative goals, like direct investment on technology or other operational costs.
      </p>
      <sec id="sec-2-1">
        <title>2.1. Purposes of Citizen Engagement</title>
        <p>
          Citizen engagement can take place in different stages of the innovation process and it can serve
multiple goals. Governments can decide to implement citizen engagement to meet legal
requirements, embody ideals of democratic participation and inclusion, diagnose a problem, design
a solution, co-produce a policy or program, generate support for an initiative, or create and sustain
social capital, among others
          <xref ref-type="bibr" rid="ref2">(Bryson et al., 2012)</xref>
          . According to
          <xref ref-type="bibr" rid="ref2">Bryson et al. (2012)</xref>
          , identifying the
purposes of citizen engagement will serve as the foundation for designing a strategy and to select
the cri
decision-making phase, either to collect useful information for the design of a solution, or to include
them directly in the decision
          <xref ref-type="bibr" rid="ref2">(Bryson et al., 2012)</xref>
          . They could also include citizens in the
implementation of the program as a form of co-production, or to simply identify critical factors for
the success of the initiative
          <xref ref-type="bibr" rid="ref11">(Mejier &amp; Rodriguez, 2016)</xref>
          Error! Reference source not found.. Finally,
citizens could also be included in the governance of a program to help make relevant decisions and
be a part of the management of the initiatives
          <xref ref-type="bibr" rid="ref5">(Fung, 2006)</xref>
          .
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>2.2. Citizen Engagement Mechanisms</title>
        <p>surveys, meetings, or simply providing information). The mechanisms that cities can use to engage
citizens are multiple and scholars have debated the dimensions used to categorize these
mechanisms. The operating assumption is that different kinds of mechanisms are useful for different
purposes contingent on the ability of a city to use those mechanisms.</p>
        <p>
          <xref ref-type="bibr" rid="ref16">Rowe and Frewer (2005)</xref>
          Error! Reference source not found. developed a typology for
engagement tools sorted into dimensions of communication, consultation, and participation. These
In public communication, local government sends information to citizens or other representatives.
In the case of public consultation, the information goes from the public to the government, but the
process is initiated by the latter. Finally, for public participation there is a bidirectional exchange of
information, in which dialogue and deliberation take place. The degree to which a specific
mechanism can fulfill effectively the goals of each typology depends on certain attributes. To date,
researchers have not used a national and diverse sample to investigate how cities engage citizens in
smart initiatives, what cities are finding successful, and what lessons can be learned to improve
citizen engagement.
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. Data, Method, and Measures</title>
      <p>
        This study provides exploratory insights on smart city citizen engagement initiatives in cities across
the US. A descriptive empirical analysis is used to report results from a nationwide survey of city
officials in the US, and lays the groundwork for future additional analysis. The survey was sent to
the 1,000 most populated cities within the US, according to census data
        <xref ref-type="bibr" rid="ref18">(US Census, 2017)</xref>
        . The
surveys were sent to public officials working in the local governments in the positions of chief
information officer, information technology managers, city managers, or similar; individuals were
identified through city websites and LinkedIn. The survey was emailed to one individual in each
city in late 2019. The maximum response rate for the citizen engagement questions was 10%. There
is only one response per city.
      </p>
      <p>The unit of analysis is the city. For all the citizen engagement questions, respondents were asked
to refer to their largest smart city project. The largest smart city project was defined as the one with
the biggest overall cost, including the total investment by all partners. The largest smart city project
has the highest likelihood of showing the wide range of citizen engagement purposes and
mechanisms that cities are implementing. The projects total cost range from a $12,000 to $1,000,000,
with a mean of $30,799 and a standard deviation of $122,490. In average a 67.80% of that cost is
public expenditure (sd. 59%). Most of the projects (63%) have been operating for less than 2 years,
24% from 3 to 5 years, and 13%for more than 6 years.</p>
      <p>
        Nine items included as purposes were adapted form the list present in Bryson and Quick [4]. The
frequency of each purpose is presented item-by-item. The survey contained a list of 10 mechanisms
adapted from the inventory developed by
        <xref ref-type="bibr" rid="ref16">Rowe &amp; Frewer (2005)</xref>
        . Respondents were asked to
indicate if they use (1) or not use (0) a specific mechanism. The mechanisms were classified using
the three typologies of engagement developed by
        <xref ref-type="bibr" rid="ref16">Rowe &amp; Frewer (2005)</xref>
        : communication,
consultation and participation.
      </p>
      <p>Seven combinations of mechanisms were created (communication only, consultation only,
participation only, communication-consultation, communication-participation,
consultationparticipation, and communication-consultation-participation). Each city was included in one of
these combinations where it had one mechanism in one of the basic types of mechanisms</p>
    </sec>
    <sec id="sec-4">
      <title>4. Results</title>
      <p>(communication, consultation, or participation). Thus, if a city had two communication mechanisms
and one consultative mechanism, it was put in the communication-consultation combination.
This section reports the frequencies of the purposes of citizen engagement and the mechanisms
utilized. Figure 1 contains the percentage of cities that declared having each purpose as part of their
plan to engage citizens in their largest smart city project. The most common purpose is to send
information to residents (86%), followed by gaining citizen support (69%). The high prevalence of
these purposes is consistent with the results shown in figure 2 for engagement mechanisms. Cities
commonly used communication mechanisms (one-way from city to citizen) whose aim is to send
information to citizens.</p>
      <p>On the other extreme, the less frequently declared purpose is to meet legal requirements (22%).
The small number of cities that declare having this as a purpose for the engagement of citizens is
interesting. One potential explanation is that there are not clear or predetermined legal requirements
on how and when to engage citizens in smart city initiatives since a large number of these cities are
still in an early stage of implementation of these kinds of projects.</p>
      <p>Figure 2 presents the percentage of cities that use each one of the mechanisms. The most used
mechanisms to engage citizens are information publicly availably (64%) and meetings to provide
information (56%). On the opposite side, the less used mechanisms are meetings to design a solution
with citizens and meetings to make binding decisions (both 8%). The percentage of cities that
implement each mechanism in their smart city initiatives seems to align with the level of intensity
of the interaction that each one requires. The most commonly used are communication mechanisms,
followed by consultation, while participation mechanisms are the less used. The most frequently
used citizen engagement mechanisms are those that require less interaction. These include making
information publicly available and meetings to provide information mechanisms that are intended
to just send information to the community.</p>
      <p>In contrast, the less frequently used mechanisms are those that require the most active interaction</p>
      <p>D M
bidirectional exchanges of information, but also involve expressing and forming opinions through
deliberation. This intense level of interaction can slow projects down and may require particular
skills or involve the expenditure of additional resources that the city does not have. One exception
to this general finding of the relationship between intensity and use, are 'Meetings with experts'
which are at a higher level of intensity but frequently used. Relying on experts may be efficient in
that they provide useful information including what citizens want and guide governments toward</p>
      <p>Another exception are 'Hotlines or 311' with a low intensity but not used frequently.
This may owe less to being low intensity and easy to use but are simply less effective for smart city
engagement.</p>
      <p>Figure 3 reports how cities combine different type of mechanisms. Most of the cities use a
combination of communication, consultation and participation mechanisms (45%). Using
combinations of communication with consultation, and communication with participation are the
second and third most popular cases (18 and 12% respectively). Only a minor percentage of cases
concentrate their portfolio purely in one of the three types of engagement. How they determine and
decide what the right combination of engagement mechanisms to achieve their purposes is, could
be because of a) the synergies among specific set of mechanisms, b) a response to experiences
engaging citizens in the past, or c) a random combination. This question cannot be responded with
this data, but could be explored in future case study research.</p>
    </sec>
    <sec id="sec-5">
      <title>Discussion</title>
      <p>Overall, the results indicate that cities perceive the purpose of citizen engagement as a way to
generate support for smart city initiatives or to inform citizens. There is less emphasis on legal
compliance or interactive design of projects. The low emphasis on legal compliance might mean that
legal requirements are a floor for citizen engagement. Earlier it was suggested that one potential
explanation for the low emphasis on legal requirements is that there are not clear or predetermined
legal requirements on how and when to engage citizens in smart city initiatives since a large number
of these cities are still in an early stage of implementation of these kinds of projects (reported in table
1). Alternatively, cities could have specific requirements to engage citizens in general, but since this
represents a minimum requirement, it becomes a routine rather than fully capturing why they are
doing citizen engagement. Put another way, there are much more important reasons for doing
citizen engagement than simply meeting legal requirements.</p>
      <p>The different purposes for doing citizen engagement, in some cases, might compete with each
other; for example, .
Yet the variety of purposes reported by cities might also mean that purposes can be harmonized. In
any case, cities might consider giving citizens the opportunity to be heard early in the process as it
might lead to better designed solutions. These tradeoffs or congruencies need to be explored
creatively by smart city managers.</p>
      <p>There may be many reasons why cities seem more reticent to use participation mechanisms. The
implementation of more participative mechanisms can require a bigger investment in time and
resources from the city, especially in the context of smart city projects, where other survey results
indicated that the financial resources seem to be unstable and unpredictable. Moreover, processes
that include deliberation increase challenges like lack of interest or capacity to understand and
process information, which could make them less likely to participate. Finally, since these process
involve deliberation, planning and implementing them effectively could be more difficult than with
simpler mechanisms without so many interests at stake.</p>
      <p>While the results of this survey show that cities use a variety of mechanisms to engage citizens in
smart city projects which is a good thing the most commonly used tools are the simpler one-way
communication mechanisms. The more intense forms of engagement, such as participatory or
consultative are less commonly employed. The presumption is that cities should be matching
mechanisms to the kinds of purposes that they are seeking to realize. If smart city purposes are
complex, while the mechanisms chosen are simple and easier, there could actually be a mismatch
between the goals and the means used to achieve them.. The use of simple mechanisms could be a
result of a lack of skills, resources, or understanding of the benefits of robust citizen engagement.
Given that a variety of different kinds of mechanisms is preferable, it may be important to identify
best practices and understand what experience among many cities has actually shown. This would
include knowing what the real costs and risks are, followed by training.</p>
      <p>This study is the first step in a larger research project on smart city initiatives. Next steps include
comparing administrator and citizen perceptions of barriers to citizen engagement and what
constitutes successful citizen engagement. There are interesting dynamics and relationships that
should be explored in more detail. Most important for practice is to understand how administrators
create pragmatic solutions given the competing purposes and constraints. In depth case studies are
another next logical step to build upon the results described here.</p>
      <p>Thompson, E. M. (2016)
358-371.</p>
      <p>International Journal of Architectural Computing, 14(4),</p>
      <sec id="sec-5-1">
        <title>About the Authors</title>
        <p>Angie Westover-Muñoz
David Landsbergen
Angie Westover-Muñoz is a Ph.D. Student in Public Policy and Management at John Glenn College of Public
Affairs, The Ohio State University. Her research interests include technology and data-driven policies, and
citizen engagement.</p>
        <p>David Landsbergen is an associate professor at the John Glenn College of Public Affairs at The Ohio State
University. He has written about modernizing information systems, interoperability, privacy, developing
technical standards, public records, and open data in Government Information Quarterly, IEEE Transactions,
the Journal of Public Administration Research and Theory, Public Administration Review, and the Journal of
Policy Analysis and Management.</p>
        <p>Amanda M. Girth</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Abella</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ortiz-De-Urbina-Criado</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>De-Pablos-Heredero</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2017</year>
          )
          <article-title>A model for the analysis of datadriven innovation and value generation in smart cities' ecosystems</article-title>
          . Cities,
          <volume>64</volume>
          (April),
          <fpage>47</fpage>
          -
          <lpage>53</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Bryson</surname>
            ,
            <given-names>J. M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Quick</surname>
            ,
            <given-names>K. S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Crosby</surname>
            ,
            <given-names>B. C.</given-names>
          </string-name>
          (
          <year>2012</year>
          )
          <article-title>Designing Public Participation Processes</article-title>
          .
          <source>Public Administration Review</source>
          ,
          <volume>73</volume>
          (
          <issue>1</issue>
          ),
          <fpage>23</fpage>
          <lpage>34</lpage>
          . https://doi.org/10.111/j.1540-
          <fpage>6210</fpage>
          .
          <year>2012</year>
          .
          <volume>02678</volume>
          .x.Designing
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Chourabi</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nam</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Walker</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gil-Garcia</surname>
            ,
            <given-names>J. R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mellouli</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nahon</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Scholl</surname>
            ,
            <given-names>H. J.</given-names>
          </string-name>
          (
          <year>2012</year>
          )
          <article-title>Understanding smart cities: An integrative framework</article-title>
          .
          <source>In 2012 45th Hawaii international conference on system sciences (pp</source>
          .
          <fpage>2289</fpage>
          -
          <lpage>2297</lpage>
          ). IEEE
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Dunleavy</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>2006</year>
          )
          <article-title>Digital era governance: IT corporations, the state</article-title>
          , and e-government / Patrick Dunleavy [et al.]. Oxford :: Oxford University Press.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Fung</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2006</year>
          )
          <article-title>Varieties of Participation in Complex Governance</article-title>
          .
          <source>Public Administration Review</source>
          ,
          <volume>66</volume>
          ,
          <fpage>66</fpage>
          75.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Gil-García</surname>
            ,
            <given-names>J. R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pardo</surname>
            ,
            <given-names>T. A.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Nam</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          (
          <year>2015</year>
          )
          <article-title>What makes a city smart? Identifying core components and proposing an integrative and comprehensive conceptualization</article-title>
          .
          <source>Information Polity</source>
          ,
          <volume>20</volume>
          (
          <issue>1</issue>
          ),
          <fpage>61</fpage>
          -
          <lpage>87</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <surname>Hollands</surname>
            ,
            <given-names>R. G.</given-names>
          </string-name>
          (
          <year>2008</year>
          )
          <article-title>Will the real smart city please stand up? Intelligent, progressive or entrepreneurial?</article-title>
          <source>City</source>
          ,
          <volume>12</volume>
          (
          <issue>3</issue>
          ):
          <fpage>303</fpage>
          -
          <lpage>320</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Janssen</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Charalabidis</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Zuiderwijk</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2012</year>
          )
          <article-title>Benefits, Adoption Barriers and Myths of Open Data and Open Government</article-title>
          .
          <source>Information Systems Management</source>
          ,
          <volume>29</volume>
          (
          <issue>4</issue>
          ),
          <fpage>258</fpage>
          -
          <lpage>268</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>Kvasny</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Keil</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2006</year>
          )
          <article-title>The challenges of redressing the digital divide: A tale of two US cities</article-title>
          .
          <source>Information systems journal</source>
          ,
          <volume>16</volume>
          (
          <issue>1</issue>
          ),
          <fpage>23</fpage>
          -
          <lpage>53</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <surname>Lytras</surname>
            ,
            <given-names>M. D.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Visvizi</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2018</year>
          )
          <article-title>Who Uses Smart City Services and What to Make of It : Toward Interdisciplinary Smart Cities Research</article-title>
          . Sustainability,
          <volume>10</volume>
          (
          <year>1998</year>
          ):
          <fpage>1</fpage>
          <lpage>16</lpage>
          . https://doi.org/10.3390/su10061998
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>Meijer</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Rodriguez</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2016</year>
          )
          <article-title>Governing the smart city : a review of the literature on smart urban governance</article-title>
          .
          <source>International Review of Administrative Sciences</source>
          ,
          <volume>82</volume>
          (
          <issue>2</issue>
          ), 392
          <fpage>408</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <surname>Nam</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Pardo</surname>
            ,
            <given-names>T. A.</given-names>
          </string-name>
          (
          <year>2011</year>
          )
          <article-title>Conceptualizing smart city with dimensions of technology, people, and institutions</article-title>
          .
          <source>In Proceedings of the 12th annual international digital government research conference: digital government innovation in challenging times</source>
          (pp.
          <fpage>282</fpage>
          -
          <lpage>291</lpage>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <surname>Olphert</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Damodaran</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          (
          <year>2007</year>
          )
          <article-title>Citizen participation and engagement in the design of e-government services: The missing link in effective ICT design and delivery</article-title>
          .
          <source>Journal of the Association for Information Systems</source>
          ,
          <volume>8</volume>
          (
          <issue>9</issue>
          ),
          <fpage>27</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <surname>Paskaleva-Shapira</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          (
          <year>2006</year>
          )
          <article-title>Transitioning from e-Government to e-Governance in the Knowledge Society: The Role of the Legal Framework for Enabling the Process in the European Union's Countries</article-title>
          .
          <source>Paper presented at the 7th Annual International Conference on Digital Government Research</source>
          , San Diego.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <string-name>
            <surname>Pereira</surname>
            ,
            <given-names>G. V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Eibl</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stylianou</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Martínez</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Neophytou</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Parycek</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>2018</year>
          )
          <article-title>The Role of Smart Technologies to Support Citizen Engagement and Decision Making: The SmartGov Case</article-title>
          .
          <source>International Journal of Electronic Government Research (IJEGR)</source>
          ,
          <volume>14</volume>
          (
          <issue>4</issue>
          ):
          <fpage>1</fpage>
          -
          <lpage>17</lpage>
          . doi:
          <volume>10</volume>
          .4018/IJEGR.2018100101
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <string-name>
            <surname>Rowe</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Frewer</surname>
            ,
            <given-names>L. J.</given-names>
          </string-name>
          (
          <year>2005</year>
          )
          <article-title>A Typology of Public Engagement Mechanisms</article-title>
          .
          <source>Science, Technology &amp; Human Values</source>
          ,
          <volume>30</volume>
          (
          <issue>2</issue>
          ),
          <fpage>251</fpage>
          <lpage>290</lpage>
          . https://doi.org/10.1177/0162243904271724
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <source>The city of Portland</source>
          , Oregon. - Civic Engagement Partners.
          <article-title>Retrieved from Civic Engagement Partners</article-title>
          , https://www.portlandoregon.gov/civic/60436, last acceded
          <year>2020</year>
          /02/14.
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          <string-name>
            <surname>U.S. Census</surname>
            <given-names>Bureau.</given-names>
          </string-name>
          (
          <year>2017</year>
          ), American Community Survey, 2017 American Community Survey 1-
          <string-name>
            <given-names>Year</given-names>
            <surname>Estimates</surname>
          </string-name>
          ,
          <article-title>using data.census</article-title>
          .gov, available at: https://data.census.gov/cedsci/
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          <string-name>
            <surname>Yeh</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          (
          <year>2017</year>
          )
          <article-title>The effects of successful ICT-based smart city services: From citizens' perspectives</article-title>
          .
          <source>Government Information Quarterly</source>
          ,
          <volume>34</volume>
          (
          <issue>3</issue>
          ):
          <fpage>556</fpage>
          -
          <lpage>565</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>