<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Sidewalk and Toronto: Critical Systems Heuristics and the Smart City</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Curtis McCord</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Christoph Becker</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>University of Toronto, Faculty of Information</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>-'Smart cities', urban development projects that design computational systems and sensory technology to monitor activity and regulate energy consumption and resource distribution, are a frontier for the prospective deployment of ICTs for sustainability. Often reduced to technological problems of optimization, these projects have implications far beyond narrow environmental and consumptive frames of sustainability. Studying them requires frameworks that support us in examining technological and environmental sustainability dimensions jointly with social justice perspectives. This paper uses Critical Systems Heuristics (CSH) to examine the design of Sidewalk Toronto, an ongoing smart city development. We explore how the professed values guiding the project are contentiously enacted, and we argue that key stakeholders and beneficiaries in the planning process significantly constrain the emancipatory and transformative potential of the project by marginalizing the role of residents in determining project purposes. This analysis contributes an example that illustrates the relevance of critical systems thinking in ICT4S and offers CSH as a conceptual frame that supports critical reflection on the tensions between the visions and realities of 'sustainable' ways of organizing human life.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>I. INTRODUCTION</title>
      <p>
        ‘A neighbourhood from the internet up’ [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]
‘Google’s Guinea-Pig City’ [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]
‘Smart City, Dumb Deal’ [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]
      </p>
      <p>Controversy surrounds the proposed development of the
Sidewalk Labs ‘smart city’ project in Toronto. In the world’s
most diverse city, the world’s most powerful computing
business (Google’s Alphabet) has partnered with the municipal
government, promising to build the sustainable city of the
future. This project is imagined as a prototype, a
technologydriven flagship, and a vehicle for legitimizing an ICT
company’s bid to shape the future of cities worldwide.</p>
      <p>The term ‘smart city’ is full of promises: as human activity
condenses into urban environments, urban life has become
the site for sustainable design. Since ICT have become a
foundation of dominating cultures and economies, they are
seen as a choice strategy to make cities sustainable. The
drivers of this kind of sustainable development are
largescale collection and analysis of observational and statistical
data, and cybernetic feedback through embedded devices and
human-facing software. The term ‘smart city’ subsumes these
technologies, the logic that relates them to goals of
sustainability, and the aesthetic of a sustainable city.</p>
      <p>This paper examines how the Sidewalk Toronto project’s
purposes are influenced by the goals of it’s most powerful
stakeholders, Waterfront Toronto and Sidewalk Labs. This
paper will argue that sustainability, and thus smart city projects,
should be considered more holistically than is possible through
the narrow lenses of technological optimization and
environmental sustainability. Failure to consider systems critically
can leave out considerations with important impacts for how
sustainability is pursued, and how power and decision-making
might influence that pursuit.</p>
      <p>
        The paper’s argument continues the trajectories set by Mann
et al. [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], Easterbrook [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] and Becker et al. [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], namely
that Information Communication Technology for
Sustainability (ICT4S) research must take a more ambitious, critical,
and holistic approach to sustainable design than is possible
through piecemeal interventions or optimization of
environmental parameters [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Sustainability design has implications
for our economies, societies, technologies, our cooperative
work, and our individual lives[
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. Building on Easterbrook’s
critique of “computational thinking”[
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], we explore the
viability of systems thinking concepts by analysing Sidewalk
Toronto, a high profile sustainable smart city proposal. Unlike
Easterbrook’s focus on System Dynamics, however, our
analysis uses Critical Systems Heuristics (CSH) to examine the
planning and engagement process of Sidewalk Toronto, and
to mount a boundary critique that provides insights on the
value judgments and justifications that promote and legitimate
the project’s technology choices and designs. By tracing the
concerns of those involved and those affected, we examine
how values and interests influence and constrain the purposes
and vision of Sidewalk Toronto, offering CSH as a conceptual
framework to support technology-supported transitions to just
and sustainable societies. We hope this can help the ICT4S
community to better understand how each of us can ‘shift the
maturity needle’ upwards [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
    </sec>
    <sec id="sec-2">
      <title>II. BACKGROUND</title>
      <sec id="sec-2-1">
        <title>A. Smart Cities in ICT4S</title>
        <p>
          Smart city research in the ICT4S community has focused on
the design of specific products to affect consumption patterns
[
          <xref ref-type="bibr" rid="ref7">7</xref>
          ], [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ], to provide ICT-based management and evaluation
tools [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ], [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ], [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ], as well as to understand the new
relationships between technologists and policymakers forged in
smart city projects [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ], [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ], even making structural critiques
about the agency of citizens herein [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ].
        </p>
        <p>
          As the concept of the smart city becomes more popular
in the ICT4S community, care must be taken to avoid
replicating the weaknesses in considering technological systems
as separable from the much larger and complex systems of
social organization and reproduction within which they are
embedded. For example, Borjesson et al. argue that a narrow
technological/environmental frame for smart cities neglect the
importance of social-systemic patterns of consumption and
activity, in favour of a simplistic understanding of humans
as atomized beings who make decisions based on economic
and rational calculations [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ]. Kamilaris et al. [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ] and von
Heland et al.[
          <xref ref-type="bibr" rid="ref8">8</xref>
          ] discuss interventions that build upon economic
and social relations among their participants, although these
relations also act as a source of inertia.
        </p>
        <p>
          To consider smart cities as abstract systems that can be
algorithmically optimized for sustainable energy and resource
use fails to do justice both to present and future residents and
to the ideal of sustainability. As Mann et al. argue, approaches
to sustainability in the ICT4S community must make a strident
effort to move beyond merely acknowledging the importance
of sustainability, or simply proposing product-based
interventions or efficiency finding manoeuvres [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ]. For us, this
means enabling ICT4S research to conceive of sustainability
holistically, without abstracting it to information and resource
management projects. Transformative sustainability requires
critical analysis and questioning of much of humanity’s habits
and practises, be they social, economic, political or
technological. Nowhere is this more apparent than in the discourse of
the smart city, a new construction of urban life according to
state of the art technologies and practises. At this intersection,
the political, economic and social dimensions of sustainability
practise are readily implicated, and researchers committed
to sustainability require tools to critically interrogate these
relationships.
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>B. Sidewalk Toronto</title>
        <p>
          The case we analyze is the Sidewalk Toronto smart
city project being planned in the 12-acre Quayside area
of Toronto’s waterfront: a joint venture between Waterfront
Toronto (WT) and Sidewalk Labs (SL), an urban development
and technology firm and Alphabet (Google’s parent company)
subsidiary. Sidewalk Toronto is to be a pilot for future local
development, and a test-bed for smart city development globally.
In 2017, WT issued a request for proposals that situated smart
cities as a technological approach to sustainability, eliciting
a partnering firm that could use ICTs to create a “climate
positive approach [to urban design] that will lead the world in
city building practises” [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ]. This RFP was answered and won
by an ambitious Vision statement by SL for an ecologically
sustainable community built on terms of cybernetic ecology
that could serve as a replicable and universalizable model for
smart city projects globally. SL’s Vision seeks to sustainability
and replicability by building a neighbourhood informated and
monitored at all levels, the “most measurable community in
the world” [1, p.22].
        </p>
        <p>
          Excepting the foregrounding of sustainability concerns, the
principles extolled in WT’s RFP and Sidewalk’s Vision are
congruent with the “Smart City Principles” explored by
Cosgrove et al., placing the focus of human work on service
provision driven by optimization, grounded in an
“information marketplace” [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ]. Beyond environmental sustainability,
Sidewalk Toronto’s ecology includes social and economic
dimensions of sustainability through its focus on “complete
communities”, and through specific products like a “public
realm management system”. The design process itself strives
for “holistic planning”, where “innovation, community
priorities, policy objectives, placemaking, phasing, infrastructure,
economics, market, site planning, and technical issues will
be thoughtfully merged” [1, p.59]. This public engagement
component is the front line in drawing system boundaries that
will structure the smart city and its operation.
        </p>
      </sec>
      <sec id="sec-2-3">
        <title>C. Systems Thinking in ICT4S</title>
        <p>
          Sidewalk Toronto is envisioned in terms of systems: a
“nextgeneration transit system”, a “district wide energy system”,
an “ecosystem” that supports economic agents, as well as
a collection of information systems that support relations
between residents, such as the “public realm management
system” [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ]. The Vision even foresees groups of people
engaged in everyday life systemically: “a system of networked
neighbourhoods. . . [that] will begin to operate at a system
scale, like the internet, generating advantages that increase
with each new node” [1, pg.21]. Systems Thinking is essential
for a critique of Sidewalk Toronto because the project pursues
aims of sustainability through the systematization of everyday
life, creating a space where the activities are monitored as
informational transactions, refined into actionable intelligence,
and turned back onto the behaviours of smart city residents.
        </p>
        <p>As a systems design project, Sidewalk Toronto intends to
construct a system of life from the ground up, so that it might
be replicated universally.</p>
        <p>Easterbrook’s call for the integration of systems thinking
contexts into computational research stems from three
perceived weaknesses in the dominating ‘computational’ way of
thinking. First, he argues that the domain ontology of
computational thinking is problematically biased by its dependence
on computational terms, techniques, metaphors, and
heuristics for describing the world [5, p.239-240]. Computational
thinking is most powerful when complexity can be reduced
to deterministic sets of variables and interactions, managed
hierarchically by a system and “solved” by reckoning. As
Easterbrook notes, though subfields in computer science have
developed techniques to capture what was overlooked, they
are for the most part expansions of computational thinking.</p>
        <p>To enrich the descriptive capacities of computational thinkers,
Easterbrook proposes the use of concepts from the area of
System Dynamics, which has a close connection of ecological
thinking and uses concepts of feedback, stocks, and flows.</p>
        <p>Second, Easterbrook argues that computational thinking
has a limited capacity to understand how systemic change
occurs. Either change is explained deterministically (in terms
of having access to technologies or information previously CSH is heuristic, admitting that no standpoint or theory can
absent), or as the result of responsible individuals, who “have ever sufficiently justify its own assumptions [17, p.287]. Any
agency over their social and environmental impacts, ... [and analysis, including our own, must take its own partial
standonly need] better tools to help them become more sustainable” point, and can neither comprehensively describe a situation,
[5, p.240]. In thinking about smart cities, we try to avoid nor subsume all possible perspectives of it. At best, CSH can
technological solutionism. seek to reveal and problematize the normative assumptions</p>
        <p>Third, Easterbrook criticizes computational thinking as ill- informing a plan, making clear the contingent nature of these
equipped to handle complexity critically, and as a result strug- boundaries and making them the subject of deliberation. CSH
gles to consider “questions about how relationships of power is intended to enable citizens or participants in a decision
are created and maintained in society, and how the tools that making process to engage in critique of expert knowledge, and
mediate social interactions affect these relationships. . . [and] to discover sources of deception or implicit strategic action
who has the power to create or prevent change” [5, p.241]. [17, p.22].</p>
        <p>These questions are essential to considering how our societies CSH aims to avoid coercion in planning by, inasmuch as
can be reorganized to be holistically sustainable. Easterbrook possible, eroding the boundaries between those affected by
here covers the key presuppositions that underpin a critical a system and those involved in the decision making process
systems approach: (1) that deciding on an account of a system [17, p.248]. At stake is how those involved, as participants and
necessarily means partitioning it from the larger context in observers, can rationally justify and legitimate the boundaries
which it is embedded, (2) that “any interesting system” will and concepts that structure systems design. Domain or
techbe complex enough such that no single definitive model or nical experts may be better able to make claims or have more
counter-factual claim can be non-probabilistically true (so power to make decisions, but they cannot justify or legitimate
disagreement is inevitable), and (3) that the standpoint of the these claims without recourse to assumptions about the way
observers are undeniably mediated by the ways we think, act the world is structured and how a system ought to be designed
and learn about a situation [5, p.242]. to accomplish the purposes for which it is created. Only the
affected can legitimate the implications of any technology</p>
        <p>III. CRITICAL SYSTEMS HEURISTICS design as far as they affect their own lived experience. On
As Ulrich compellingly argues, it is not enough to try and be this matter, they are the legitimate experts.
holistic. Systems thinkers must also deal critically with their Those involved in decision making construct the boundary
own inevitable selectivity and lack of comprehensiveness, by judgments that constitute an intelligible social systems
dereflecting on their own understandings as equally partial. sign. This raises questions about motivation, control, and the</p>
        <p>
          As the major framework in critical systems thinking[
          <xref ref-type="bibr" rid="ref16">16</xref>
          ], expertise needed for implementation. The sorts of decisions
CSH is of course systemic. Some kinds of systems thinking inevitably made to plan a system are summarized in twelve
–including System Dynamics approaches– are just as focused boundary judgments derived from the intersection of four
catas computational thinking on description, abstraction, and egories with three levels of concern [17, p.244ff]. These four
modelling. By contrast, CSH is not dependent on a ‘realist’ categories are shown in Fig.1. Application of CSH involves
ontology that assumes descriptions of a system correspond to moving through the twelve questions, often shifting between
a real (existing) arrangement in the world. CSH is concerned “is” and “ought” modes. The former mode asks us to reflect
with discursive acts, with decisions made by multiple par- on how we see boundary judgments in practise. The latter
ties with varying goals, epistemic frameworks, and ways of is intended to stimulate critical reflection on the adequacy
describing the world and the systems being designed. Rather of those judgments. It might focus on what is left out, and
than seeking to classify the component elements of an assumed the moves made by the involved to constrain or preempt
system or provide a model of their relations, CSH focuses on boundaries for systems design.
the reflexive consideration of a designed system’s purpose or CSH can be used: (1) to support ideal planning or critical
goals, and how these are justified by a ‘reference system’ of reflection in reflective practise or action research; (2) as
assumptions and judgments. The central entrance point to this an evaluative framework applied to planning situations or
reflection is the system’s purpose, which is not a thing in itself, decision making processes that define and specify a system
but deployed by someone as a matter of heuristic necessity. to be designed [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ]; and (3) polemically, to question experts’
Any system or plan humans design will be designed for some claims about what is ‘objectively necessary’ and expose the
purpose, to serve some interest or need, according to some implicit boundary judgments they make. CSH is not simply
worldview [17, p.243]. Purposes are necessary to make an a questionnaire to be populated, however, but a system of
endeavour intelligible. categories to structure a discursive, reflective, or dialectic
        </p>
        <p>CSH is critical. In contrast with structural accounts of process. As such, its raises questions rather than answers them.
change, critical systems thinking means not only acknowledg- Our use of CSH to critically examine the boundary judgments
ing the systemic interconnections of behavioural patterns (such in Sidewalk Toronto is no exception. For this analysis, we
as the use of fossil fuels with the design of cities), but to see used official SL and WT documentation, public engagement
that these patterns are not homeostatic but actively maintained reports, and press articles. We have also participated in several
and could, therefore, be changed. planning sessions, and have visited the affected spaces.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>IV. CSH AND THE SMART CITY</title>
      <sec id="sec-3-1">
        <title>A. The official story</title>
        <p>
          The project’s stated purpose is to create “a vibrant,
climatepositive and prosperous community. . . as a national and global
model to encourage market transformation towards
climatepositive city building” [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ]. The RFP positions the initial site
(Quayside) as stepping stone for “subsequent developments
on the eastern waterfront”[15, p.6]). WT adopts the “triple
bottom line” approach that balances environmental, economic,
and “socio-cultural” purposes in the “3Ps” of people, profits,
and planet [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ], [20, p.A4].
        </p>
        <p>
          Declared beneficiaries include prospective residents in
Toronto, including “people of all income levels and at all
stages of life” who will benefit from a “future proof” life in
an inclusive “complete community”. This includes “employers
and job creators” who benefit from access to a dense cluster of
skilled labour and competing firms, as well as the businesses
who sustaining and sustained by the community. Tourists
and residents of the greater Toronto area will benefit from
the addition of significant cultural and recreational amenities
to the waterfront[
          <xref ref-type="bibr" rid="ref1">1</xref>
          ], [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ]. Finally, the RFP clearly denotes
the prospective partner (SL) as a beneficiary to balance the
requirement that the partner provide $50M CAD to cover
project costs. Key benefits to SL are an “unparalleled testbed
environment” to “showcase advanced technologies, building
materials, sustainable practices and innovative business models
that demonstrate pragmatic solutions to climate positive urban
development”; “financial opportunities” from real-estate
transactions (even beyond Quayside); and, critically, intellectual
property (IP) [15, p.18].
        </p>
        <p>
          To assure that the project has succeeded in its purpose to
create an environmentally and socially sustainable community
in a market friendly urban area, measures of improvement
(MoIs) are developed. These provide an important basis to
examine how parties involved in decision making understand
the system’s purposes and beneficiaries. WT’s RFP sets out
sustainability-related MoIs in their Resilience and Innovation
Framework and asks potential partners to provide key
performance indicators to measure and evaluate success [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ]. A
collection of these can be found in the Technical appendix
to the Vision document [1, pgs.162-171]. Concerning social
sustainability, WT sets measures for community creation in
terms of “quality of life”, measured in part through minimum
shares for affordable housing (20% of units), “convenient and
efficient” transit options, as well as the provision of sufficient
social and cultural amenities and high quality design. For WT,
the purpose of building “complete communities” is realized by
meeting people’s needs for jobs, services, housing, community
infrastructure, as well as transit options.
        </p>
        <p>Before the release of the major planning document, the</p>
      </sec>
      <sec id="sec-3-2">
        <title>Master Innovation and Development Plan (MIDP), the Plan</title>
        <p>
          Draft Agreement (PDA)[
          <xref ref-type="bibr" rid="ref21">21</xref>
          ] sets out the major resources at
stake: land and real-estate property, IP, and data. It makes clear
that no transfers of real-estate to Sidewalk have been made:
WT continues to assert its role as a steward of public lands and
act as negotiating partner (under the auspices of government)
in cases where privately owned land will be acquired within
the scope of the MIDP [21, p.5]. The PDA identifies two
types of IP: “planning materials” and “products and services”,
referring to user-facing software and applications as well
as standard and data layer “enabler” technologies[21, p.41].
Importantly, data may become a source of IP in the future.
Within the ambit of “data governance”, the PDA insists on
compliance with existing laws and encourages design
principles such as “personal privacy, civil society protections and
technological sovereignty” and “data governance and
stewardship that ensures both data/information sovereignty protection
and innovation”. An expert advisory board oversees these
parts of the plan [21, p.46-9]. These commitments reference
distributions of control through consent, the creation of an
independent data trust, and innovation through open
architectures. The PDA establishes WT and SL as joint decision
makers about the MIDP’s structure and its approval, which
will be based on a framework developed by WT[
          <xref ref-type="bibr" rid="ref21">21</xref>
          ]. The
ultimate sign-off for the plan lies with the municipal and
provincial governments, which constitutes the administrative
decision making environment over which the decision makers
have no control.
        </p>
        <p>
          The planning process is centered on public engagement and
what the /emphVision calls“holistic planning”. The technical
expertise of Sidewalk Members and the facilitation skills of
WT and contracted firms continuously collect feedback and
responses from citizens. Sidewalk Toronto thus involves an
array of experts and expertise in planning, implementation
and operational phases. As the MIDP is drafted, pieces of
the plan are presented for public comment and engagement
on specific ideas. In line with Borjensson et al.’s[
          <xref ref-type="bibr" rid="ref14">14</xref>
          ] call to
include lived experience within the planning scope of smart
cities systems, the engagement mechanisms deployed by WT
and SL have leveraged both residents and experts. Resident
Advisory Panels provide situated everyday expertise in the
form of reports [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ]. In Expert Advisory panels, independent
subject matter experts contribute to planning within areas
such as information management and privacy. Additionally, a
fellowship program leverages the experiences and training of
students and other young subject matter experts to provide
a report and recommendations after visiting a number of
cities [
          <xref ref-type="bibr" rid="ref23">23</xref>
          ]. A summer camp even engaged children to provide
experiential knowledge [
          <xref ref-type="bibr" rid="ref24">24</xref>
          ].
        </p>
        <p>
          In principle, the opportunities for residents and members
of publics to learn about and contribute to planning supports
the broad participation of a wide range of experts. Hundreds
of people attend the frequent public meetings and open
events, staffed by dozens of volunteers. Public Roundtables
feature general and breakout sessions which are recorded
and streamable[
          <xref ref-type="bibr" rid="ref25">25</xref>
          ], while charettes and design jams address
specific themes with public and expert cooperation. To ask
about a guarantor for this project in this light is to ask
what assures that our assumptions are justified? and, crucially,
what assumptions underpin the credibility of experts?,
including assumptions about the relevance of their knowledge, the
correctness of their predictions, and the legitimacy of their
perspectives. As purposeful human activity, systems design in
the view of CSH implies recourse to a guarantor: something
in which people must put their trust at the place when the
chain of justification breaks off. For example, we might trust
in WT’s mandate to act in the public interest and believe
that market-led innovation and development will guarantee the
best or most serviceable smart city. Or, we might trust in the
expertise of SL, believing that the state-of-the-art technologies
offered by one of the world’s most well-known firms is the
most effective path to sustainable urban design, and that their
careful consideration of their public engagement work will
assure public have their say.
        </p>
        <p>While categories of Motivation, Control and Knowledge
refer to those involved, Legitimacy addresses those affected.
The legitimate inclusion of multiple perspectives requires
the emancipation of the affected, the ability to speak their
concerns freely, and the obligation of the involved to consider
them in good faith. This is to be made possible through
commitments to public engagement in the planning process.
For example, participants at Roundtables represent themselves;
they give their own opinions and thoughts, speaking to specific
questions in structured and facilitated venues. The resulting
material is collected, analyzed and responded to in iterated
representations of the emerging plan. However, public
engagement processes like this are clearly designed to establish
the democratic legitimacy of the project by ensuring that
those affected are represented. To what degree does this
selfselected participation in highly structured exercises bring forth
an honest witness to testify to the experience of those affected
by the outcomes of this process? In order to examine to what
degree those affected are free to emancipate themselves from
the project’s worldview, and to offer their own perspectives,
we turn to the conceptual framework of boundary critique and
explore how CSH supports it.</p>
      </sec>
      <sec id="sec-3-3">
        <title>B. Boundary critique</title>
        <p>Having used CSH to represent the stated ‘is’ situation, we
discuss selected themes that illustrate how CSH helps us to:
(1) elicit and make visible the reference system of assumptions
that underpin the project; (2) contrast it with complementary
perspectives on how things are as well as how things should
be; (3) evaluate how competing interpretations are politically
marginalized through the design of the engagement process;
(4) identify and critique central boundary judgments; and (5)
effectively structure our own critique so that its normative
implications become transparent.</p>
      </sec>
      <sec id="sec-3-4">
        <title>1) Elicit reference system: CSH can provide a discursive</title>
        <p>grounding for critique of the normative assumptions at play in
the planning process. The first step is the reconstruction of the
stated boundaries of the system within the CSH framework.
We have done this above through reference to, and analysis
of, official documentation and presentations. Placing these
statements of value and purpose into the relations of CSH
allows us to sketch out themes and boundaries based on our
own standpoints, such that we can explore how boundaries
are constructed, and potentially in disagreement with their
motivating principles.</p>
        <p>
          CSH considers two kinds of boundary judgments. The first
kind refers to boundaries are established more or less explicitly
in the process of partitioning a system, or in deciding what
should be considered a component or relation of the system
and what is considered as environmental. The second kind
refers to the boundary judgments supporting the first. Any
decision about what and how to consider a system is a claim that
admits of argumentation and justification. These supporting
statements are also claims that admit of justification, going on
until justification stops with a rhetorical appeal to something
like expertise or to a view of reality. The point at which a
boundary admits of varying interpretation from complimentary
perspectives, or when the reason to accept it is left as an open
question, constitutes a “justification break-off”[
          <xref ref-type="bibr" rid="ref26">26</xref>
          ]. Revealing
these justification break-offs is essential to creating an account
of the reference system and worldview of the Involved.
        </p>
        <p>In the case of Sidewalk Toronto, justification break-offs
occur in the way that control over the system is to be exercised.
Questions about the first kind of boundary judgment can be
asked about not only the planning process but the design of
the system itself: who controls different aspects of the
systemwill it be existing government authorities? Citizens? Sidewalk?
Markets? Answering these questions in any manner prompts
a second order boundary question: why should the smart city
be administered in this way?</p>
      </sec>
      <sec id="sec-3-5">
        <title>2) Contrast complementary perspectives: Critical reflection</title>
        <p>on the boundaries set out in an official storyline need not
occur in a vacuum. We draw from the mainstream criticisms of
Sidewalk in the press that speak to specific parts of the official
story, and that often clearly reference the boundary judgments
stabilized within the CSH framework. These complimentary
perspectives offer avenues for critical reflection, suggest
alternative ways of interpreting the situation, and provide support
and direction for suspicions that arise from a perception of
marginalization or coercion within the official boundaries.</p>
        <p>
          Take for example the commitment to ‘complete
communities’. Its key pillar is a mixed-income distribution in the
Quayside, to be assured and measured through the provision
of “affordable housing”. The operationalization of
affordability suggests how complete, mixed-income communities in
Quayside are to be understood. At first glance, Sidewalk
Lab’s commitment to affordable housing seems to exceed the
legal minimum set by municipal policy. Following a Sidewalk
Fellows report, as well as criticism by community organization
ACORN, they expanded the plan to include 40% affordable
housing[
          <xref ref-type="bibr" rid="ref23">23</xref>
          ], [
          <xref ref-type="bibr" rid="ref27">27</xref>
          ], [
          <xref ref-type="bibr" rid="ref28">28</xref>
          ].
        </p>
        <p>
          However, this commitment does not address the affordable
housing crisis in Toronto, it merely sets the floor based on the
existing need[
          <xref ref-type="bibr" rid="ref29">29</xref>
          ]. Crucially, WT and SL have operationalized
affordability using the definition of the City of Toronto, which
defines affordable housing as housing provided at a cost
below the market rate. Housing advocates and the Canadian
Mortgage and Housing Corporation generally consider
affordability as a relation between income and rent expenditure, i.e.
less than 30% [
          <xref ref-type="bibr" rid="ref30">30</xref>
          ], [
          <xref ref-type="bibr" rid="ref31">31</xref>
          ]. More than one third of Toronto’s
residents cannot afford housing at current market rates. The
market-based definition of affordable housing has changed
the presumed beneficiaries of affordable housing in Sidewalk
Toronto; now half of the affordable units are intended for low
income residents, while the other is earmarked for “middle
income” residents [
          <xref ref-type="bibr" rid="ref28">28</xref>
          ]. The remaining 60% of units are for
rental or sale at market rate, benefiting the affluent. This
prioritization of the real-estate market at the expense of lower
and middle income families and other renters demonstrates not
only the worldview of involved parties, but the stakes of smart
city development.
        </p>
        <p>3) Evaluate discourse and marginalization: CSH can also
allow reflection on where and how concerns about boundary
judgments are marginalized. The specific boundaries drawn
through the design, architecture, management, and governance
of ICTs remain underdeveloped, but as CSH can focus equally
well on process as on product, some of these boundaries
are already tangible. The case of the Civic Data Trust
(CDT) demonstrates how boundaries are drawn based on the
worldview of the Involved, which focuses on innovation and
resource allocation through markets, frustrating the honest
consideration of smart city residents as beneficiaries.</p>
        <p>
          Much criticism of Sidewalk Toronto has focused on the
tensions between developing smart cities to serve local publics
versus the need to build them with a profit-oriented “business
model” that allows SL to accrue value through the operation of
the smart city. In part, discussion has focused on how the key
resource of data generated in Quayside should be considered
as a social product or public good, how the data is treated and
made accessible, and to whom it belongs [
          <xref ref-type="bibr" rid="ref32">32</xref>
          ], [
          <xref ref-type="bibr" rid="ref33">33</xref>
          ], [
          <xref ref-type="bibr" rid="ref34">34</xref>
          ].
        </p>
        <p>
          To address these concerns, decisionmakers announced a
plan to create a “Civic Data Trust” (CDT), a “third party public
organization” to govern a repository of Quayside Data [
          <xref ref-type="bibr" rid="ref28">28</xref>
          ],
[
          <xref ref-type="bibr" rid="ref23">23</xref>
          ]. The CDT is intended to balance the goals of spurning
innovation and protecting privacy, and to “[safeguard] the public
interest”. Itis meant to do so by committing to open standards
in architecture and application programming interfaces (APIs),
and by requiring data collection and sharing be minimal, done
with ‘meaningful consent’, and in accordance with existing
laws. The governing body of the CDT balances the market
value of this data with commitments to the people who are at
once the source of this data, and its presumed beneficiaries.
        </p>
        <p>
          The proposal of the CDT was met with criticism. Former
Privacy Commissioner for Ontario and global privacy expert
Ann Cavoukian resigned from the aforementioned expert
panel, citing unacceptable weaknesses in the fact that it did not
require anonymization at the point of collection and merely
encouraged services collecting data to adhere to strong
privacy principles [
          <xref ref-type="bibr" rid="ref35">35</xref>
          ]. While Cavoukian’s resignation addressed
concerns about privacy and social norms, it did not touch on
the deeper issues of ownership and control. In the case of the
CDT, this means elaborating on how governance decisions are
made about authorization and licensing for data use, guiding
principles, and compliance– and by whom. These concerns
are well spoken to by digital rights activist Bianca Wylie,
who criticizes the way that value-laden concepts are deployed
in the engagement process but do not lead to a more honest
discussion about ownership and control over the direction and
legal framework of constructs like the CDT[
          <xref ref-type="bibr" rid="ref36">36</xref>
          ].
        </p>
        <p>
          Decisions of ownership and control over technological
infrastructure in the smart city draw boundaries with enormous
social and economic impacts within these systems. The CDT
would control the infrastructure of data storage and use,
produced by the sensors that collect that data and the technical
standards that structure access. The former head of Blackberry
maker RIM summarized the problem of private ownership
of the low level data infrastructure: because it enshrines
Sidewalk’s ownership of IP based on the collection of public
data, it inevitably “creates a systemic market advantage from
which companies can inexorably expand” [
          <xref ref-type="bibr" rid="ref37">37</xref>
          ]. Basillie argues
that the ownership structure makes SL the major intended
beneficiary of Quayside data, to say nothing of their
relationship with Alphabet, whose major competencies and source of
value are the exploitation of data. Wylie builds on concerns
about this kind of “platform capitalism” in her critique of SL’s
ownership over the low level, built infrastructure, the
datalayer infrastructure of storage and collection, as well as the
access-layer that allows use of the data [
          <xref ref-type="bibr" rid="ref38">38</xref>
          ]. Technological
development making use of these layers could effectively be
controlled by the strategic interest of Sidewalk Labs,
potentially leading to the exclusion of local firms and community
technologists from key development opportunities [
          <xref ref-type="bibr" rid="ref32">32</xref>
          ].
        </p>
        <p>
          SL has drawn their boundaries of control of resources very
broadly. Tenuous agreements set out in the PDA protect the
IP interests of Alphabet and Sidewalk, but do not provide
much detail on how contracts for services might be decided
in the future. Alphabet already controls applicable services
such as Coord (for managing transit and road-based assets)
and has proposed numerous application level products for
pilot at Quayside [
          <xref ref-type="bibr" rid="ref39">39</xref>
          ], [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ]. With control over the smart city
architecture and their role as decision maker, SL appears
positioned to place their own subsidiaries into market niches
that they themselves would create, maintain, ad control.
        </p>
        <p>Control over the low-level technical and physical
infrastructure by a single dominating firm allows a standards-level
monopoly to shape the environment and market within which
technology development and service innovation occurs. What
role will those affected, the citizens and residents of Smart
Cities, play in the decision making and governance of these
new ways of life? Civic engagement and community building
are alluded to in Sidewalk Toronto materials; Sidewalk says
that its smart city will make volunteering easier, or that its
data-layers will be a great resource for civic tech and social
entrepreneurialism. However, these civic activities are situated
within the boundaries of information systems controlled by
Sidewalk. Examples include ‘Intersection’, a product that
provides internet access and “enables a vast array of
neighbourhood experiences, including amenity reservation and digital
feedback channels”[1, p.19] and a “Neighbourhood Assistant
Tool” that could “enable Quayside residents to form new
neighbourhood groups, crowd-source community needs, and
access a peer-to-peer marketplace. . . another portal through
which residents communicate feedback to officials, addressing
the need for digital tools that gauge community well-being”
[1, p.33].</p>
        <p>
          By juxtaposing official and critical discourses of the project,
CSH allows us to see how opposing views are addressed,
reconciled, and marginalized by the Involved. Specifically,
we have tried to show how the Vision for Sidewalk Toronto
posits the company’s role as a facilitator of civic engagement
and democratic decision making, but not as the site or object
of governance. Public engagement exercises seem to address
governance issues, but in reality they obscure them. A CDT
is just an act of trust if it does not have a governance
structure that allows the civic body that it describes to exercise
control over its data in decision making. While the proposed
information systems seem to encourage civic engagement,
their design also specifies what counts as valid engagement,
suggesting that these concessions are a form of what Cardullo
and Kitchin (via Arnstein) call “placation”, where citizens are
given the chance to change or challenge plans, but where their
involvement is subordinated to the larger objectives of of those
Involved[
          <xref ref-type="bibr" rid="ref40">40</xref>
          ].
        </p>
        <p>
          4) Identify boundary judgments: The examples of
affordable housing and the CDT illustrate some of the central
motivations and boundary judgments that appear to be guiding
the planning process. Tensions between resource collection
and control are tied to boundary judgments around what
constitutes the environment of smart city developments. For
entities like WT and SL, the market is the ultimate
environmental constraint. This is apparent, on one hand, by the
way WT positions itself as a partner that seeks to leverage
relationships with the private sector [
          <xref ref-type="bibr" rid="ref41">41</xref>
          ]. Their role as a
steward of public lands working for complete communities is
feasible only insofar as they attract capital investment, which
is only possible if their partners can see a return on that
investment [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ]. On the other hand, SL must look at smart city
development as a way of maintaining competitive advantage,
protecting its assets by maintaining control and authority in
smart city governance.
        </p>
        <p>CSH has allowed us to stabilize an ‘official’ story for the
smart city planning process, and to leverage some existing,
but marginalized, criticisms of that process to provide greater
nuance to our perception of boundary judgments. We use the
official narrative as a source of evidence for the way that these
boundaries are constructed and maintained, and in some cases,
how they serve to brush aside criticisms by giving the sense
that they have been addressed, while still maintaining the same
strategic boundaries.</p>
        <p>5) Structure critique: Table IV-B5 briefly summarizes key
standpoints, concepts, and questions that arose during our
analysis of official and critical perspectives. In the spirit of
CSH, it should be seen as heuristic device rather than a result:
not the outcome of CSH’s application, but a mid-point that
both helps to settle our reflections and points to more questions
and avenues for critique. More iterations and versions of such
tables can be produced individually or cooperatively. The table
here represents a period of research and analysis, it serves as
a summary of our thoughts at the time, as a provocation to
further reflection and analysis within the categories of CSH.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>V. DISCUSSION</title>
      <sec id="sec-4-1">
        <title>A. Reflections and Limitations</title>
        <p>As our tabular application of CSH (IV-B5) demonstrates, the
authors’ standpoint and the requirements of the format have
acted to select and constrain the perspective of this partial
engagement with the Sidewalk Toronto planning process. Our
account here is not comprehensively holistic in terms of
description. The reproduction of urban life relies on global
and local systems well beyond our scope here. As a document
of process, the CSH table passes over many considerations and
commitments to matters of environmental, social, economic,
and individual justice.</p>
        <p>
          In application, CST and CSH research could anticipate
these limitations and address them with a systematic
expansion of methods. We have collected mainstream press and
official documentation, and attended events when possible.
It would be desirable to sweep in a more diverse array of
collaborators, participants, and publics into the creation of
CSH documentation[
          <xref ref-type="bibr" rid="ref53">53</xref>
          ]. In matters of public concern, CSH is
always one voice among many. As Systemic Intervention [
          <xref ref-type="bibr" rid="ref54">54</xref>
          ]
        </p>
        <p>
          Sustainability indicators[
          <xref ref-type="bibr" rid="ref45">45</xref>
          ]
Definitions of affordable
housing
Tradeoffs or conflicts
between the 3Ps
Transactionalization of
relations
Boundaries around
governance
‘Public Interest’ as a
contested concept
CDT governance
Platform Capitalism [
          <xref ref-type="bibr" rid="ref46">46</xref>
          ]
“Tokenistic” engagement
[
          <xref ref-type="bibr" rid="ref40">40</xref>
          ]
Feedback as user testing
Utopian aesthetics in Vision
and promotional material[
          <xref ref-type="bibr" rid="ref2">2</xref>
          ]
Publics[
          <xref ref-type="bibr" rid="ref47">47</xref>
          ], [
          <xref ref-type="bibr" rid="ref48">48</xref>
          ] as the
object of data collection
Everyday expertise, situated
knowledges
Technological Solutionism
Faith in markets
Curated publics
Highly structured process
Feedback as
representation/engagement
Politics as management
Computational thinking [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ]
City as computer [
          <xref ref-type="bibr" rid="ref52">52</xref>
          ]
        </p>
        <p>Environmental sustainability as a service
affordable housing for the middle class
CDT governance left outside boundaries,
proposed information systems enclose civic
engagement in decision making.</p>
        <p>Role of public engagement gives WT, SL the
initiative in communication and final calls.</p>
        <p>
          Criticism by Ann Cavoukian around IP points to
discretionary power of SL around publicly
produced data[
          <xref ref-type="bibr" rid="ref35">35</xref>
          ], and ownership of the standards
layer positions SL for bottom level control [
          <xref ref-type="bibr" rid="ref37">37</xref>
          ]
Technical/professional administration vs situated
knowledge
“Confusion over what codesign means”[
          <xref ref-type="bibr" rid="ref49">49</xref>
          ].
        </p>
        <p>
          Public engagements seen not as a source of
expertise, but as SL leveraging public engagements
as a source of knowledge for their own experts,
to ‘inform’ MIDP [
          <xref ref-type="bibr" rid="ref50">50</xref>
          ].
        </p>
        <p>Democracy as Guarantor
Atomization and aggregation poses public as
individuals to provide affective feedback and to
components rather than the system. Focus on
values provides rhetorical initiative to WT and SL.</p>
        <p>No apparent inclusion or reference beyond land
acknowledgement
Preconfigured engagement, based on identified
areas, and offering no potential for emancipation
Appealing to the ‘reality’ of neoliberal dominance,
the balance of the 3Ps tilting to profit, which is
always the most bottom line.
or other action research, applying CSH could help maintain
space for critical reflection and diversity of perspective.
B. Measured Management</p>
        <p>“Sidewalk expects Quayside to become the most measurable
community in the world” [1, pg.22]. Ambitions to
environmental sustainability in Sidewalk Toronto rest on the belief that
through measurement and systematization of urban activities
such as energy use and transit, control and coordination can
be improved to lessen waste and environmental impact. Smart
City technology enables pursuit of this goal through sensory
and management systems that might track and analyze trends,
more efficiently consuming resources. In the case of a smart
city like Sidewalk, these resources might include stocks for
heating, waste and recycling capacity, and for maintaining
the physical spaces sought after for conducting economic and
social activity, including dwelling, commercial, and public
spaces like parks. If discrete or aggregated measurements can
be sought, monitored, and managed, that data stands in as
a resource. As a representational layer on top of the city’s
(not to mention its associates) material activities, smart city
systems want to manage that data. Value creation promised
through increased convenience, efficiency, sustainability, etc.,
are delivered only if the presumed requisite data is available,
and on who has access to it. Even after construction, capital
resources and labour are required needed to maintain these
infrastructures and to put their results to use.</p>
        <p>Ambitions in the Vision extend beyond environmental
sustainability, to “promoting activity, healthy eating, relaxation,
and connection to the environment. . . [through] capturing a
variety of data and facilitating residents’ and others’ uses of
that data through existing and new applications”, as well as
to the business of neighbourhood politics [1, pg.171]. From
this perspective, ecological sustainability intersects with other
aspects of sustainability as resource consumption and use is
related with activities, lifestyles, exchanges (etc.), and with
supporting infrastructures, computational and otherwise.
However, mere measurement is insufficient for management: “to
understand what makes the urban environment work well, and
detect when it is under-performing, it is necessary to perform
longitudinal analysis, and be able to distinguish normal states
from anomalous ones” [1, pg.72].</p>
        <p>
          Achieving normal, “livable” space requires evaluation, and
a value-based framework that is implied, but, we think,
unspecific. Sidewalk’s commitment to Quayside suggests an
ongoing endeavour, actively managed at different time scales
with successive interventions by, for example, “facility
managers” [1, pg.74]. Commercially, efficiency and convenience
can perform as MoIs– a decrease in travel time or noise
complaints, increases in overall air quality, successful user
transactions, etc. Proposed innovation platforms or information
marketplaces articulate the resident/citizens of a smart city
primarily as the beneficiaries of services, or consumers of
resources. Just who delivers these services and manages the
resources? Would municipal or public actors be replaced by a
market where returns were sought through treating residents
and citizens as a resource or product [
          <xref ref-type="bibr" rid="ref40">40</xref>
          ]? Politically, objects
like the CDT or smart city MoIs could be a site for citizen
control. A democratic approach to smart city design would
make citizen involvement in the creation of these standards a
part of the planning process, open for debate and driven by
the values of residents. Already within the context of smart
city technologies, Balestrini et al., have used the concept of
a “city commons” to guide participatory design of a sensor
network[
          <xref ref-type="bibr" rid="ref55">55</xref>
          ]. So far, however, Sidewalk Toronto’s planning
process represents publics without including them.
        </p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>VI. CONCLUSIONS</title>
      <p>
        ‘Cities have the capability of providing something
for everybody, only because, and only when, they
are created by everybody.’ [
        <xref ref-type="bibr" rid="ref56">56</xref>
        ]
      </p>
      <p>
        The ongoing SL project in Toronto is a major smart city
development, the deployment of technologically advanced urban
infrastructures built from scratch to achieve their designers’
ambitious goals. Sustainability is a key value used to motivate
the project. As this paper argued, however, sustainability
in smart city projects must be considered more holistically
than is possible through the narrow lenses of technological
optimization and ecological sustainability[
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>Basing our analysis on CST, we have showed how the
project’s purpose is framed by the rationalities and goals of
its most powerful stakeholders. We used CSH for a boundary
critique that traces the concerns of the numerous voices, and
to examine and critically reflect on how values and interests
influence and constrain the project’s purposes and vision. This
situates CSH, and CST more broadly, as a powerful tool for the
holistic consideration of sustainability in smart city projects
and large scale transitions to sustainable societies.</p>
      <p>This is not a call to disregard the technical expertise offered
by Sidewalk or any other firm. If we are to truly transform our
societies to be sustainable and prosperous, we must critically
reflect on the role and purpose of technologies in our everyday
lives. What becomes clear through critical analysis is that
technical decisions in the smart city are, as much as ever,
political decisions about relations between people,
organizations, and power. Governance of smart cities is tied to design
and architecture choices, both in regards to the sustainability
of any underlying infrastructure of smart cities, but also to
the intersection of this new datafied layer and everyday life,
through the systems and interfaces constructed to create and
manage that resource.</p>
      <p>A key challenge for the ICT4s community is to ensure that
these types of boundaries do not go unnoticed in smart city
research. This will mean continuing to critically reflect on
the role of technological choices in instantiating social and
political relationships and assessing their potential as
environmentally sustainable technologies. Critical systems thinking
can assist in just that type of work. As a heuristic tool, CSH
does not need to supplant or dominate research in order to
be effective. Beyond this evaluative role, as framework for
interventionary practise or self-reflection in technology design
it can help practitioners and technologists to more effectively
probe the normative implications of their work.</p>
    </sec>
    <sec id="sec-6">
      <title>ACKNOWLEDGEMENTS</title>
      <p>This research was partially supported by Natural Sciences
and Engineering Research Council through
RGPIN-201606640, the Canada Foundation for Innovation, Onatrio
Research Fund, and the Social Science and Humanities Research
Council through the Canadian Graduate Scholarship. Special
thanks to Dawn Walker.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>D. L.</given-names>
            <surname>Doctoroff</surname>
          </string-name>
          , “Sidewalk toronto project proposal,” proposal, Sidewalk Labs,
          <volume>10</volume>
          <fpage>2017</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>M.</given-names>
            <surname>Sauter</surname>
          </string-name>
          , “
          <article-title>Google's Guinea-Pig City,” The Atlantic</article-title>
          , Feb.
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>The</given-names>
            <surname>Guardian</surname>
          </string-name>
          , “
          <article-title>The Guardian view on Google and Toronto: Smart city</article-title>
          , dumb deal,” Feb.
          <year>2018</year>
          . Editorial.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>S.</given-names>
            <surname>Mann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Bates</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Maher</surname>
          </string-name>
          , “
          <article-title>Shifting the maturity needle of ict for sustainability</article-title>
          ,
          <source>” Proc. 5th Int Conf on ICT4S</source>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>S.</given-names>
            <surname>Easterbrook</surname>
          </string-name>
          , “
          <article-title>From computational thinking to systems thinking,”</article-title>
          <source>in Proc. 2nd Int Conf on ICT4S</source>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>C.</given-names>
            <surname>Becker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Chitchyan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Duboc</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Easterbrook</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Penzenstadler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Seyff</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C. C.</given-names>
            <surname>Venters</surname>
          </string-name>
          , “
          <article-title>Sustainability design and software: The karlskrona manifesto</article-title>
          ,”
          <source>in Proc., 37th Intl. Conference on Software Engineering</source>
          , vol.
          <volume>2</volume>
          , IEEE Press,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>A.</given-names>
            <surname>Kamilaris</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Pitsillides</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Fidas</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Kondepudi</surname>
          </string-name>
          , “
          <article-title>Social electricity: The evolution of a large-scale, green ict social application through two case studies in cyprus and singapore</article-title>
          ,”
          <source>in Proc. 3rd Int Conf of ICT4S</source>
          , (Copenhagen, Denmark), Atlantis Press,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>P. F.</given-names>
            von
            <surname>Heland</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Nyberg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Bondesson</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P.</given-names>
            <surname>Westerberg</surname>
          </string-name>
          , “
          <article-title>The citizen field engineer: Crowdsourced maintenance of connected water infrastructure,”</article-title>
          <source>in Proc. 3rd Int Conf on ICT4S</source>
          , Atlantis Press,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>H.</given-names>
            <surname>Shahrokni</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Van der Heijde</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Lazarevic</surname>
          </string-name>
          , and
          <string-name>
            <given-names>N.</given-names>
            <surname>Brandt</surname>
          </string-name>
          , “
          <article-title>Big data gis analytics towards efficient waste management in stockholm</article-title>
          .,”
          <source>in Proc. 2nd Int Conf on ICT4S</source>
          , Atlantis Press,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>J.</given-names>
            <surname>Studzinski</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Brylka</surname>
          </string-name>
          , and
          <string-name>
            <given-names>K.</given-names>
            <surname>Kazubski</surname>
          </string-name>
          , “
          <article-title>Ict system for smart city management,”</article-title>
          <source>in Proc. 2nd. Int Conf on ICT4S</source>
          , Atlantis Press,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>A.</given-names>
            <surname>Kramers</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Ringenson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Sopjani</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P.</given-names>
            <surname>Arnfalk</surname>
          </string-name>
          , “
          <article-title>Aaas and maas for reduced environmental and ccclimate impact of transport,”</article-title>
          <source>in Proc. 5th Int Conf on ICT4S</source>
          , vol.
          <volume>52</volume>
          ,
          <issue>EasyChair</issue>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>E.</given-names>
            <surname>Cosgrave</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Tryfonas</surname>
          </string-name>
          , and T. Crick, “
          <article-title>The smart city from a public value perspective,”</article-title>
          <source>in Proc. 2nd. Int Conf on ICT4S</source>
          , Atlantis Press,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>A.</given-names>
            <surname>Kramers</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Wangel</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Höjer</surname>
          </string-name>
          , “
          <article-title>Planning for smart sustainable cities,”</article-title>
          <source>in Proc. 2nd Int Conf on ICT4S</source>
          , Atlantis Press,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>M.</given-names>
            <surname>Börjesson Rivera</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Eriksson</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Wangel</surname>
          </string-name>
          , “
          <article-title>Ict practices in smart sustainable cities: In the intersection of technological solutions and practices of everyday life,”</article-title>
          <source>in Proc. EnviroInfo and ICT for Sustainability</source>
          <year>2015</year>
          , (Copenhagen), Atlantis Press,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <surname>Waterfront</surname>
            <given-names>Toronto</given-names>
          </string-name>
          , “
          <article-title>Request for proposals innovation and funding partner for the quayside development opportunity</article-title>
          ,
          <source>” Request for Proposal</source>
          <year>2017</year>
          -
          <volume>13</volume>
          , Waterfront Toronto,
          <year>03 2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <surname>M. C. Jackson</surname>
          </string-name>
          ,
          <article-title>Systems thinking: Creative holism for managers</article-title>
          .
          <source>Citeseer</source>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>W.</given-names>
            <surname>Ulrich</surname>
          </string-name>
          ,
          <article-title>Critical Heuristics of Social Planning: A New Approach to Practical Philosophy</article-title>
          . J. Wiley and Sons,
          <year>1983</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>W.</given-names>
            <surname>Ulrich</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Reynolds</surname>
          </string-name>
          , “
          <article-title>Critical systems heuristics,” in Systems Approaches to Managing Change: A Practical Guide</article-title>
          , Springer,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>M.</given-names>
            <surname>Reynolds</surname>
          </string-name>
          , “
          <article-title>Evaluation based on critical systems heuristics</article-title>
          ,”
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>A.</given-names>
            <surname>Henriques</surname>
          </string-name>
          and J. Richardson, eds., The Triple Bottom Line:
          <article-title>Does it all Add Up? : Assessing the Sustainability of Business and CSR</article-title>
          . Earthscan Publications Ltd.,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <surname>Waterfront</surname>
            <given-names>Toronto</given-names>
          </string-name>
          , “
          <article-title>Plan development agreement between toronto waterfront revitalization corporation and sidewalk labs llc,” agreement</article-title>
          , Waterfront Toronto,
          <year>07 2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>F.</given-names>
            <surname>Chowdhury</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>West</surname>
          </string-name>
          , G. Chau, G. Hewitt, G. Cabigas,
          <string-name>
            <given-names>H.</given-names>
            <surname>Kang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Mactaggart</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Goodman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Duong</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Ruzic</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Slaughter</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Donaldson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Clamageran</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Houghron</surname>
          </string-name>
          , P. MacKay,
          <string-name>
            <given-names>R.</given-names>
            <surname>Jia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Mahmood</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Mehta</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Fung</surname>
          </string-name>
          ,
          <source>Resident's Reference Panel Interim Report. Sidewalk Toronto</source>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>A.</given-names>
            <surname>Wishloff</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Espanol</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Chang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Leung</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Yeung</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Brath</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Ngo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K. S.</given-names>
            <surname>Louis-McBurnie</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Seufert</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Persaud</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Chan</surname>
          </string-name>
          , and
          <string-name>
            <given-names>W.</given-names>
            <surname>Sutter</surname>
          </string-name>
          ,
          <source>Sidewalk Toronto Fellow Report. Sidewalk Toronto</source>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>Sidewalk</given-names>
            <surname>Toronto</surname>
          </string-name>
          and Kids Camp Participants, Sidewalk Toronto Summer Kids Camp. Sidewalk Toronto,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <surname>Sidewalk</surname>
            <given-names>Toronto</given-names>
          </string-name>
          ,
          <year>2018</year>
          . YouTube Channel.
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>W.</given-names>
            <surname>Ulrich</surname>
          </string-name>
          , “
          <article-title>Critical heuristics of social systems design</article-title>
          ,”
          <year>1987</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>ACORN</given-names>
            <surname>Canada</surname>
          </string-name>
          , “
          <article-title>Acorn to sidewalk toronto: Give us real affordable housing!</article-title>
          .
          <source>” Online</source>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <given-names>Waterfront</given-names>
            <surname>Toronto</surname>
          </string-name>
          and Sidewalk Labs, “Public Roundtable #
          <fpage>4</fpage>
          .” Presentation, 12
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <given-names>City</given-names>
            <surname>News</surname>
          </string-name>
          <string-name>
            <surname>Staff</surname>
          </string-name>
          , “
          <article-title>By the numbers: Toronto's rental market</article-title>
          - CityNews Toronto,”
          <year>Feb 2018</year>
          . [Online; accessed 21.
          <string-name>
            <surname>Jun</surname>
          </string-name>
          .
          <year>2018</year>
          ].
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <given-names>Canadian</given-names>
            <surname>Mortgage</surname>
          </string-name>
          and Housing Corporation, “
          <article-title>About affordable housing</article-title>
          .
          <source>” Online</source>
          , 04
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [31]
          <string-name>
            <given-names>J.</given-names>
            <surname>Pagliaro</surname>
          </string-name>
          , “Toronto to review defintion of 'affordable' housing,” The Toronto Star,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          [32]
          <string-name>
            <given-names>B.</given-names>
            <surname>Bean</surname>
          </string-name>
          , “
          <article-title>The world is watching as data drives toronto's smart city experiment</article-title>
          ,” Open Data Exchange,
          <volume>10</volume>
          <fpage>2017</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          [33]
          <string-name>
            <given-names>C.</given-names>
            <surname>Rattan</surname>
          </string-name>
          , “
          <article-title>Torontonians should take control of their data</article-title>
          ,
          <source>” Now Magazine</source>
          ,
          <volume>05</volume>
          <fpage>2018</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          [34]
          <string-name>
            <given-names>B.</given-names>
            <surname>Wylie</surname>
          </string-name>
          , “Sidewalk toronto, procurement innovation, and permission to fail,” Medium, 04
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          [35]
          <string-name>
            <given-names>CBC</given-names>
            <surname>News</surname>
          </string-name>
          , “
          <article-title>'not good enough': Toronto privacy expert resigns from sidewalk labs over data concerns</article-title>
          ,
          <source>” CBC News</source>
          ,
          <year>10 2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          [36]
          <string-name>
            <given-names>B.</given-names>
            <surname>Wylie</surname>
          </string-name>
          , “
          <article-title>Google is still planning a 'smart city' in toronto despite major privacy concerns</article-title>
          ,” Motherboard,
          <year>August 2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          [37]
          <string-name>
            <given-names>J.</given-names>
            <surname>Balsillie</surname>
          </string-name>
          , “
          <article-title>Sidewalk toronto has only one beneficiary</article-title>
          , and it is not toronto,”
          <source>The Globe and Mail</source>
          ,
          <volume>10</volume>
          <fpage>2018</fpage>
          . Editorial.
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          [38]
          <string-name>
            <given-names>B.</given-names>
            <surname>Wylie</surname>
          </string-name>
          , “Civic Tech: On Google,
          <string-name>
            <given-names>Sidewalk</given-names>
            <surname>Labs</surname>
          </string-name>
          , and Smart Cities,” Torontoist,
          <string-name>
            <surname>Oct</surname>
          </string-name>
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref39">
        <mixed-citation>
          [39]
          <string-name>
            <given-names>S.</given-names>
            <surname>Smyth</surname>
          </string-name>
          , “
          <article-title>Announcing coord: The integration platform for mobility providers, navigation tools</article-title>
          , and urban infrastructure,” Sidewalk Labs,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref40">
        <mixed-citation>
          [40]
          <string-name>
            <given-names>P.</given-names>
            <surname>Cardullo</surname>
          </string-name>
          and
          <string-name>
            <given-names>R.</given-names>
            <surname>Kitchin</surname>
          </string-name>
          , “
          <article-title>Being a 'citizen'in the smart city: up and down the scaffold of smart citizen participation in dublin</article-title>
          , ireland,” GeoJournal, vol.
          <volume>84</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>13</lpage>
          ,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref41">
        <mixed-citation>
          [41]
          <string-name>
            <given-names>Waterfront</given-names>
            <surname>Toronto</surname>
          </string-name>
          and Sidewalk Labs, “Public Roundtable #
          <fpage>3</fpage>
          .” Presentation, 08
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref42">
        <mixed-citation>
          [42]
          <string-name>
            <given-names>D. H.</given-names>
            <surname>Meadows</surname>
          </string-name>
          and
          <string-name>
            <given-names>D.</given-names>
            <surname>Wright</surname>
          </string-name>
          , Thinking in Systems: A Primer. Chelsea Green publishing,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref43">
        <mixed-citation>
          [43]
          <string-name>
            <given-names>Canada</given-names>
            <surname>Green Building Council</surname>
          </string-name>
          , “Leed®certification process.
          <source>” Online</source>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref44">
        <mixed-citation>
          [44]
          <string-name>
            <given-names>Waterfront</given-names>
            <surname>Toronto</surname>
          </string-name>
          and Canadian Urban Institute, “
          <article-title>Waterfront toronto resilience and innovation framework for sustainability,” tech</article-title>
          . rep., Waterfront Toronto,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref45">
        <mixed-citation>
          [45]
          <string-name>
            <given-names>S.</given-names>
            <surname>Bell</surname>
          </string-name>
          and
          <string-name>
            <given-names>S.</given-names>
            <surname>Morse</surname>
          </string-name>
          ,
          <source>Sustainability Indicators: Measuring the Immeasurable? Routledge</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref46">
        <mixed-citation>
          [46]
          <string-name>
            <given-names>N.</given-names>
            <surname>Srnicek</surname>
          </string-name>
          ,
          <article-title>Platform capitalism</article-title>
          . John Wiley &amp; Sons,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref47">
        <mixed-citation>
          [47]
          <string-name>
            <surname>C. DiSalvo</surname>
          </string-name>
          , “
          <article-title>Design and the construction of publics,” Design Issues</article-title>
          , vol.
          <volume>25</volume>
          , no.
          <issue>1</issue>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref48">
        <mixed-citation>
          [48]
          <string-name>
            <given-names>J.</given-names>
            <surname>Dewey</surname>
          </string-name>
          ,
          <article-title>The Public and its Problems: An Essay in Political Inquiry</article-title>
          . Penn State Press,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref49">
        <mixed-citation>
          [49]
          <string-name>
            <given-names>B.</given-names>
            <surname>Wylie</surname>
          </string-name>
          , “
          <article-title>Sidewalk toronto, social license, and the limits of a borrowed reputation</article-title>
          ,” Medium, 06
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref50">
        <mixed-citation>
          [50]
          <string-name>
            <surname>Sidewalk</surname>
            <given-names>Toronto</given-names>
          </string-name>
          , “Design Jam: Background.” Presentation,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref51">
        <mixed-citation>
          [51]
          <string-name>
            <surname>Sidewalk</surname>
            <given-names>Toronto</given-names>
          </string-name>
          , Sidewalk Toronto Residents Reference Panel FAQ. Sidewalk Toronto,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref52">
        <mixed-citation>
          [52]
          <string-name>
            <given-names>S.</given-names>
            <surname>Mattern</surname>
          </string-name>
          , “
          <article-title>A city is not a computer,”</article-title>
          <source>Places Journal</source>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref53">
        <mixed-citation>
          [53]
          <string-name>
            <given-names>C. W.</given-names>
            <surname>Churchman</surname>
          </string-name>
          ,
          <article-title>The Systems Approach</article-title>
          . Delta, New York,
          <year>1968</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref54">
        <mixed-citation>
          [54]
          <string-name>
            <given-names>G.</given-names>
            <surname>Midgley</surname>
          </string-name>
          , Systemic Intervention. Springer,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref55">
        <mixed-citation>
          [55]
          <string-name>
            <given-names>M.</given-names>
            <surname>Balestrini</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Rogers</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Hassan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Creus</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>King</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P.</given-names>
            <surname>Marshall</surname>
          </string-name>
          , “
          <article-title>A city in common: a framework to orchestrate large-scale citizen engagement around urban issues,”</article-title>
          <source>in Proc. '17 CHI Conference on Human Factors in Computing Systems</source>
          , pp.
          <fpage>2282</fpage>
          -
          <lpage>2294</lpage>
          , ACM,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref56">
        <mixed-citation>
          [56]
          <string-name>
            <given-names>J.</given-names>
            <surname>Jacobs</surname>
          </string-name>
          ,
          <article-title>The Death and Life of Great American Cities</article-title>
          .
          <source>Vintage Books</source>
          ,
          <year>1961</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>