<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Towards an Open Data Vocabulary for Canvas Driven Innovation Ethics</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Dave Lewis</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Harshvardhan J. Pandit</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Hannah Devinney</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Wessel Reijers</string-name>
          <email>wreijersg@adaptcentre.ie</email>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>ADAPT Centre</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Dublin City University</institution>
          ,
          <addr-line>Dublin</addr-line>
          ,
          <country country="IE">Ireland</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Trinity College Dublin</institution>
          ,
          <addr-line>Dublin</addr-line>
          ,
          <country country="IE">Ireland</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Discussing the role of ethics in Research &amp; Innovation is an important aspect of the technological progress we make today, and therefore contributes to the sustainable development goal on industry and innovation. In this context, the task of structuring such discussions of ethics with the business processes they relate to is di cult due to a lack of methodologies and existing use-cases. The Ethics Canvas o ers a tool that uses a model based on the Business Model Canvas to structure discussions around ethical implications. We present a way to relate such ethical considerations with their business process using the semantic web. This will allow an investigation of how business models and ethics a ect each other, and to structure discussions around this relation. The approach also allows discovering related ethical implications through the Ethics Canvas tool for a richer discussion surrounding ethics.</p>
      </abstract>
      <kwd-group>
        <kwd>Research&amp;Innovation</kwd>
        <kwd>Ethics</kwd>
        <kwd>Canvas Model</kwd>
        <kwd>Semantic Web</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        The UN sustainable development goal for Industry, Innovation and
Infrastructure [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] highlights the critical role of technology research and innovation (R&amp;I)
in enabling sustainable industrialisation and targets growth in R&amp;I capacity and
investment. However, as the pace of technological R&amp;I accelerates, especially in
digital technology and data-driven AI, the power of the resulting technology to
negatively impact individuals and societies increasingly comes to the fore of
public concern and debate. Concerns about the ethical issues that arise in the R&amp;I
process therefore are gaining more attention and must be addressed clearly and
systematically if public support for R&amp;I activities is to be maintained. Existing
methods for practising ethics in technology R&amp;I can be classi ed as: ex-ante, for
emerging technologies at early stages of R&amp;I; intra, during technology design and
Copyright c 2018 for this paper by its authors.
      </p>
      <p>Copying permitted for private and academic purposes.
testing; and ex-post, when technology from R&amp;I is mature and the technology
is applied. From a comprehensive literature review of R&amp;I ethics approaches [8]
Reijers et al recommend that: ethical technological design should be integrated
into the day-to-day work of R&amp;I practitioners; with guidance for discerning the
ethical nature of technology design choices and how ethical principles can be
balanced; di erent socio-technical alternatives considered; and stakeholder
participation should be broadened while being guided by democratic principles.</p>
      <p>The rapid commercialisation of digital technology R&amp;I demonstrates how
implementing such recommendations cannot be addressed solely within the
connes of policies for publicly-funded research. It must instead be based on an
open and honest debate with commercial R&amp;I practitioners about appropriate
methodologies and possible regulatory actions needed to enable viable ethical
practice that can balance the commercial bene ts of digital technology with the
broader social good. The focus on ethics is also signi cant for the funding of
R&amp;I. While publicly funded research is already served by institutional ethics
guidelines, these are not applied systematically as knowledge is transferred to
the commercial sector, i.e. as a given technology transitions from a research to an
innovation phase. This transition is increasingly the focus of public co-funding
as governments strive to improve the economic and social impact of research
through commercial innovation. In parallel, Environmental, Socials and
Governance criteria are growing in importance for commercial investors concerned
about the ethical impact of innovation investments.</p>
      <p>
        Innovation ethics have to a large extent been subsumed into broader a
discussion of ethics in R&amp;I, often as part of policies around Responsible R&amp;I, i.e.
without di erentiating the speci c needs of innovation ethics in industry from
those of research ethics. An early exploration of this distinction [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] proposed
an analogue of academic institutional ethics review boards for industry in the
form of a Consumer Subject Review Board, while acknowledging the potential
complexities in managing the con icts between ethical concerns and the
maximisation of shareholder value within companies. Dreyer et al [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] highlight this
con ation of research and innovation ethics as a barrier to advancing the
latter in industry and calls for better alignment of proposed approaches with the
tools and frameworks already used in industry both for innovation and for
societal consideration such as Corporate Social Responsibility. A recent volume [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]
gathered several papers addressing R&amp;I integrity in industry, focussing on the
bene ts of and barriers to adoption in di erent sectors, the potential to treat
ethics as part of a business risk assessment and the potential for a responsible
R&amp;I maturity model. While providing a rich overview of the state of the art it
also highlights the urgent need of good ethical practice for commercial
innovation in the form of accessible guidelines, usable tools and reliable governance
structures. This paper describes how we have begun to address issues of tool
support via an agile re ective tool called the Ethics Canvas. We discuss how
this provides a basis for using linked open data to contribute towards advancing
ex-ante, intra and ex-post practices in innovation ethics before discussing further
work.
We have developed the Ethics Canvas as a novel method to address some of
the challenges identi ed in bringing innovation ethics into practice. We chose
to align the a ordance of our ethical analysis tool with the popular canvas
format that has gained widespread acceptance for business modelling in the digital
technology and startup community. Though variations exist, we aligned with the
most mature, the Business Model Canvas (BMC) [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. The BMC is a carefully
designed layout of 9 blocks in which the key business considerations of
technology innovation can be easily captured and iterated. It is designed to be highly
iterative, with each block used to capture hypotheses which the innovation team
then needs to validate through engaging with potential customers and partners,
conducting market research and testing ideas through minimal viable product
prototypes. The BMC can be used by technology innovation teams without
recourse to external business or marketing expertise, especially in the exploratory
stage of establishing that a technological innovation represents a viable
commercial application. The blocks address: customer segments whose pain or potential
gains are addressed by the innovation; the value proposition of the innovation
in addressing such pains or gain; the channels via which the value proposition
is delivered to customer; how the relationship with a customer is established
and maintained; the revenue stream(s) that would result; the key resources,
activities and partnerships needed to deliver the value proposition and the cost
structure involved in doing so. The Ethics Canvas, depicted in Figure. 1, takes
this familiar 9-block structure and the a ordance of lightweight re ection and
frequent iterative revision, but refactored to help structure discussions on ethical
considerations.
      </p>
      <p>The Ethics Canvas consists of nine thematic blocks that are grouped together
in four stages of completion. The rst stage (blocks 1, 2) requires identifying the
stakeholders involved based on the technology under consideration. These are
respectively the classes of individuals a ected and the types of groups a ected,
where groups would have some form of advocate or representation that could
potentially engage on ethical issues. The emphasis here is on identifying
stakeholders who are not necessarily users and partners in the innovation, but are
nevertheless impacted by it. These are then used to identify potential ethical
impacts for the identi ed stakeholders in stage two (blocks 3-6). The impact
includes changes in the behavior of the classes of individuals, changes in the
relationships between classes of individuals or between individuals and groups,
or con icts that might arise between a ected groups. Non-stakeholder speci c
ethical impacts are also analysed in stage three (blocks 7, 8), addressing the
impact of service/system failure of and resource use by the innovative technology.
Stage four (block 9) consists of discussions structured around overcoming ethical
impacts identi ed in the previous stages.</p>
      <p>The ethics canvas can be printed or used as a web application5 that can
be used with or without an account. Analyses can be downloaded as either a
5 https://www.ethicscanvas.org
Identify the types or categories of
individuals affected by the product
or service, such as men/women,
user/non- user, age-category, etc.</p>
      <p>The ADAPT Centre for Digital Content Technology is funded under the SFI Research Centres Programme (Grant 13/RC/2106) and is co-funded under the European Regional Development Fund. .</p>
      <p>Individuals affected</p>
      <p>Behaviour</p>
      <p>What can we do?</p>
      <p>Worldviews
Project Title:</p>
      <p>Date:</p>
      <p>Ethics Canvas v1.8 - ethicscanvas.org © ADAPT Centre &amp; Trinity Col ege</p>
      <p>Dublin &amp; Dublin City University, 2017.</p>
      <p>Groups affected
Identify the col ectives or
communities, e.g. groups or organisations,
that can be affected by your product
or service, such as environmental
and religious groups, unions,
professional bodies, competing companies
and government agencies,
considering any interest they might have in
the effects of the product or service.</p>
      <p>1
Product or Service Failure
Discuss the potential negative impact of your product or
service failing to operate as intended,eg technical or human
error, financial failure/ receivership/acquisition, security
breach, data loss, etc.</p>
      <p>9
7</p>
      <p>Problematic Use of Resources
Discuss possible negative impacts of the consumption of
resources of your project, e.g. climate impacts, privacy
impacts, employment impacts etc.</p>
      <p>2
8
Discuss problematic changes to
individual behaviour that may be
prompted by the application e.g. differences in
habits, time-schedules, choice of
activities, people behaving more
individualistic or col ectivist, people
behaving more or less materialistic.</p>
      <p>Select the four most important
Ethical impacts you discussed.</p>
      <p>Identify ways of solving these
Impacts by changing your project’s
product/service design,
organisation.Or by providing
recommendations for its use or spel ing out more
clearly to users the values driving
the design
Relations
Discuss problematic differences in
individual behaviour such as
differences in habits, time-schedules,
choice of activities, etc
3
4</p>
      <p>Discuss how the general perception
of somebody’s role in society can be
affected by the project,
Group Conflicts
Discuss the impact on the
relationships between the groups identified,
e.g. employers and unions
5
6
The Ethics Canvas is adapted from Alex Osterwalder’s Business Model Canvas. The Business Model Canvas is designed by: Business Model Foundry AG. This work is licensed under the Creative Commons At
ribution-Share Alike 3.0 unported license. To view a copy of this license, visit ht ps://creativecommons.org/licenses/by-sa/3.0/. To view the original Business Model Canvas, visit ht ps://strategyzer.com/canvas.</p>
    </sec>
    <sec id="sec-2">
      <title>Ethics</title>
    </sec>
    <sec id="sec-3">
      <title>Canvas</title>
    </sec>
    <sec id="sec-4">
      <title>Design</title>
      <sec id="sec-4-1">
        <title>PDF or as a structured</title>
        <p>JSON representation
of the text entered into
each
block.</p>
        <p>The
online
version
allows for
collaborative
editing
of
an</p>
      </sec>
      <sec id="sec-4-2">
        <title>Ethics</title>
      </sec>
      <sec id="sec-4-3">
        <title>Canvas, shared</title>
        <p>comment threads on individual block entries and tagging of strings
within a block
entry
used
(see
entering a similar tag in their own canvas design, thereby o
ering the opportunity
to
cross
reference
between
canvases
and
establish a shared
folksonomy of</p>
      </sec>
      <sec id="sec-4-4">
        <title>Ethic</title>
        <p>Canvas entry tags. The source of the application is hosted
online</p>
        <p>and is available
6
under the CC-by-SA 3.0 license.</p>
        <p>The
design
of the</p>
        <p>Ethics</p>
        <p>Canvas
has itself followed
an
iterative
process
over
the
last
three
years. The
canvas
was
observed
in
use
with
di
erent
cohorts
of
university
students
at
undergraduate, Masters
and PhD levels, across
computer
science, engineering
and
business
disciplines.</p>
        <p>To
date
nearly
500
students
have
used
the
canvas. This
has
been
in a combination
of: ex-ante
practice
exercises,
where students analyse emerging technologies; intra
practice exercises, where
students
apply
the
ethics
canvas
to
an
active
technology
development
or
analysis
pro ject
they
are
working
on;
or
ex-post
practice
where
they
business
analysed
the ethics of existing technology
products. In
the most recent evaluation
of intra
practice, use
of the</p>
        <p>Ethics</p>
      </sec>
      <sec id="sec-4-5">
        <title>Canvas was integrated into the iterative development</title>
        <p>
          https://opengogs.adaptcentre.ie/ADAPT/ethics- canvas
of a BMC for di erent digital technology innovation projects with positive
usability results and some observed design pivots arising from the ethical assessment
[
          <xref ref-type="bibr" rid="ref7">7</xref>
          ]. We are working on the next iteration of the canvas and intend to exploit
web technologies to provide a cohesive experience around discussing ethics. We
welcome ideas, suggestions, and collaboration regarding the same.
        </p>
        <p>In particular, there is a possibility of using the various arguments discussed
in other related canvases, including the BMC, on the Ethics Canvas platform.
Such an approach would, in theory, allow the user to investigate similar ethical
considerations to the ones they are currently investigating in di erent business
contexts. This is quite similar to looking up how similar businesses operate and
using their experience within the context of understanding the challenges of a
new start-up. In the context of considering ethical impacts, the discussion would
involve both the Ethics Canvas and the BMC to provide a comprehensive view
of how innovation and ethics a ect each other. Therefore, linking the BMC with
its relevant Ethics Canvas is an important part of our evolving approach to tools
and support for innovation ethics. This can be done based on the structure of
the two canvas models. Both the business and ethics canvases are structured
into blocks, and have individual ideas or segments populating each block based
on context. Linking the related blocks or ideas between the two should provide
a good context for how the two a ect each other. Next we explore how we can
implement this using semantic web technologies.</p>
        <p>Canvas-driven Ethics Vocabulary
To support the broader use of the ethics canvas, we propose an open data
vocabulary to formalise and interlink the structured output of the online canvas
entries (already available in JSON) using Linked Open Data Vocabularies. This
vocabulary (outlined in Figure. 3) provides support for the following features.
Grouped Business and Ethics canvas perspectives: The vocabulary groups
both business model canvases and ethics canvases under a Project class. This
enables analyses to o er both canvas types to both i) contextualise the ethical
analysis in the business context for ex-ante and ex-post practice and ii) group the
ethics canvas with a business canvas during intra practice by innovation teams.
By subclassing Project from the Dataset object of the W3C DCAT7 standard, a
set of canvases can be grouped and managed as a data set using other
cataloguing metadata features of DCAT. This includes the ability to create a distribution
version of a dataset, which would allow for a set of canvases developed within an
organisation to be di erentiated from a version that was exposed more widely,
including possible license terms. This would be critical in intra practice where the
possibility that a data set of business and ethics canvases developed during an
innovation project could be published should not impede the honest and critical
development of those canvases internally. Therefore a `cleaning' process to map
internal canvases to ones suitable for wider consumption should be supported,
e.g. removing comments, re-wording tags for indexing as part of a wider canvas
repositories, including only the most recent versions of canvases and removing
con dential information or trade secrets.</p>
        <p>Canvas design evolution and variation: A general Canvas and BlockEntry
7 https://www.w3.org/TR/vocab-dcat/
class is used which is then subclassed in this case by the business model canvas
and ethics canvas types and their block types as described above. There are
however a variety of di erent innovation-focussed canvas designs available in
addition to the Business Model Canvas, e.g. the Lean Model Canvas. In addition,
canvas designs for other non-business concerns such as environmental or privacy
issues are also emerging. This class design therefore allows di erent canvas
designs to be used and integrated into the same project. This is key, at the very
least, in supporting the anticipated continued evolution of the Ethics Canvas
design.</p>
        <p>
          Canvas iteration and logging: The core a ordance of the canvas approach
is its use to rapidly capture, test and modify ideas in an iterative and
evidencedriven, pivot or proceed process [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ]. To support this, Project, Canvas,
BlockEntry, Tag and Comment classes are subclassed from the Entity class of the W3C
Provenance Ontology8 (PROV-O). This allows the provenance of each of these
entities to be tracked as canvas ideas are iterated across versions of the di
erent canvas types within a project. Provenance entity relations wasDerivedFrom,
and more speci c subproperties wasQuotedFrom and wasRevisonOf can then
be used to capture the revision history and the actors involved (prov:Agent ).
In ex-ante and ex-post settings, this is useful in tracking and acknowledging
the contributions to ethical analyses of di erent users and thereby encouraging
broader participation and collaboration. It may also be of use for linking di erent
published canvas analyses as part of evidence gathering and issue generalisation
for input into public policy formation. In intra practice, this can be useful for
logging relationships to possible ethics governance processes and responsibilities
(modelled as prov:Activity and prov:Agent ) as well as o ering a log of ethical
analyses for future scrutiny in handling a downstream ethics issue and the e
ectiveness of the process in identifying and reacting to the risk of that issue.
Canvas and entry interlinking: Consistent with the current online canvas
design, tags can be associated with a canvas block entry and then use to
index entries to allow others users to search for similar tags within the projects
available to them. This can be useful both on a public repository or a private
institutional repository for sharing ethical analyses and learning across multiple
innovation projects. Representing tags as rst class objects allows them to be
shared separately from canvases and entries, so that for instance a canvas author
can declare work involving a common issue represented in a tag without having
to publish the details in the canvas and its block entries. This also opens the
possibility for developing more taxonomically structured folksonomies of tags
managed by communities, either in the public domain or within organisations
with su cient volumes of tagged canvases to draw useful indexing and
interlinking bene ts. This also o ers the opportunity of interlinking tags with other
sources of knowledge, such as existing domain ontologies or indexes to larger
general knowledge data sets such as DBPedia9 or other sets within the linked
8 https://www.w3.org/TR/prov-o/
9 https://dbpedia.org/
open data cloud. For instance linking to legal terms or o cial taxonomies may
accelerate the path for such linked ethical data to inform public policy.
However the accelerating nature of technology innovation means that many of the
concepts useful for tags represent a moving target. To address this, tags could
be combined with natural language processing techniques such as named entity
recognition and text classi cation that could be harvested from and used to
interlink to the wider corpora of written material related to technology ethics.
        </p>
        <p>As a proof of concept we developed a small corpora of 102 articles annotated
with a similar number of tags for each of 5 classi cations, based on English
language news articles gathered in January 2018. While the annotation of
impacts proved unfeasible due to their multifaceted nature, 5 classi cations related
to the ethics canvas were found to be amenable for use in annotating the
corpus. These were: ethical issues; stakeholder classes (i.e. classes of individuals);
speci c organisations; resources; and technologies. Experiments with term
frequency and its inverse document frequency using this corpora showed potential
for useful text classi cation of news articles if a larger annotated training corpus
could be assembled. So while the annotated corpora was too small to provide
accurate results in classifying articles, it o ers a direction especially for
conducting ex-ante and ex-post ethical analyses. Automated annotation of news articles
and blog postings indexed against tags linked to published ethics canvases o ers
the chance to encourage much wider stakeholder involvement in the analysis of
emerging or recent ethics issues. Using tags to nd and lter streams of related
articles for those using the ethics canvas to analyse an issue considerably
lowers the bar for engaging in such analyses in comparison to academic literature
surveys. It also o ers a systematic way of identifying shifts in issues,
technologies and actors in such textual corpora that could be used to motivate further
corpora development and NLP tool training.
4</p>
        <sec id="sec-4-5-1">
          <title>Conclusion &amp; Future Work</title>
          <p>Responsible Innovation is becoming recognised as a topic deserving of study,
support and guidance separate to the more well established area of Responsible
Research. While a body of literature is starting to emerge, few practical tools
for ethical analysis in active commercial innovation settings are available.
Furthermore, existing methodologies often rely on embedded ethical expertise and
therefore seem unlikely to scale to the pace of innovation and breadth of
stakeholder involvement required to address ethics in digital technology innovation.
We have previously proposed aligning ethical analyses with the lightweight,
unmediated canvas a ordance that has become widely adopted for business analysis
in the digital technology innovation sector and have developed practical tools to
implement this approach. In this paper, we argue that such an approach could
be leveraged to enable broader industry and societal engagement in the ethical
analysis and debate of the emergent ethical issues associated with digital
technologies. To enable this ex-ante, intra and ex-post practice, we propose an open
data vocabulary to support the logging, sharing, searching and interlinking of
instances of ethical analysis.</p>
          <p>We are currently extending the existing Ethics Canvas implementation to
support the capture and publication of such analyses. This will be released as an
update to the current open source platform with features for publishing linked
business canvases to open data repositories. Future work will also explore
indexing published interlinked ethics-business canvas models to support the federated
search of tags and concepts across published data sets. The use of text classi
cation and named entity recognition to index news articles that may in future
inform both ex-ante and ex-post use of the canvas tool is also a target for
further exploration. Future work will also include the evaluation of this approach for
intra practice in ICT (Information &amp; Communications Technology) innovation
classroom settings as well as with active ICT innovation project teams. Its future
use in ex-post practice will be explored in educational setting with non-ICT
students, which will require seeding it with a set of business model canvas data sets
based on existing digital technology applications. Opportunities to develop
further usage guidance and support materials for employing and publishing linked
business and ethics canvases as linked open data will be explored to improve
uptake both as an educational and research tool.</p>
        </sec>
        <sec id="sec-4-5-2">
          <title>Acknowledgements</title>
          <p>This work is supported by the ADAPT Centre for Digital Content Technology
which is funded under the SFI Research Centres Programme (Grant 13/RC/2106)
and is co-funded under the European Regional Development Fund.
8. Reijers, W., Wright, D., Brey, P., Weber, K., Rodrigues, R., O'Sullivan, D., Gordijn,
B.: Methods for practising ethics in research and innovation: A literature review,
critical analysis and recommendations. Science and engineering ethics pp. 1{45
(2017)</p>
        </sec>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Blank</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>The four steps to the epiphany: successful strategies for products that win</article-title>
          .
          <source>BookBaby</source>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Calo</surname>
          </string-name>
          , R.:
          <article-title>Consumer subject review boards: A thought experiment</article-title>
          .
          <source>Stan. L. Rev. Online</source>
          <volume>66</volume>
          ,
          <issue>97</issue>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Dreyer</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chefneux</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goldberg</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>von Heimburg</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Patrignani</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Scho</surname>
            <given-names>eld</given-names>
          </string-name>
          , M.,
          <string-name>
            <surname>Shilling</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Responsible innovation: A complementary view from industry with proposals for bridging di erent perspectives</article-title>
          .
          <source>Sustainability</source>
          <volume>9</volume>
          (
          <issue>10</issue>
          ),
          <volume>1719</volume>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>Industrial</given-names>
            <surname>Innovation</surname>
          </string-name>
          and
          <article-title>Infrastructure (Goal 9) targets - Sustainable Development Goals - United Nations Development Programme</article-title>
          . http: //www.undp.org/content/undp/en/home/sustainable-development-goals/ goal-9
          <article-title>-industry-</article-title>
          <string-name>
            <surname>innovation-</surname>
          </string-name>
          and-infrastructure/targets/, accessed:
          <fpage>2018</fpage>
          -05- 30
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Martinuzzi</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Blok</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brem</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stahl</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          , Schonherr, N.:
          <article-title>Responsible research and innovation in industry|challenges, insights and perspectives (</article-title>
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Osterwalder</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pigneur</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          :
          <article-title>Business model generation: a handbook for visionaries, game changers, and challengers</article-title>
          . John Wiley &amp; Sons (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Reijers</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Koidl</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lewis</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pandit</surname>
            ,
            <given-names>H.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Godjin</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Discussing ethical impacts in research and innovation: The ethics canvas</article-title>
          .
          <source>IFIP TC9 Human Choice and Computers Conference</source>
          , Poznan, Poland (
          <year>September 2018</year>
          (in-press))
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>