=Paper=
{{Paper
|id=Vol-1216/paper5
|storemode=property
|title=Social Sustainability Indicators for Software: Initial Review
|pdfUrl=https://ceur-ws.org/Vol-1216/paper5.pdf
|volume=Vol-1216
|dblpUrl=https://dblp.org/rec/conf/re/HinaiC14
}}
==Social Sustainability Indicators for Software: Initial Review==
https://ceur-ws.org/Vol-1216/paper5.pdf
Social Sustainability Indicators for Software: Initial
Review
Maryam Al Hinai Ruzanna Chitchyan
Department of Computer Science Department of Computer Science
University of Leicester University of Leicester
Leicester, UK Leicester, UK
masah1@leicester.ac.uk rc256@le.ac.uk
Abstract—Software’s social sustainability is an important usage of the software is minimal and/or has a positive effect on
concern that needs an in-depth investigation. The objective of this sustainable development” [9]. However, to the best of our
paper is to understand what social sustainability is, how it is knowledge, presently there are no heuristics or metrics to
measured today, and how is social sustainability of a software inform and guide software engineers in assessing the effects of
system evaluated today. We present the initial results of a
a software system on “social capital” or on “positive …
systematic literature review on these questions. Our findings so
far highlight a large gap in work on software sustainability condition within communities…”. In order to produce socially
assessment. sustainable software, the software engineers need a way of
Index Terms—Social sustainability, software, indicators, assessing, throughout the development process, the effects that
systematic literature review, assessment. the constructed software will have on social sustainability of its
intended users. This paper presents the initial results of our on-
I. INTRODUCTION going effort towards development of such metrics – a
comprehensive review of research related to social
In all developed (and most developing) countries the public
sustainability and software.
is now heavily dependent on software in nearly all walks of life
In order to construct meaningful metrics to measure how
– from email to e-banking and e-voting. Most agree that
software would affect social sustainability, one must first learn
software applications have changed and largely improved our
what social sustainability really implies over and above some
lives. However, there is a dark side of the story. With all our
generic definitions. It is also necessary to study any related
information available electronically and most activities moving
metrics (which may already exist), and to identify what social
on-line, individuals and nations alike are at social risks that
sustainability indicators are considered relevant today. We
may include (no name a few):
present the preliminary results of our study of these questions
• Cyber-crimes such as child bullying and grooming obtained via an (on-going) systematic literature review (SLR).
attacks [1]; The rest of the paper is structured as follows: section 2
• Eroding privacy, and step-by-step move to “total outlines the sources used and specific questions set in the above
surveillance” societies; mentioned SLR, section 3 describes the findings on research
• Social ties degradation. questions and section 4 summarizes the work.
Thus, software engineers must closely engage with the
movement on sustainable development (widely inspired in II. SYSTEMATIC LITERATURE REVIEW SET UP
1987 [2]) in order to make software products socially The objective of this study is to understand what social
sustainable. A significant effort has been expanded into sustainability is, how it is measured today, and what has been
research on numerous topics related to software sustainability published with regards to evaluation of software’s social
(e.g., data center energy efficiency [3], energy efficient sustainability effects. To investigate these issues, we
algorithms [4] and requirements engineering [5], etc.). Yet, the formulated the following set of research questions:
issue of software effects on social sustainability has barely RQ1: What metrics are used for measuring social sustain-
been studied. ability? How are they constructed?
According to [6], “Social sustainability means maintaining This question aims at exploring how social sustainability
social capital and preserving the societal communities in their has been evaluated and what are the specific metrics used for
solidarity”. Willis, McKenzie and Harris [7, 8] defined social measuring social sustainability. With this question, we aim at
sustainability as “a positive and long-term condition within exploring the broader literature on the social sustainability
communities and a process within communities that can issues, regardless of the area of application – whether related or
achieve and maintain that condition”. Sustainable software was unrelated to software development. This question also aims to
described as “software whose direct and indirect negative review how social sustainability metrics are built and what
impacts on economy, society, human beings, and the their bases are.
environment resulting from development, deployment, and RQ2: What are social sustainability indicators?
This question aims to study the finer-grained constituents No of No. of
No. of
No. of
on which the social sustainability metrics are built, and the Digital duplicate
results accept papers
Library removed (so
ways that these constituents are quantified upon. Furthermore, returned ed
far)
included
here we will identify what are the common aspects of social ASSIA 1 1 0 1
sustainability in each area. We will identify common
Web of
dimensions/constituents used in various domains and how they Science
79 68 29 9
are customized to adapt to a specific context or domain. ACM 3 2 0 2
RQ3: What is the role of software in social sustainability? Springer
The intention here is to know what is the relationship and 832 310 7 15
Link
use of software applications within social sustainability Total 1116 540 45 88
domain. This question will be used to look at a set of issues,
including:
What social sustainability areas of life and activities does
The following data was extracted from each studied article:
software support and how?
What (if any) challenges related to social sustainability • General admin, i.e.,: title, author(s), source, year
could be expected to be addressed via software? • Social sustainability indicator
RQ4: What are the indicators of software’s social • Social sustainability metric
sustainability? • How social sustainability is supported
The objective here is to study how software’s social • Type of study (e.g., case study, rigorous analysis,
sustainability is assessed. We are interested in knowing the prototype)
indicators related specifically to software applications. We are • Context of study/domain
also looking at how similar or different are these indicators to
indicators in other domains (e.g., agriculture, etc.). III. FINDINGS ON RESEARCH QUESTIONS
As sources for SLR we used a number of digital libraries, As we have noted above, this is an on-going work.
namely ACM, IEEE, Scopus, Springer Link, Web of Science, However, we are now able to review the answers we have so
Applied Social Sciences Index & Abstracts (ASSIA). These far obtained to the previously set questions. Though these
libraries where chosen based on their subject coverage of both findings will likely evolve to some degree by the time the full
computer science and social sciences. ACM and IEEE cover SLR is completed, we have observed that the general set of
computer science and engineering areas. Social sciences and indicators, metrics, and domains has now well stabilized. In
engineering are covered by Scopus and Springer link libraries. other words, review of additional articles does not tend to
Web of science and ASSIA cover social sciences areas to significantly change/add to the current set of results.
obtain content on (computer-science domain independent) The current findings that address the set research questions
social sustainability. are presented below:
To select the articles from the digital libraries, we used a
combined search string extracted from the above discussed A. Construction of metrics used for measuring social
research questions to assure that we get relevant results [10]. sustainability (RQ1)
Although the combined search string (which we arrived at after 1) Assessment frameworks for Social Sustainability
an initial piloting of several search strings) was customized to The most commonly used framework for assessment of
each digital library, it always covered the topics of "Social social sustainability is the life cycle assessment (LCA). This is
Sustainability" AND (metrics OR indicators OR software). a “cradle-to-grave” method of evaluating the inputs, outputs
The results of the search and initial screening for this study and environmental impacts of a product during all phases of its
are shown in Table 1. The excluded sets of papers were either life cycle [11]. An example of this is: land consumption and
those with no access to abstracts, or not in English, or found to environmental emissions in a case of municipal waste
be not relevant to the research questions (i.e., did not address management [12]. The LCA has been adapted to include such
the topic of social sustainability or had no relation to social concerns as labour force, communities’ living standards,
indicators/metrics for social sustainability). Eighty-eight of cultural heritage, freedom, health and safety, equity and
accepted papers have then been studied (this is an on-going poverty prevention [12-21].
work). In [22], a Social Impact Indicator (SII) is applied. SII is
based on LCA and is used to calculate social effects such as
TABLE I. SCREENING RESULTS human resources and stakeholders participation [22].
No. of
In [21], the LCA is merged with the Economic Input and
No of No. of No. of Output analyses method (EIO) to form economic input–output-
Digital duplicate
results accept papers
Library
returned ed
removed (so
included
based life cycle assessment (EIO-LCA). The EIO-LCA used to
far) quantify direct and indirect sustainability impacts of U.S
IEEEXplor
er
64 44 0 13 construction industries (e.g. indirect work injuries) [21].
Vulnerability assessment techniques (VATs) were used in
Scopus 137 115 9 48
[23] to assess the social impacts resulted from urban
redevelopment projects. This was done by identifying the most involved in selecting or designing indicators for social themes
vulnerable people then assessing the social negative impacts as the available scientific information was limited or non-
affecting them [23]. This approach gives insights to policy existent.
makers on areas to consider reducing the negative social effect Once the indicators are selected, metrics are constructed with
of the project [23]. Doloi 2012 presented a framework for them. For example, in [12] the social sustainability of
social performance assessment of infrastructure projects based Municipal Solid Waste Management system was evaluated by
on Social Network Analysis (SNA) [24]. The SNA was utilised two indicators: damage to human health and income based
to identify groups of stakeholders affected by the project community well-being [12]. The damage to human health was
(actors), their degree of influence (relationships between calculated by summing the “factors for mortality (measured as
actors) and their specific social needs [24]. Then, the groups’ years of life lost—YOLL), severe morbidity and morbidity
satisfaction of needs was measured and the project’s social (measured as years lived disabled—YLD)” [12]. The income
performance was derived [24]. based well-being indicator was calculated using the
potential
In [25], Maslow’s Hierarchy of needs was suggested to be employment
opportunities
for
ith
level
(labour
hrs/tonne),
combined with LCA to develop social sustainability measure the
rate
of
wages
($/hour)
of
ith
level.
The
value
of
income
for organizational decisions. Organizations can use a specified generation
from
indirect
activities
($/tonne)
and
the
cost
need to derive a social indicator from it. For example, taking of
living
($/person),
as
shown
in
Fig
1.
into account health as a basic need, an organization considers
improved quality of food and health insurance policies as social
indicators [25]. Companies aiming at more social sustainability
shall focus on meeting their employees higher order needs (e.g.
equity) while others will focus on satisfying the lower order
needs such as food [25]. Fig. 1. Calculation (source [12])
2) Metrics Construction Process
Another clearly emerging threat from the literature review
Based on the reviewed literature so far, we observe that the
is the current lack of trust towards the sustainability assessment
common way of constructing metrics or methodology to assess
metrics and methodologies. This, we believe, is caused by the
social sustainability starts with identification of general or
relative immaturity of the filed. Some publications propose to
domain specific sustainability assessment guidelines that have
tackle this issue by “developing case study banks to translate
been already published. For example, in [26], the researchers
experiences of using an indicator” [43]. This work also notes
investigated available higher education and campus
that such banks will help in “… increasing criteria confidence
sustainability assessments frameworks as a starting point for
and value usefulness to potential users … through case studies
evaluating Malaysian campuses. Guidelines can be local or
validation checks which can also assist with improving the
international. For instance, in [27], the researchers based their
indicators to meet a satisfactory degree of ‘accuracy’, and
assessment on the International Hydropower Association (IHA)
‘credibility’.” This approach has, in fact, been used by a
Sustainability Guidelines to evaluate the sustainability of
number of other researchers [22, 36, 40].
hydropower project in China.
Moreover, established indexes/indicators of assessments B. Social sustainability indicators (RQ2)
(such as Human development index and Wellbeing Index [28], Social sustainability indicators should be relevant to the
Vanclay’s definitional list of ‘‘social impacts’’ [20], Oregon case under investigation. In [40], it was expressed that
Benchmarks [29] and European Commission indicators [30]) sustainability indicators need to satisfy criteria such as
could be used as basis to build upon them the assessment causality and sensitivity. Those criteria are to ensure that the
variables or to compare the assessment results against them1. indicators are related to the monitored case and they respond to
Once the general guidelines are chosen and complemented changes in the studied case [40].
with domain-specific policies, the assessment methodology is Social sustainability indicators vary depending on the
then customized to fit a specific domain and case study. In domain. Based on our literature review, so far we have
order to do that, academics’ and stakeholders’ contributions are identified over 600 indicators. Looking at the list of indicators
often involved. This is done through interviews, questionnaires and using the keywords and classifications that paper authors
or focus groups [14, 16, 23, 26, 28, 29, 31-42]. Stakeholders’ had provided, commonly used indicators were identified
participation is also a part of evaluating a project’s (regardless of the domain). At the most abstract level, the
sustainability [27]. In study presented in [39], for instance, the indicators are divided into two main categories: Community
experts who took a part in a customisation phase were selected and Culture and Governance. Indicators under the Community
based on their contribution to the research on future category are directly related to individuals and groups within a
development of dairy farming. In [40, 41], stakeholders were given society, their health, education, equality, etc. Culture and
Governance indicators are concerned with cultural and political
1 issues of a given society. The aggregated categories are
Although we cannot use the same methods directly, as these are
constructed on bases of extensive country-wide surveys of such demonstrated in Fig. 1 below.
indicators as life expectancy at birth, mean years of schooling or 1) Employment indicator comprises several sub-indicators
gross national income per capita. related to employment statistics and job conditions [39]. The
2
Child labor (i.e., employment of those under 16 years of age) is commonly
considered a bad practice in the West. However, we do note that in some
following indicators are examples of what can be used under 9) Social acceptance of technology indicator evaluates the
this category. community’s readiness to implement or use new technology.
• Number of employed women/ “Share of women in Knowledge, perception and fear are used as sub-indicators for
leading positions” [33, 37, 44] social acceptance [20]. Knowledge estimates what is the public
• Number of Full time/part time workers [45] level of knowledge about the technology while perception will
• Utilization of different working time arrangement [45] assess what they think about it (positive – negative). Fear
• Compensation [46] evaluates what issues/ worries the community has about the
• Job opportunities creation [37] technology.
2) Health indicators set covers the quality of health services 10) Social cohesion group of indicators is related to the ties
provided to the people [37], health problems reported to between the community members and their feel of
authorities [15, 46], health risks [36] and health practices [46] involvement. Some examples are:
in the community. Health indicators could be used to assess: • Citizens walkability to places in the local area such as
shops and community [41, 52].
• Availability and access to drinking water [35]
• Citizens empowerment by allowing initiations of
• Child mortality rate [47]
community activities and voluntary work [48, 52] or
• “Percentage of workers with health benefits” [18]
decision making [15, 40]
• “Contribution to healthy and safe food” [36]
• Network [40, 48, 54, 55] and knowledge sharing [14,
• “Voluntary health measures taken” [37] 36, 37, 56, 57]
3) Equity category includes indicators that should reveal • Visible minorities, tolerance, identity [40, 48]
equality measures to all people regardless of their age, gender,
• Accountability and transparent decision making
ethnicity and social status. Examples are: process [48]
• Income/wealth distribution [17, 27] 11) Cultural indicator is concerned with preserving the
• Social inclusion [40, 48] community’s culture. This can include
• Diversity of housing infrastructure [48] • Respect on cultural heritage and local wisdom [14]
• “Provisions for basic needs of disabled, elderly or • Respect on customary right of indigenous people [14]
children with proper access” [32] • Local heritage and listed buildings [54]
• “Fair competition” [14] • Protection of cultural heritage [27]
4) Education indicators are related to education facilities 12) Political indicator considers governmental laws and
provided to the community. This can include: peoples’ trust in them [28]. When a given case evaluates social
• Number of persons with higher education than sustainability of an organization, these indicators focus on the
secondary school/number of persons between 20–64
organizational policies and employees’ attitude towards them.
years [49] While in this section we have summarized the more than
• Employees educational level/ Literacy levels [28, 36, 600 social indicators collected form our study into 12 cohesive
48] categories, we must also note that the social sustainability
• Offered areas of employee training [37] indicators do not, in fact, always adhere to such a simple, flat
• Number of student per teacher [50] hierarchy. In truth, they are often interchangeable and
• Supporting Educational Institutions [46] overlapping. We attribute this to the previously discussed
5) Security indicators are primarily related to crimes as the metrics and methodology adaptation process (see section III.
examples below suggest. A.1), whereby the metrics and methodology are always
• Personal crime [48] customized to suite the domain and the level of granularity
• Property crime [48] relevant to a given case study. For example, employment can
• Overall crime [29, 34] be used as an indicator by itself (or a group of indicators, as
• Vandalism [34, 51] suggested above) but it can also be used as a sub-indicator to
the community’s equity.
• Juvenile arrests [29]
The social indicators can also vary based on external and
6) Services and facilities indicators focus on availability
internal view of an organization [15, 22, 40, 42, 46]. For
and access to services and facilities.
instance, looking at a farm’s social sustainability internally
Those indicators can be related to schools [32, 52], health
means relating the social concerns to its employees and
care services [32, 34, 52], sports facilities [32, 52], child care
workers [40, 42]. External social sustainability would mean
and housing [48]
assessing the community affected by the farm or consumes the
7) Resilience indicator is related to the communities’ farm’s products. In [40], the external indicators were related to
adaptability to changes [23, 32, 48, 53]. animal welfare and health and landscape management.
8) Human rights indicators are concerned with, for
instance, child labour, forced labour, and discrimination [14, C. Role of software in social sustainability (RQ3)
54]. The articles related to the role of software in social
sustainability suggest that software is often used to:
1) Promote social sustainability. body of research conducted in the area of human-computer
For instance, in [58] a prototype of communication interaction that focuses on various topics of social
software is presented which is to be used as a communication sustainability (such as stress, usability, loneliness, etc. [59]).
enabler between virtual teams and virtual organization. The This issue indicates that thought a large effort has been
software is to support social sustainability by enhancing the underway for some time in HCI community to address
social networks. particular human-computer interaction issues, that work has not
2) Design for social sustainability. yet been consolidated under the umbrella of “social
For instance, in [37] software is utilized to provide sustainability”. As the next step in this research, it is our
guidance and reminders to researchers and managers while intention to further study this issue to better address this
modelling a biotechnological product. The provided knowledge research question.
is about social sustainability issues to be taken into account D. Indicators of software’s social sustainability (RQ4)
while designing the product. This will help support the process
of decision-making. As for any other product, the social sustainability of
software can be considered in its production, use, maintenance,
and disposal stages. Below are the findings from our literature
review on this topic so far:
1) Social sustainability at production process is considered
in [60], where it is suggested to use “country of origin of a
material and the manner in which it was produced (for
example through child labor2)” as social sustainability
indicator.
2) For software use response time and scalability were used
to evaluate software prototype that supports social networks
and knowledge sharing between virtual teams [58]. This work
also mentions that evaluating the prototype’s performance
includes evaluating “the degree of network congestion, the
load on servers, the number of 3D objects to manage, and the
complexity of the submitted query.” They added that the
database will support data availability in different context and
data stability. Response time is a relevant indicator for social
sustainability in domains where fast access to information is
necessary for equality (e.g., financial markets). In more
general context, response time and scalability are more related
to the sustainability of software itself as inadequate speed and
scalability devalue software and complicate evolution.
Another work [57] provides “… a theoretical basis for a
multi-actor system as a simulation tool for social
sustainability”. Here software agents and human simulate a
social sustainability model [57]. For this the software agents
must be “…equipped with functions of perception, mobility,
learning, communication, and coordination…”[57]. Such
functions can be considered indicators for software agents’
social sustainability. The agents were proposed to simulate
human individuals and groups’ behaviour related to knowledge
generation, knowledge communication and knowledge use
Fig. 2. Social sustainability indicators
[57]. Knowledge, perception, learning, communication and
3) Educate on social sustainability. coordination functions are social sustainability
For instance, an educational game is used in a study to dimensions/indicators Fig 2.).
educate students on sustainability and social responsibility [55]. At present we have not yet identified any work on social
4) Assess social sustainability. sustainability of software maintenance and disposal.
For instance, Assefa and Frostel outline a tool for assessing
ecological and economic sustainability of energy technologies
[20]. They discuss social indicators to be included in the tool. 2
Child labor (i.e., employment of those under 16 years of age) is commonly
We observe that our search on software and “social
considered a bad practice in the West. However, we do note that in some
sustainability” resulted in much fewer articles than expected. countries working in programming or tasks like interview transcription for
This is particularly surprising as we are well aware of a large software requirements, etc. could provide a very good future prospect to the
children involved.
Similar to the comment in the preceding sub-section, we [4] Héliot, F., M.A. Imran, and R. Tafazolli. Near-optimal energy-
have observed that there are much fewer social sustainability efficient joint resource allocation for multi-hop MIMO-AF
indicators discussed for software domain, compared to other systems. 2013.
domains (such as agriculture and supply chain management). [5] Roher, K. and D. Richardson. Sustainability requirement
This can be attributed to two factors: patterns. In Requirements Patterns (RePa), 2013 IEEE Third
International Workshop on. 2013.
i) On the one hand, the software effects on social
[6] Penzenstadler, B. and H. Femmer, A generic model for
sustainability are likely to have been studied for individual
sustainability with process- and product-specific instances, in
social sustainability characteristics (such as access to learning Proceedings of the 2013 workshop on Green in/by software
or other electronic resources, connectedness, etc.), without engineering2013, ACM: Fukuoka, Japan. p. 3-8.
aggregating these characteristics under the overall umbrella of [7] Willis, P., S. McKenzie, and R. Harris, Introduction: Challenges
social sustainability. in Adult and Vocational Education for Social Sustainability, in
ii) On the other hand, the social effects of software Rethinking Work and Learning, P. Willis, S. McKenzie, and R.
products, once in use, are often indirect, take long term to Harris, Editors. 2009, Springer Netherlands. p. 1-9.
surface, and are difficult to discern. These effects are the so- [8] McKenzie, S., Adult and Vocational Education for Social
called third-order impacts of ICT [61] which “… are long term Sustainability: A New Concept for TVET for Sustainable
indirect effects on the environment that result from ICT usage, Development, in Work, Learning and Sustainable Development,
like changing life styles that promote faster economic growth J. Fien, R. Maclean, and M.-G. Park, Editors. 2009, Springer
and, at worst, outweigh the formerly achieved savings (rebound Netherlands. p. 177-186.
effects).” [9] Dick, M., S. Naumann, and N. Kuhn, A Model and Selected
As noted above, review of work that addresses specific Instances of Green and Sustainable Software, in What Kind of
Information Society? Governance, Virtuality, Surveillance,
characteristics of social sustainability will be the next step in
Sustainability, Resilience, J. Berleur, M. Hercheui, and L. Hilty,
this work. Editors. 2010, Springer Berlin Heidelberg. p. 248-259.
IV. CONCLUSION [10] Software Engineering Group, S.o.C.S.a.m., Keele University, et
al., Guidelines for performing Systematic Literature Reviews in
This paper presents the initial results of our work on Software Engineering. 2007.
(ongoing) systematic literature review on social sustainability, [11] Handbook of Life Cycle Assessment : Operation Guide to ISO
its metrics and indicators and its relation to software. So far we Standards. 2002, Secaucus, NJ, USA: Kluwer Academic
have distilled a general social sustainability assessment Publishers.
framework and assembled over 600 social sustainability [12] Menikpura, S.N.M., et al., Evaluation of the Effect of Recycling
indicators which are then aggregated into 12 cohesive groups. on Sustainability of Municipal Solid Waste Management in
A surprise finding of the SLR so far is that, in the 88 Thailand. Waste and Biomass Valorization, 2012. 4(2): p. 237-
reviewed papers - taken from 5 digital libraries - software has 257.
virtually no consideration of the concept of social [13] Ekvall, T., Nations in social LCA. The International Journal of
sustainability. Yet, we are aware of significant work (most Life Cycle Assessment, 2011. 16(1): p. 1-2.
particularly in HCI community) that has addressed a number of [14] Manik, Y., J. Leahy, and A. Halog, Social life cycle assessment
social sustainability features (such as usability, loneliness, etc.). of palm oil biodiesel: a case study in Jambi Province of
This SLR has not been able to identify such relevant work Indonesia. The International Journal of Life Cycle Assessment,
since that work has not related to the concept of social 2013. 18(7): p. 1386-1392.
sustainability explicitly. Thus, our future work will investigate [15] Labuschagne, C., A.C. Brent, and S.J. Claasen, Environmental
such specific social sustainability dimensions in relation to and social impact considerations for sustainable project life
software development. Upon completion of the literature cycle management in the process industry. Corporate Social
Responsibility and Environmental Management, 2005. 12(1): p.
review, we will work on construction of social sustainability
38-54.
assessment metrics and guidelines for software development.
[16] Stamford, L. and A. Azapagic, Sustainability indicators for the
assessment of nuclear power. Energy, 2011. 36(10): p. 6037-
REFERENCES 6057.
[17] Corbière-Nicollier, T., I. Blanc, and S. Erkman, Towards a
[1] Rybnicek, M., R. Poisel, and S. Tjoa. Facebook Watchdog: A global criteria based framework for the sustainability assessment
Research Agenda for Detecting Online Grooming and Bullying of bioethanol supply chains. Ecological Indicators, 2011. 11(5):
Activities. In Systems, Man, and Cybernetics (SMC), 2013 p. 1447-1458.
IEEE International Conference on. 2013.
[18] Heller, M.C. and G.A. Keoleian, Assessing the sustainability of
[2] Bruntland, G., Our common future: The world commission on the US food system: a life cycle perspective. Agricultural
environment and development, 1987, Oxford: Oxford University Systems, 2003. 76(3): p. 1007-1041.
Press.
[19] Menna, C., et al., Assessment of ecological sustainability of a
[3] Garg, S.K., et al., Environment-conscious scheduling of HPC building subjected to potential seismic events during its lifetime.
applications on distributed Cloud-oriented data centers. Journal The International Journal of Life Cycle Assessment, 2012.
of Parallel and Distributed Computing, 2011. 71(6): p. 732-749. 18(2): p. 504-515.
[20] Assefa, G. and B. Frostell, Social sustainability and social [37] von Geibler, J., et al., Accounting for the social dimension of
acceptance in technology assessment: A case study of energy sustainability: experiences from the biotechnology industry.
technologies. Technology in Society, 2007. 29(1): p. 63-78. Business Strategy and the Environment, 2006. 15(5): p. 334-
[21] Kucukvar, M. and O. Tatari, Towards a triple bottom-line 346.
sustainability assessment of the U.S. construction industry. The [38] Valdes-Vasquez, R. and L.E. Klotz, Social Sustainability
International Journal of Life Cycle Assessment, 2013. 18(5): p. Considerations during Planning and Design: Framework of
958-972. Processes for Construction Projects. Journal of Construction
[22] Brent, A. and C. Labuschagne, Social Indicators for Sustainable Engineering & Management, 2013. 139(1): p. 80-89.
Project and Technology Life Cycle Management in the Process [39] Calker, K.V., et al., Identifying and ranking attributes that
Industry (13 pp + 4). The International Journal of Life Cycle determine sustainability in Dutch dairy farming. Agriculture and
Assessment, 2006. 11(1): p. 3-15. Human Values, 2005. 22(1): p. 53-63.
[23] Pearsall, H., From brown to green? Assessing social [40] Meul, M., et al., MOTIFS: a monitoring tool for integrated farm
vulnerability to environmental gentrification in New York City. sustainability. Agronomy for Sustainable Development, 2008.
Environment and Planning C: Government and Policy, 2010. 28(2): p. 321-332.
28(5): p. 872-886. [41] Marletto, G. and F. Mameli, A participative procedure to select
[24] Doloi, H., Assessing stakeholders' influence on social indicators of policies for sustainable urban mobility. Outcomes
performance of infrastructure projects. Facilities, 2012. 30(11): of a national test. European Transport Research Review, 2012.
p. 531-550. 4(2): p. 79-89.
[25] Hutchins, M.J., J.S. Gierke, and J.W. Sutherland. Decision [42] Lebacq, T., P. Baret, and D. Stilmant, Sustainability indicators
making for social sustainability: A life-cycle assessment for livestock farming. A review. Agronomy for Sustainable
approach. In Technology and Society, 2009. ISTAS '09. IEEE Development, 2013. 33(2): p. 311-327.
International Symposium on. 2009. [43] Hasna, A.M. Embedding sustainability in capstone engineering
[26] Saadatian, O., K.B. Sopian, and E. Salleh, Adaptation of design projects. in Education Engineering (EDUCON), 2010
sustainability community indicators for Malaysian campuses as IEEE. 2010.
small cities. Sustainable Cities and Society, 2013. 6: p. 40-50. [44] Alam, M., Y. Furukawa, and K. Harada, Agroforestry as a
[27] Liu, J., et al., Sustainability in hydropower development-A case sustainable landuse option in degraded tropical forests: a study
study. Renewable & Sustainable Energy Reviews, 2013. 19: p. from Bangladesh. Environment, Development and
230-237. Sustainability, 2009. 12(2): p. 147-158.
[28] Magee, L., A. Scerri, and P. James, Measuring Social [45] Blake-Beard, S., et al., Social sustainability, flexible work
Sustainability: A Community-Centred Approach. Applied arrangements, and diverse women. Gender in Management: An
Research in Quality of Life, 2012. 7(3): p. 239-261. International Journal, 2010. 25(5): p. 408-425.
[29] Schlossberg, M. and A. Zimmerman, Developing Statewide [46] Sarkis, J., M.M. Helms, and A.A. Hervani, Reverse logistics and
Indices of Environmental, Economic, and Social Sustainability: social sustainability. Corporate Social Responsibility and
a look at Oregon and the Oregon Benchmarks. Local Environmental Management, 2010. 17(6): p. 337-354.
Environment, 2003. 8(6): p. 641-660. [47] McMichael, A.J. and J.W. Powles, Human numbers,
[30] Manos, B., T. Bournaris, and P. Chatzinikolaou, Impact environment, sustainability, and health. British Medical Journal,
assessment of CAP policies on social sustainability in rural 1999. 319(7215): p. 977-980.
areas: an application in Northern Greece. Operational Research, [48] Landorf, C., Evaluating social sustainability in historic urban
2010. 11(1): p. 77-92. environments. International Journal of Heritage Studies, 2011.
[31] Chengcheng, F., J.D. Carrell, and Z. Hong-Chao. An 17(5): p. 463-477.
investigation of indicators for measuring sustainable [49] Andersson, K., et al., Connecting Municipal and Regional Level
manufacturing. in Sustainable Systems and Technology Planning: Analysis and Visualization of Sustainability Indicators
(ISSST), 2010 IEEE International Symposium on. 2010. in Bergslagen, Sweden. European Planning Studies, 2013. 21(8):
[32] Chan, E. and G.L. Lee, Critical factors for improving social p. 1210-1234.
sustainability of urban renewal projects. Social Indicators [50] Ceyhan, V., Assessing the agricultural sustainability of
Research, 2008. 85(2): p. 243-256. conventional farming systems in samsun province of Turkey.
[33] Manos, B., et al., Effects of CAP policy on farm household African Journal of Agricultural Research, 2010. 5(13): p. 1572-
behaviour and social sustainability. Land Use Policy, 2013. 31: 1583.
p. 166-181. [51] Halme, M., C. Jasch, and M. Scharp, Sustainable home services?
[34] Bramley, G. and S. Power, Urban form and social sustainability: Toward household services that enhance ecological, social and
The role of density and housing type. Environment and Planning economic sustainability. Ecological Economics, 2004. 51(1-2):
B: Planning and Design, 2009. 36(1): p. 30-48. p. 125-138.
[35] Ochieng, B.O., K.F.D. Hughey, and H. Bigsby, Rainforest [52] Rogers, S., K. Gardner, and C. Carlson, Social Capital and
Alliance Certification of Kenyan tea farms: a contribution to Walkability as Social Aspects of Sustainability. Sustainability,
sustainability or tokenism? Journal of Cleaner Production, 2013. 2013. 5(8): p. 3473-3483.
39: p. 285-293. [53] Lee, G.K.L. and E.H.W. Chan, Evaluation of the urban renewal
[36] Vasileiadis, V.P., et al., Sustainability of European maize-based projects in social dimensions. Property Management, 2010.
cropping systems: Economic, environmental and social 28(4): p. 257-269.
assessment of current and proposed innovative IPM-based [54] Weingaertner, C. and Å. Moberg, Exploring Social
systems. European Journal of Agronomy, 2013. 48: p. 1-11. Sustainability: Learning from Perspectives on Urban
Development and Companies and Products. Sustainable [58] Fiumara, G., et al., Knowledge Representation in Virtual Teams:
Development, 2011: p. n/a-n/a. A Perspective Approach for Synthetic Worlds, in Collaborative
[55] Gennett, Z.A., J.A. Isaacs, and T.P. Seager. Developing a social Networks for a Sustainable World, L. Camarinha-Matos, X.
capital metric for use in an educational computer game. in Boucher, and H. Afsarmanesh, Editors. 2010, Springer Berlin
Sustainable Systems and Technology (ISSST), 2010 IEEE Heidelberg. p. 619-625.
International Symposium on. 2010. [59] CHI 2014: Toronto, ON, Canada. The DBLP Computer Science
[56] Oliveira, F.d.C., Á. Calle Collado, and L.F. Carvalho Leite, Bibliography 2014 [cited 2014 22nd May]; Available from:
Autonomy and sustainability: An integrated analysis of the http://dblp.uni-trier.de/db/conf/chi/chi2014.html.
development of new approaches to agrosystem management in [60] Widok, A.H., et al. Achieving sustainability through a
family-based farming in Carnaubais Territory, Piauí, Brazil. combination of LCA and DES integrated in a simulation
Agricultural Systems, 2013. 115(0): p. 1-9. software for production processes. in Simulation Conference
[57] Faber, N.R. and R.J. Jorna. The use of multi-actor systems for (WSC), Proceedings of the 2012 Winter. 2012.
studying social sustainability: Theoretical backgrounds and [61] Naumann, S., et al., The GREENSOFT Model: A reference
pseudo-specifications. in Computer Supported Cooperative model for green and sustainable software and its engineering.
Work in Design (CSCWD), 2011 15th International Conference Sustainable Computing: Informatics and Systems, 2011. 1(4): p.
on. 2011. 294-304.