<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>The Acceptance of energy monitoring technologies: the case of local prosumers</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Mary Barreto</string-name>
          <email>mary.barreto@prsma.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Lucas Pereira</string-name>
          <email>lucas.pereira@prsma.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Filipe Quintal</string-name>
          <email>filipe.quintal@prsma.com</email>
          <email>lipe.quintal@prsma.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>ITI/LARSyS/prsma.com</institution>
          ,
          <addr-line>Funchal</addr-line>
          ,
          <country country="PT">Portugal</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>-With transformations happening in the electricity sector, we need to ensure consumers have access to updated and correct information to accompany such changes. Consumers need to understand technologies available to them but also, learn how to use them to optimize their personal investment in such types of equipment. In this paper, we explore how a group of local prosumers has adopted energy monitoring technologies, their dayto-day strategies, and expectations when handling such systems. We studied 11 prosumers and the technologies they have used for three years, evaluated their satisfaction with the feedback provided and analyzed how a more modern visualization of their energy practices was introduced and adopted into their daily lives. We conducted interviews and questionnaires to evaluate their engagement with these tools. This initial work suggests this particular group of users have already a high level of knowledge about their systems, and as a result have integrated these into their routines. However, more support would be needed from other local actors to help them reach more benefits and as such, more satisfaction as consumers. We conclude by reflecting on barriers that need to be addressed to increase user satisfaction with these systems.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        I. INTRODUCTION
viously available to electricity suppliers become accessible to
these consumers. However, there is some work to be done
until that point, since they seem to have limited access to
information about ways to optimize their current installations,
whether through upgrades or storage solutions that would be
most adequate for them [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>
        Energy monitoring systems address part of that issue, as
these provide users access to the information being collected
and consequently, enable them to act on their energy
consumption. Energy monitoring technologies or eco-feedback are
defined as the use of technologies to monitor energy consumption
and production of a specific household [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. These technologies
allow the collection of energy consumption and production
by using sensors that send information from the household
to a central system. The information is gathered and then
presented using various forms such as email, or applications
that allow consulting and analyzing the information. In fact,
research studies [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] highlight the importance of
the mobility aspect.
      </p>
      <p>In this paper, we report on a study of technology acceptance
of energy monitoring technologies with residential prosumers
using small-scale solar PV to generate electricity. This study
describes participants’ motivations to become prosumers, the
acceptance and usage of the PV system and PrsmaEnergy
the application developed within the project, and differences
between these two. The ultimate goal is to capture and
analyze the empirical data with these users of how they have
used a PV system, observe how they adopted it through a
more modern application installed to optimize it and identify
potential problems that may exist while using it. Finally,
provide recommendations that can help service providers and
the design of effective user-driven solutions.</p>
      <p>
        The increasing global population has lead to an equal
increase in energy use. Due to limited energy resources such as
fossil fuels and, climate effects, energy efficiency has become
a challenging and pressing problem across the planet [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Since
a large portion of energy use has been in the residential sector,
measures implemented in countries have focused on the energy
efficiency of the existing buildings. Policy measures have
encouraged investments in innovative solutions such as smart
grids, smart homes, self-generation, and storage technologies,
which are available but still not widespread [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Photovoltaic
systems (PV systems) for instance, are technologies that
operate in the area of clean energy, not focused on inefficiency
but replacing the energy source for renewable energy. It is a
solution that helps consumers generate their own energy, and II. RELATED WORK
it is easy to integrate within existing buildings. An estimate Due to the diversity of existing equipment that can be used
of 17GW solar PV has been installed in the European Union, to achieve energy generation, there does not seem to be a
and it is predicted to increase up to 32GW by 2030 [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. precise term for residential prosumers. Generally, these are
      </p>
      <p>
        Consumers who use such systems are known as prosumers, known as energy consumers who produce their own energy
energy consumers who also produce and generate their own but there is not a clear term to classify these users across
energy. With the increased adoption rate and the technology countries due to differing regulatory frameworks and policies
innovation of these systems, these consumers transition very [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. Even within the EU there are no standard policies followed
quickly from passive to active participants in the changing by the member countries that help create a set of incentives
energy market [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. In other words, decisions that were pre- to increase the adoption rates of PV systems. Although, it
is expected for the installation of such systems to double
by 2030, there are barriers that endanger such adoption [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
      </p>
      <p>
        For instance, many consumers decide to install such systems
because they see these as an extra source of income, whether
through savings in electricity or earnings, they realize that
producing their own energy could be very valuable, but when
they search for the information, they realize local regulations
prevent them from doing so. In spite of some countries
have already developed remuneration schemes, few enable
prosumers to sell their electricity [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Consequently, reducing
the uptake of users investing in PV systems.
      </p>
    </sec>
    <sec id="sec-2">
      <title>A. Prosumer Motivations</title>
      <p>
        Recent work suggested a variety of motivations that explain
why regular consumers decide to produce energy in their own
homes. At an initial phase, the financial factors determine
the purchase of PV systems, for instance the upfront cost of
installation, borrowing costs, the scale of the financial benefit
(in terms of reduced electricity bills and available policy
support), and, the expected rate of return, earnings and savings
obtained (and payback period) of their investment [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ],
[
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
      </p>
      <p>In some instances, consumers relied on technical reasons
to purchase a PV system, for example, ownership of an
electric vehicle, smart meters or the ability to include at a
later stage battery storage and demand response technologies.
Other motivations included the aesthetics of rooftop solar PV
panels, the security of supply, and finally, maintenance costs
and efforts over time.</p>
      <p>
        The environmental impact and commitment remain a
motivation once the financial factors have been considered, and it
is based on the desire to protect future generations, and help
reduce the environmental impact of fossil fuel usage [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
      </p>
      <p>
        The prevalence of some motivations over others is not
similar across European countries, due to the varied policies
being followed [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], nevertheless, financial factors and access to
capital seem to be the most prevalent. Becoming a prosumer,
particularly installing a PV panel, often starts with financial
factors, but in a large number of cases it is a decision-based
in green and environmental motivations, and it becomes an
extension of their lifestyle [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
      </p>
    </sec>
    <sec id="sec-3">
      <title>B. Shifting energy activities</title>
      <p>
        Demand-side management (DSM) has been one of the
strategies within energy efficiency initiatives, used to reduce
or optimize the end user’s energy consumption in order to
reduce the cost and the environmental impact. One of its
mechanisms is the Demand response (DR) designed with the
objective of adjusting production demand. It does so, through
the creation of dynamic tariffs that encourage consumers to
conduct their energy consuming activities spread over time
or throughout the day, consequently avoiding consumption
peaks. From this demand-side perspective, prosumers are given
the choice of services they want to use to better match their
needs, and which ones they will want to offer [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Once users
have installed energy generation systems a set of practices or
changes emerge within the households. These changes are part
of what researchers have designated as “demand shifting” [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ],
where consumers change their behaviors to match and use
most of the energy produced at the time it is being produced
[
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. Constanza et al. [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] used an agent-based system to study
how users would shift laundry routines based on the electricity
tariff, and its results suggested increasing user interaction
around automated systems to take more advantage of them.
Hansen et al [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] conducted a study with 20 households in
Denmark where they observed how participants changed their
practices after having smart grid technologies installed. Results
indicated participants became prosumers as they changed their
knowledge and behaviors to make the most use of the sun
while requesting more support and dialogue with the local
energy provider. Similarly, Pierce et al [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] and Smale et al
[
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] conducted interviews with users participating in smart
grid trials to find cleaning practices were the ones most
suitable for DSM, while other activities (leisure, cooking and
eating) were more limited to being conducted in other times
than the ones usually taken to perform these.
      </p>
      <p>Nevertheless, having access to information about energy
generation is not always possible or easy to achieve. Besides
the presence of other factors, such as social influences within
the household, there are technical limitations that prevent
prosumers from pursuing this demand shifting.</p>
      <p>This paper describes a case study of a group of prosumers
located in a remote island, using energy monitoring
technologies that keep track of their energy generation systems and
the technology acceptance observed and measured through the
period of 4 to 6 weeks. Barriers are listed and analyzed in
terms of recommendations to improve such tools for future
service providers.</p>
      <sec id="sec-3-1">
        <title>III. STUDY DESIGN</title>
        <p>This study is integrated in the SMILE project that aims to
demonstrate nine different smart grid technologies in three
islands across Europe in order to foster its market introduction.
This study was conducted within one of the pilots (Madeira
island) in the project with the main goal to smarten up the
distribution grid, through the optimization of self-consumption of
renewable energy in the installations by introducing elements
like Battery energy Storage system (BESS) and specialized
battery management software. These prosumers are not
currently allowed to inject the excess energy into the grid due to
local regulations, however, for the purpose of battery analysis
and testing, these will be allowed to do it.</p>
        <p>
          One of the aspects of the project refers to the evaluation of
the energy monitoring technologies being used by participants.
We started by recruiting prosumers in the island that owned PV
solar systems and collected baseline information about their
usage of those systems. Around 4 weeks later, we installed a
monitoring system that collected baseline data for 6 months.
Afterward, prosumers were given access to an application
that provided feedback on their energy consumption and
production designated as PrsmaEnergy. This work describes
the technology acceptance evaluation of both the PV system
(prosumers had already installed) and the project application
PrsmaEnergy (which was integrated into the project). The
acceptance was measured using: semi-structured interviews
and a questionnaire adapted from the Technology Acceptance
Model (TAM) [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ], [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ], [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ].
        </p>
        <p>
          The interviews collected information related to electric
energy consumption and production, routines, expenses and
awareness about energy-related habits or strategies. All
interviews, before receiving PrsmaEnergy and after using it for 4 to
6 weeks, lasted around 20 to 30 minutes. All interviews were
recorded and transcribed, and its data were analyzed using
grounded theory [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ], [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ] by grouping quotes into themes,
and coding these according to categories, which are further
explained in the coming section.
        </p>
        <p>The Technology Acceptance scale was used before
providing access to PrsmaEnergy, and around 4 to 6 weeks after users
were given the access credentials to use it. The scale included
32 items across 6 dimensions: perceived usefulness (PU) (9
items), perceived ease-of-use (PEU) (7 items), intention to use
(2 items), user satisfaction (7 items), ease of learning (4 items),
and attribute of usability (3 items) (see table I for more details).
The items were slightly adjusted to evaluate the acceptance of
energy monitoring technologies. It is believed the higher these
aspects are rated the higher is the user’s acceptance. The scale
was translated to the native language of the user sample and
users were asked to rate their degree of (dis) agreement on 7
points Likert scale. The internal consistency of the scale was
assessed by calculating the Cronbach alpha value of the overall
scale, which was 0.98 for evaluating the current system, and
0.76 for the PrsmaEnergy evaluation.</p>
        <p>This study was designed to evaluate the technology
acceptance in two moments:</p>
        <p>
          1) Evaluation of the current PV system: Understand how
participants were using the PV systems they had already
installed in the homes before the project even started. The
research team conducted semi-structured interviews to collect
information on the following aspects:
1) The reasons and motivations for purchasing such a
system and becoming a prosumer;
2) Expenses before and after, as well as current ones;
3) Strategies used to optimize their production;
4) Routines and changes;
5) Use of an application that provides information about
their energy production, in case they had one. It included
a Think-Aloud while using the PV system. After the
interview participants were asked to fill in a questionnaire
based on the TAM [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ], [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ], [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ].
        </p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>2) Evaluation of the PrsmaEnergy satisfaction and usage:</title>
      <p>Understand how and in which ways PrsmaEnergy changed
their behaviors or use of the PV panels. Participants were
given access to the digital platform and were interviewed
4 to 6 weeks after having used it. The interviews focused
on following up aspects from the interviews conducted in
the first moment, namely, changes in expenses, changes to
their routines using devices or the system, and strategies
they used to handle or interpret the information given. In
addition, participants were asked about: frequency of use, most
relevant information and tools used to access it, least relevant
information and suggestions. After the interviews participants
were asked to fill in the acceptance questionnaire based on the
TAM.</p>
    </sec>
    <sec id="sec-5">
      <title>A. Participants</title>
      <p>
        The study was conducted with 11 households (see Table
II) that were recruited through the project using information
sessions and ads in social media. During the recruitment
phase, we encountered a combination of users that reported
they wish to optimize their PV panels as a reason to get
involved in the study. All participants had a solar PV system
installed in their homes purchased with their own funds with
no financial programs or subsidies using local companies as
installers or recurring to online sales and installing these
themselves. Participants were asked to complete a baseline
survey that provided both demographic information and
consumption practices. In terms of demographic information, the
household size ranges from 2 to 5 people, with an average
of 3.54 people per household. Age ranges of participants and
family members vary between 2 years old and 84 (average
age is 37.3 years old). We measured participants environmental
concern by asking them to fill in the New Environmental Scale
(NEP) [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ], to which all responded in agreement with the
new environmental paradigm. All participants were supportive
of the impact of human activity in the environment and its
fragility, higher scores of this new paradigm are associated
with pro-environmental behaviors [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ].
      </p>
    </sec>
    <sec id="sec-6">
      <title>B. PrsmaEnergy set up</title>
      <p>
        Each participant household was already equipped with a
PV panel to which a smart meter was installed to collect
baseline data in terms of 1) energy production, 2) energy
consumption, 3) energy being sent to the grid. This data
was then stored in the projects Energy Management System
(EMS) and displayed through PrsmaEnergy designed with the
purpose of tracking the individual installations and providing
information about their systems throughout the project. In
terms of the feedback, it was decided to represent electricity
production and consumption in terms of 1) energy and power,
2) cost and 3) environmental impact. The metrics selected
- kWh/kW, money, and CO2 - are indeed commonly used
in combination for the specific purpose of engaging different
target groups [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ].
      </p>
      <p>The features included close to real-time feedback about
consumption and production (updated every minute), historical
feedback with three levels of temporal granularity (days,
weeks, months), and comparison between dates the users could
select to have more information. Real-time feedback (i.e.
current consumption and production), together with an overview
of recent energy use (last hour and current day/week/month),
is displayed in the “dashboard” (which serves as a landing
page), while the “analytics” feature provides users with the
opportunity of reviewing and comparing data among different
periods of time (Figure 1).</p>
      <p>We selected three main visualization types (Figure 2): lines
chart (to show patterns over time - e.g. the period of the day
when production usually exceeds consumption), pie and bar
charts (to represent cumulative amounts of data - i.e. daily,
weekly, and monthly energy use). Households usually value
the opportunity to access feedback and check their energy
status via mobile devices. For this reason, we opted for a
webbased application designed to be responsive, so that it can be
accessed also via mobile devices (smartphone and tablets).</p>
      <p>The work presented here aimed to evaluate the acceptance of
energy monitoring technologies by a local group of prosumers,
focusing on the following questions:
1) What motivations led participants to become prosumers?
2) How do they report themselves in terms of electricity
usage and other resources?
3) What was the acceptance for the current PV system
they had installed in their homes before we started our
research project?
4) Were there differences in terms of previous system and</p>
      <p>PrsmaEnergy?
5) How did participants use PrsmaEnergy?</p>
      <p>The following section summarizes the findings for each
of these questions, with a combination of qualitative and
quantitative results, gathered through the questionnaire and
the interviews conducted with the participants. The
qualitative analysis displays more relevant and common themes
that emerged from the participants’ interviews concerning
technology acceptance. The quantitative results refer to the
Acceptance scale used to evaluate both systems.</p>
      <sec id="sec-6-1">
        <title>IV. RESULTS</title>
        <p>This section presents the key findings of the acceptance
study in three areas: a) users energy practices, b) user
motivations and c) technology acceptance, of the current system
and of PrsmaEnergy. For the first two, the main themes are
described in a succinct way, and for PrsmaEnergy, Table III
presents the main themes with illustrative quotes.</p>
      </sec>
    </sec>
    <sec id="sec-7">
      <title>A. Users energy practices</title>
      <p>When asked about their electricity costs before (the costs
ranged from 75 to 130 euros) and after the installation of
the PV panel (the costs lowered from 45 up to 100 euros)
all participants referred to a cost reduction between 20 and
30 percent after installing the PV panels. Participants reported
the costs based on expense tracking habits they had before and
after installing the PV panel. Four out of the 11 users reported
slight increases to their energy bill, which they interpreted as
tax increases. Or even due to weather changes, for instance, the
fluctuating temperatures during the summer required the use of
air conditioning or fans in the homes. One user shared the PV
system did not allow so far savings, due to specific appliances
in the home that did not allow for it just yet, namely, the water
pump used for agriculture. In spite of these increases, all users
mentioned the decision to purchase such a system was a great
one; otherwise, their expenses would reach higher values.</p>
      <p>To understand their routines and the use of electrical
appliances, users were asked to list their daily use to which they
reported the following:</p>
      <p>A set of devices is always used every day (coffee
machine, microwave, and kettle);
A set of devices is always used during the day when they
have the highest energy production (washing machine,
stovetop, oven, vacuum cleaner);
When there is not enough production they postpone the
usage of the device for the next day - for instance, doing
laundry (washing machine) or cleaning (vacuum cleaner)
when it is sunnier;
In some cases, they anticipate the realization of some
activities as early as possible to avoid using energy from
the grid at night - for example, they cook dinner earlier
than usual (they know the stovetop and oven are highly
consuming);
They charge their phones during the day, which they tried
to implement whenever possible.</p>
    </sec>
    <sec id="sec-8">
      <title>B. User motivations to become prosumers</title>
      <p>All prosumers used their own means to install the solar
PV system, meaning they used local installers, searched for
local information, contacted the local electricity company
or used online sources. They mentioned this process to be
cumbersome, as there were no clear paths on how to proceed
whether in terms of subsidies they could apply to or even
regulation they would need to follow.</p>
      <p>In terms of the reasons and motivations for purchasing
PV panel system, users reported this decision was aligned
to their willingness to keep up with the latest technologies
or the opportunity to have an innovative system at their
home. In other words, they are the early adopters of such
technologies and perceived their purchase as an opportunity
to try something new in the area of renewable energy.</p>
      <p>Regarding the environmental value users, viewed it as a
way to protect the environment but also, part of a greater
goal, as they saw it as a part of a lifestyle they want to
build around environmental protection and preservation. Not
only in the field of energy but also, food production, purchase
of organic products or even sustainable home construction.
Whenever the environmental concerns were mentioned, users
had already integrated into their lives these aspects beyond the
area of energy, and these were measures they had started to
progressively adopt into their day to day living, even before
the self-consumption systems came into the market.</p>
      <p>Other users referred to the availability of solar energy on the
island, they saw it as a valuable and ready to operate resource
that was not being used to its fullest potential. For them,
it seemed it could be even more capitalized and an obvious
choice to follow by our governments, by our local companies
and supported by all kinds of programs. It was not clear to
them why this is not supported, as it should be. As well as
why are not there more consumers investing in PV systems
for their home.</p>
      <p>A few users mentioned their motivation to have PV panels
was associated with the need to having greater information
about the electrical appliances they have at their homes, which
consequently helps preventing future problems. Either because
they ran into device malfunctioning in the past, or had an
energy surcharge that affected their electrical appliances, or a
remote way to monitor their equipment when away from home
for longer periods of time. This allowed them to keep a record
of information they can use as justification in case they have
a situation of malfunctioning, and they need to report it to the
local electricity company.</p>
      <p>The cost reduction was a least motivation mentioned, with
time users realized achieving full autonomy from the local grid
is still a long distant goal, however, they are pleased for being
able to use the energy produced by their self-consumption
units during the day.</p>
    </sec>
    <sec id="sec-9">
      <title>C. Technology Acceptance</title>
      <p>With regards to the acceptance evaluation, users scores were
higher for PrsmaEnergy to the exception of one user. To
investigate further, we proceeded to test the differences between the
two acceptance scores. Due to the data not following a normal
distribution for some variables, a Wilcoxon Signed-Ranks Test
was run and the output indicated the PrsmaEnergy acceptance
scores were statistically significantly higher than the current
system acceptance scores Z = 26:5; p &lt; :034.</p>
      <p>Users scores were higher for all the sub-dimensions for
PrsmaEnergy (see Figure 3). The highest scores were on
Perceived usefulness, which means users felt the application
made them believe it would enhance their productivity, or more
specifically help them collect the most relevant information in
a fast, easy and simple way about their energy production.</p>
      <p>The second highest scored was for User satisfaction, meaning
prosumers felt confident using the application, felt it was
working as expected and they would recommend it to a friend.</p>
      <p>Intention to use was the lowest for both the PV system and
PrsmaEnergy.</p>
      <p>In the following two subsections, we explore even further
the results regarding the PV system and the project application,
through a summarized description of users perceptions of both
systems.</p>
      <p>1) PV system: Users were asked about strategies used to
optimize their production once they installed the system, and
these included the use of devices such as washing machines,
dishwasher or dryers during the day. For that, they would either
program the machines to be used in the highest sun peak hours,
or stop using these after a certain time in the day, for example,
avoid using these after 4 PM in the winter and 6 PM in the
summer. Another strategy was to purchase timers to control
device usage, especially at night to regulate their energy usage
from the grid. The overall goal was to avoid using energy from
the grid, as a result, they specified to use as few devices at
night as possible, replaced devices that were demonstrating
high consumption for more efficient ones or even replaced
some lighting to more efficient lamps.</p>
      <p>In terms of improvements, they would like to conduct in
their installations these would be the purchase of storage
solutions to use the energy they know is not being used and
currently wasted, however, the high costs and the lack of
financial support programs prevent them from making such
investments. As well as the lack of trustworthy information of
reliable systems they can use to optimize even more the use
they make out of their systems.</p>
      <p>Regarding the use of an application with information about
their production, only 7 out of the 11 users mentioned to have
it available everyday or rather frequently. The other 4 users
did not have access to their energy production information.</p>
      <p>The users who did use it did it to plan their activities in the
homes, and their device usage based on that information. In
addition, they mentioned the information was useful to:
detect consumption peaks;
remotely control their homes when away;
and to plan their household activities.</p>
      <p>In terms of weaknesses, users mentioned:
the complexity to sometimes customize the visualizations,
to the extent they had not figured these applications quite
well;
the lack of being closer to real-time activities. In other
words, the system should be placed closer to the spaces
where devices are mostly used such as the kitchen or
easily available to other family members. In fact, the
frequent user of the application in all homes is male, the
person who decides to purchase the system, the person
who is at most ease with technology and the one most
interested in such equipment.</p>
      <p>2) PrsmaEnergy: Regarding the application provided by
the project (see Table III), users reported using it more
frequently in the first three weeks either through their mobile
phone or their personal computer. When they wanted to take
a quick glance at the data they would use their mobile phone,
while if they wanted a more detailed analysis they would use
the computer to enlarge the graphs. Once they learned how to
interpret the production information based on their household
routines and/or weather conditions they used it less frequently.</p>
      <p>In terms of reasons to interact with PrsmaEnergy, they
would use it to keep track of their energy production
information and keep track of their savings. All users mentioned this
reason several times. Some users were more specific in terms
of which moments led them to use the application, such as:
to check the influence of a new appliance;
to confirm production values according to the weather
conditions on that specific week or day (especially for
sunny days);
to assess if certain activities could be conducted using
self-consumption;
to identify energy peaks that could be avoided to optimize
even more their system;
and to assess the feasibility of adding other renewable
energy systems to his home.</p>
      <p>Users mentioned the most relevant information to be the
money being saved while using most of their energy
production, the carbon dioxide emissions and the production
information they used as a hint to start certain electrical
appliances in order to avoid using energy from the grid.</p>
      <p>In terms of routines, users felt PrsmaEnergy was a good tool
to plan laundry and to analyze consumption peaks in order
to know where and when they could further optimize their
efforts, whether by moving one activity to another time of the
day or stop using one appliance in case there were too many
being used. One user mentioned the information was helpful to
make the family aware, however, they felt they were not taking
it to the next level and making these into actual strategies to
change their practices at home. Users continued to do the most
consuming activities during the times when there was more
energy being generated by the PV system.</p>
      <p>In terms of suggestions one user who has batteries installed
in his home, would like to have had its information added to
PrsmaEnergy, similarly to the PV system application that was
included with it.</p>
      <p>Users found the application user-friendly and accessible in
some cases even more than the PV current system. In terms
of family members using the application, the majority of users
Themes
Production Information
Triggers to use it
Most relevant information
Ease of use
User quotes examples
Now I really want to buy the (wind) turbine to see through the application how much energy can I
produce when there are windy days and perhaps take advantage of night periods to collect it (User C)
I look at the production and the consumption to make sure everything is working (User D)
I was not aware of the best time to start the washing machine in the morning and now I avoid starting
it too early such as 9 am because there is not much sun yet, it is better to start it after 10 or 11 am, it’s
the time to start using more appliances (User E)
I use it mostly when it is sunny, and I’ll check several times on those days, when it’s rainy weather I
don’t even bother to look at it because I know it is not producing as much energy (User F)
The most relevant for me is seeing the bill being reduced, the more savings the better (User K)
I find it very interesting that you have added how much carbon dioxide am I responsible for, I find it
very interesting and it was a very great choice from your side to include it in the feedback (User I)
Your application is much better, more reliable more complete than the one I used to use that came with
the system (User C)
I think it is very good, it gives the necessary information for regular people who are not experts, if it
had much more information I might not know how to interpret it or what it meant. It is simple and user
friendly (User D)</p>
      <p>
        The information I need is here, it is easy to see and very intuitive for me (User J)
mentioned being just themselves checking the application and
was installed. In fact, the application enabled them to infer
using the information in their daily lives. In spite of their
even more information, such as adding or upgrading their
efforts to captivate their attention to look at the information,
current PV system with other energy generation technologies.
or told they should avoid using an appliance due to low energy
This follows the recommendations by [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], where consumer
production, other family members would not use it.
acceptance can be increased if governments and local
municipalities support the growth of complementary technologies
(Electrical Vehicles and storage technologies).
      </p>
      <p>
        V. DISCUSSION
Participants in this study being prosumers revealed high
Users continued to use PrsmaEnergy to plan activities and
scores in terms of environmental concern and had their energy
detect consumption peaks. The activities more prone to be
use transformed by the decision of installing a PV system.
shifted were also cleaning and laundry, such as [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ], but also,
Similarly to [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], they also changed their consumption
activiwith some prosumers the activity of cooking was considered
ties to take advantage of the hours with most energy
producdue to their flexible working schedules. However, in both
tion, with the current PV system and even after PrsmaEnergy
systems, the most frequent users were the person responsible
for purchasing the PV panel, for agreeing to be part of the
study, and the one that would already use the information.
      </p>
      <p>
        The fact that other family members were not mentioned, in
the majority of the cases, it means PrsmaEnergy could be
further improved to engage other users within the homes,
since practices tend to be influenced by the social dynamics
of families, which has been seen in the area of eco-feedback
[
        <xref ref-type="bibr" rid="ref25">25</xref>
        ] but also, energy production [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
      </p>
      <p>
        In what concerns motivations to become prosumers, our
users contrary to what authors have found so far [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ],
hardly mentioned financial concerns or earnings. At least, this
did not emerge until PrsmaEnergy displayed such information,
but only for two users out of the 11. The remaining users
focused mostly in using the latest technology, helping the
environment and that it could be even further used, but local
authorities or organizations do not offer proper incentives for
more people to join the green energy movement. Although
users did not verbalize the financial concerns being a major
motivation, we believe that beyond the green values and
environment protection, prosumers revealed a need to have
greater control over their electricity in their own home. Since
they used both PV system and PrsmaEnergy information to
keep track of electrical appliance problems, but also problems
resulting from the grid supply, and to further learn about their
consumption and production practices.
      </p>
      <p>Taking in consideration the fact that prosumers in this study
invested their own resources to pursue their motivations of
having an energy generation system, it seems that incentives
for this group of people and others in similar cases should go
beyond economical grounds. One way could be through the
creation of subsidies to help users upgrade their installations,
but also, include the access to information campaigns, or the
creation of community-based activities that allow users to
share information and experiences since the installations had
specific technical needs that could be overcome through shared
knowledge.</p>
      <p>In terms of technology acceptance, users felt PrsmaEnergy
was easier to interpret, more complete, hence the highest
scores for the application. Consequently, users were more
satisfied with it as reinforced by their testimonies in the
interviews. The high scores can also be explained by the
fact that all prosumers decision and investment for the PV
system was their personal initiative using their own financial
resources, supported by the desire to have an innovative system
and have the opportunity to experience it first hand. One user
scored the PV system higher than PrsmaEnergy in terms of
acceptance, due to the fact that his own application included
in the equipment, provided the information about his storage
equipment. This user has the most complete PV system in
the sample, and our application will only include this type of
information at a later stage in the project. As a result, his scores
are understandable, since the user expects an application to be
even more innovative compared to the one he already interacts
with on a daily basis. Nevertheless, this user was impressed by
the addition of the emissions information, which he believes
is important to bring more people into the environmental
protection mindset.</p>
      <p>In terms of features used, users referred mostly to the most
recent information, and hardly to historical information, which
can be explained by the fact that users would use the presence
of sun as a trigger to use the application. The fact that this
study occurred in the Winter, they felt less motivated to use the
application and conduct comparisons between dates, meaning
they would only interact with it while there were sunnier
days and less interested in exploring different production days.</p>
      <p>Users enjoyed the application because it expanded on the
lifestyle they are trying to pursue, by having information on
the emissions they felt it came to strengthen their motivations
to use as much renewable energy as possible. Overall,
participants revealed high scores in terms of technology acceptance
for both the PV system they installed and PrsmaEnergy that
came to increase their satisfaction with the user experience
and information provided.</p>
      <sec id="sec-9-1">
        <title>VI. RECOMMENDATIONS</title>
        <p>Prosumers are a group of people with a considerable level
of knowledge and are willing to invest their own resources in
order to optimize the equipment they have already installed
in their homes. The number of prosumers is likely to increase
as the technologies become more accessible. Prosumers have
motivations that start by being financial, but just partially as
the regulation in each country will support it or not. But this
does not stop them from conducting an upgrade to the system
or even considering other energy efficiency solutions.</p>
        <p>It is becoming more common to find regular consumers
interested in green values and environmental protection, and
not just because of their local municipality awards it. On the
contrary, this study showcased a group of prosumers that are
pursuing their goal to become more innovative and become
more self-sufficient in spite of having no subsidies or local
programs to help them improve the current installations. This
project came to help them, what they hope to assess the
feasibility of potential storage solutions or even just the installation
in itself. What we observed was that prosumers are more than
willing to invest in energy generation technologies if it means
having greater control of their costs, their information, their
consumption patterns and practices, as long as these work and
are user-friendly.</p>
        <p>How can ICT help these citizens reach a more sustainable
future? We believe ICT cannot work alone if local
organizations are not involved, and for that matter, ICT can help group
and gather the data and information in a more meaningful way
in order for municipalities to create tangible measures
consumers can easily put into practice. The following measures
could be a start to this kind of work:
create community digital platforms that consumers can
access to have clear and neutral information about energy
generation systems and regulation;
disseminate local experiences with these technologies;
facilitate participatory discussions between governments,
companies, and consumers about contextual conditions
that could be implemented to optimize the local
resources, and motivate integrated collaborations between
all stakeholders for a greener mindset.</p>
      </sec>
      <sec id="sec-9-2">
        <title>VII. LIMITATIONS</title>
        <p>One limitation of this research is the fact this is a small
sample of participants that live in a specific context where they
are not allowed to inject the excess produced energy into the
grid. This alone makes them prone to become motivated to use
most of their energy production through a number of strategies.
Having an application that helps them to do so, explains their
high scores in terms of acceptance and satisfaction. Having
conducted the study in a location where prosumers could make
direct earnings from their production, we are left to wonder if
the efforts would remain the same. Another limitation regards
the fact that a large part of the savings before and after the
system, were self/reported, even though participants did keep
an accurate track of their expenses, the study would have
benefited if expenses analysis prior to our study had been
analyzed, either through the utility company records or the
participants.</p>
      </sec>
      <sec id="sec-9-3">
        <title>VIII. FUTURE WORK</title>
        <p>This study is integrated into a larger scale project that aims
to maximize self-consumption installations into the current
grid. The next stage consists on splitting our sample of
prosumers into two, one where prosumers will have a battery
installed in their homes, and a second one, where prosumers
will have more detailed feedback based on their production
characteristics. The goal will be to compare the
optimization strategies used within the two samples. The technology
acceptance will be evaluated again, with the introduction of
batteries and its usage in PrsmaEnergy, with an added level of
feedback. This will be essential to understanding acceptance
and satisfaction for this type of systems, and which factors may
affect its user experience or satisfaction, and market entrance.</p>
      </sec>
      <sec id="sec-9-4">
        <title>IX. CONCLUSIONS</title>
        <p>In this paper, we have presented the technology acceptance
of energy monitoring technologies, namely solar PV systems
and an application providing detailed feedback on energy
consumption and production designated as PrsmaEnergy. The
groups of prosumers that participated in this study are a group
of people that are deeply motivated to change their practices to
optimize even more the technology they have installed,
however further support to expand such systems would be needed.
The interviews with the participants unraveled their challenges
rely mostly on getting other family members to get involved
and obtaining governmental support, their expectations are
to improve even further their systems with other generation
technologies, but also storage. PrsmaEnergy expanded their
knowledge and likewise allowed them to identify more
strategies to optimize even further their systems.</p>
      </sec>
      <sec id="sec-9-5">
        <title>X. ACKNOWLEDGMENTS</title>
        <p>This work was funded by the European Union Horizon 2020
research and innovation programme under grant agreement
number 731249, by the Fundac¸a˜o para a Cieˆncia e Tecnologia
under the grant agreement number UID/EEA/50009/2019 and
by ARDITI - Ageˆncia Regional para o Desenvolvimento
da Investigac¸a˜o Tecnologia e Inovac¸a˜o through the support
provided under the grant agreement number
M1420-09-5369</p>
      </sec>
      <sec id="sec-9-6">
        <title>FSE-000001- Bolsa de Po´ s- Doutoramento.</title>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>L.</given-names>
            <surname>Pe</surname>
          </string-name>
          <article-title>´rez-</article-title>
          <string-name>
            <surname>Lombard</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Ortiz</surname>
            , and
            <given-names>C.</given-names>
          </string-name>
          <string-name>
            <surname>Pout</surname>
          </string-name>
          , “
          <article-title>A review on buildings energy consumption information,” Energy and buildings</article-title>
          , vol.
          <volume>40</volume>
          , no.
          <issue>3</issue>
          , pp.
          <fpage>394</fpage>
          -
          <lpage>398</lpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>The</given-names>
            <surname>European</surname>
          </string-name>
          <string-name>
            <surname>Commission</surname>
          </string-name>
          ,
          <article-title>Study on Residential Prosumers in the European Energy Union</article-title>
          .
          <source>The European Commission</source>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Parag</surname>
          </string-name>
          , “
          <article-title>Beyond energy efficiency: A 'prosumer market'as an integrated platform for consumer engagement with the energy system</article-title>
          ,
          <source>” eceee 2015 Summer Study on energy efficiency</source>
          , pp.
          <fpage>15</fpage>
          -
          <lpage>23</lpage>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>S.</given-names>
            <surname>Ga</surname>
          </string-name>
          <article-title>¨hrs, K</article-title>
          . Mehler,
          <string-name>
            <given-names>M.</given-names>
            <surname>Bost</surname>
          </string-name>
          , and
          <string-name>
            <given-names>B.</given-names>
            <surname>Hirschl</surname>
          </string-name>
          , “
          <article-title>Acceptance of ancillary services and willingness to invest in pv-storage-systems,” Energy Procedia</article-title>
          , vol.
          <volume>73</volume>
          , pp.
          <fpage>29</fpage>
          -
          <lpage>36</lpage>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>J.</given-names>
            <surname>Froehlich</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Findlater</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Landay</surname>
          </string-name>
          , “
          <article-title>The design of eco-feedback technology,” in Proceedings of the SIGCHI conference on human factors in computing systems</article-title>
          . ACM,
          <year>2010</year>
          , pp.
          <fpage>1999</fpage>
          -
          <lpage>2008</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>G.</given-names>
            <surname>Fitzpatrick</surname>
          </string-name>
          and
          <string-name>
            <given-names>G.</given-names>
            <surname>Smith</surname>
          </string-name>
          , “
          <article-title>Technology-enabled feedback on domestic energy consumption: Articulating a set of design concerns</article-title>
          ,
          <source>” IEEE Pervasive Computing, no. 1</source>
          , pp.
          <fpage>37</fpage>
          -
          <lpage>44</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>L.</given-names>
            <surname>Pereira</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Quintal</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Barreto</surname>
          </string-name>
          , and
          <string-name>
            <given-names>N. J.</given-names>
            <surname>Nunes</surname>
          </string-name>
          , “
          <article-title>Understanding the limitations of eco-feedback: a one-year long-term study,” in humancomputer interaction and knowledge discovery in complex, unstructured, big data</article-title>
          . Springer,
          <year>2013</year>
          , pp.
          <fpage>237</fpage>
          -
          <lpage>255</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>J.</given-names>
            <surname>Kjeldskov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. B.</given-names>
            <surname>Skov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Paay</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Pathmanathan</surname>
          </string-name>
          , “
          <article-title>Using mobile phones to support sustainability: a field study of residential electricity consumption</article-title>
          ,”
          <source>in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM</source>
          ,
          <year>2012</year>
          , pp.
          <fpage>2347</fpage>
          -
          <lpage>2356</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>E.</given-names>
            <surname>Heiskanen</surname>
          </string-name>
          and
          <string-name>
            <given-names>K.</given-names>
            <surname>Matschoss</surname>
          </string-name>
          , “
          <article-title>Understanding the uneven diffusion of building-scale renewable energy systems: A review of household, local and country level factors in diverse european countries,” Renewable and Sustainable Energy Reviews</article-title>
          , vol.
          <volume>75</volume>
          , pp.
          <fpage>580</fpage>
          -
          <lpage>591</lpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <article-title>The European Commission, Consumer surbey 1 - Attitudes, opnion, drives and barriers and satisfaction with regard to Renewable Energy Systems</article-title>
          .
          <source>The European Commission</source>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>P.</given-names>
            <surname>Balcombe</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Rigby</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Azapagic</surname>
          </string-name>
          , “
          <article-title>Motivations and barriers associated with adopting microgeneration energy technologies in the uk,” Renewable and Sustainable Energy Reviews</article-title>
          , vol.
          <volume>22</volume>
          , pp.
          <fpage>655</fpage>
          -
          <lpage>666</lpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>M.</given-names>
            <surname>Hansen</surname>
          </string-name>
          and
          <string-name>
            <given-names>B.</given-names>
            <surname>Hauge</surname>
          </string-name>
          , “
          <article-title>Prosumers and smart grid technologies in denmark: developing user competences in smart grid households,” Energy Efficiency</article-title>
          , vol.
          <volume>10</volume>
          , no.
          <issue>5</issue>
          , pp.
          <fpage>1215</fpage>
          -
          <lpage>1234</lpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>J.</given-names>
            <surname>Bourgeois</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. Van Der</given-names>
            <surname>Linden</surname>
          </string-name>
          , G. Kortuem,
          <string-name>
            <given-names>B. A.</given-names>
            <surname>Price</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Rimmer</surname>
          </string-name>
          , “
          <article-title>Conversations with my washing machine: an in-the-wild study of demand shifting with self-generated energy</article-title>
          ,”
          <source>in Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM</source>
          ,
          <year>2014</year>
          , pp.
          <fpage>459</fpage>
          -
          <lpage>470</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>J.</given-names>
            <surname>Pierce</surname>
          </string-name>
          and E. Paulos, “
          <article-title>Beyond energy monitors: interaction, energy, and emerging energy systems</article-title>
          ,”
          <source>in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM</source>
          ,
          <year>2012</year>
          , pp.
          <fpage>665</fpage>
          -
          <lpage>674</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>E.</given-names>
            <surname>Costanza</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. E.</given-names>
            <surname>Fischer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Colley</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Rodden</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. D.</given-names>
            <surname>Ramchurn</surname>
          </string-name>
          , and
          <string-name>
            <given-names>N. R.</given-names>
            <surname>Jennings</surname>
          </string-name>
          , “
          <article-title>Doing the laundry with agents: a field trial of a future smart energy system in the home</article-title>
          ,”
          <source>in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM</source>
          ,
          <year>2014</year>
          , pp.
          <fpage>813</fpage>
          -
          <lpage>822</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>J.</given-names>
            <surname>Pierce</surname>
          </string-name>
          and E. Paulos, “
          <article-title>The local energy indicator: designing for wind and solar energy systems in the home</article-title>
          ,”
          <source>in Proceedings of the Designing Interactive Systems Conference. ACM</source>
          ,
          <year>2012</year>
          , pp.
          <fpage>631</fpage>
          -
          <lpage>634</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>R.</given-names>
            <surname>Smale</surname>
          </string-name>
          ,
          <string-name>
            <surname>B. van Vliet</surname>
          </string-name>
          , and G. Spaargaren, “
          <article-title>When social practices meet smart grids: Flexibility, grid management, and domestic consumption in the netherlands</article-title>
          ,
          <source>” Energy Research &amp; Social Science</source>
          , vol.
          <volume>34</volume>
          , pp.
          <fpage>132</fpage>
          -
          <lpage>140</lpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>M. P.</given-names>
            <surname>Gagnon</surname>
          </string-name>
          , E. Orru n˜o,
          <string-name>
            <given-names>J.</given-names>
            <surname>Asua</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. B.</given-names>
            <surname>Abdeljelil</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Emparanza</surname>
          </string-name>
          , “
          <article-title>Using a modified technology acceptance model to evaluate healthcare professionals' adoption of a new telemonitoring system,” Telemedicine and e-Health, vol</article-title>
          .
          <volume>18</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>54</fpage>
          -
          <lpage>59</lpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>V.</given-names>
            <surname>Venkatesh</surname>
          </string-name>
          and
          <string-name>
            <given-names>F. D.</given-names>
            <surname>Davis</surname>
          </string-name>
          , “
          <article-title>A theoretical extension of the technology acceptance model: Four longitudinal field studies,” Management science</article-title>
          , vol.
          <volume>46</volume>
          , no.
          <issue>2</issue>
          , pp.
          <fpage>186</fpage>
          -
          <lpage>204</lpage>
          ,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>H. M.</given-names>
            <surname>Abu-Dalbouh</surname>
          </string-name>
          ,
          <article-title>“A questionnaire approach based on the technology acceptance model for mobile tracking on patient progress applications</article-title>
          ,
          <source>” Journal of Computer Science</source>
          , vol.
          <volume>9</volume>
          , no.
          <issue>6</issue>
          , pp.
          <fpage>763</fpage>
          -
          <lpage>770</lpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>A.</given-names>
            <surname>Strauss</surname>
          </string-name>
          and
          <string-name>
            <given-names>J.</given-names>
            <surname>Corbin</surname>
          </string-name>
          , “
          <article-title>Grounded theory methodology,” Handbook of qualitative research</article-title>
          , vol.
          <volume>17</volume>
          , pp.
          <fpage>273</fpage>
          -
          <lpage>85</lpage>
          ,
          <year>1994</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>J.</given-names>
            <surname>Corbin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Strauss</surname>
          </string-name>
          et al.,
          <article-title>Basics of qualitative research: Techniques and procedures for developing grounded theory</article-title>
          . Thousand Oaks, CA: Sage,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>R. E.</given-names>
            <surname>Dunlap</surname>
          </string-name>
          ,
          <string-name>
            <surname>K. D. Van Liere</surname>
            ,
            <given-names>A. G.</given-names>
          </string-name>
          <string-name>
            <surname>Mertig</surname>
            , and
            <given-names>R. E.</given-names>
          </string-name>
          <string-name>
            <surname>Jones</surname>
          </string-name>
          , “
          <article-title>New trends in measuring environmental attitudes: measuring endorsement of the new ecological paradigm: a revised nep scale</article-title>
          ,
          <source>” Journal of social issues</source>
          , vol.
          <volume>56</volume>
          , no.
          <issue>3</issue>
          , pp.
          <fpage>425</fpage>
          -
          <lpage>442</lpage>
          ,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>C.</given-names>
            <surname>Fischer</surname>
          </string-name>
          , “
          <article-title>Feedback on household electricity consumption: a tool for saving energy?” Energy efficiency</article-title>
          , vol.
          <volume>1</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>79</fpage>
          -
          <lpage>104</lpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <surname>M. L. Barreto</surname>
            ,
            <given-names>A</given-names>
          </string-name>
          . Szo´ stek, E. Karapanos,
          <string-name>
            <given-names>N. J.</given-names>
            <surname>Nunes</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Pereira</surname>
          </string-name>
          , and
          <string-name>
            <given-names>F.</given-names>
            <surname>Quintal</surname>
          </string-name>
          , “
          <article-title>Understanding families' motivations for sustainable behaviors,” Computers in Human Behavior</article-title>
          , vol.
          <volume>40</volume>
          , pp.
          <fpage>6</fpage>
          -
          <lpage>15</lpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>