<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Energy Eficiency Benchmarking for Smart Homes⋆</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Institute Mihajlo Pupin, University of Belgrade</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>Numerous strategies were developed over the years in order to encourage users to reduce energy consumption and bolster energy efifciency. However, with increasing levels of eficiency achieved by most household appliances, one of the most impactful approaches that remains as a means to further increase energy eficiency is attempting to encourage users to behave in an energy eficient manner. More precisely, positive behavior change can be motivated through the creation of unique social pressure and competition. Namely, the idea of the methodology presented in this paper is providing a fair, normalized, comparable ranking (benchmark) between diferent energy consumptions of diferent users. Therefore, the ranking is supposed to motivate them to either retain a leading position in the ranking or to attempt to improve their behavior and advance within the ranking.</p>
      </abstract>
      <kwd-group>
        <kwd>Energy eficiency</kwd>
        <kwd>User benchmarking</kwd>
        <kwd>Smart homes</kwd>
        <kwd>Data envelopment analysis</kwd>
        <kwd>Machine learning</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        The energy-use performance benchmarking and user behavior assessment
methodologies appear to be a relatively unexplored topic in the relevant literature of this
domain, especially when compared with other energy related topics like demand
side management or demand response optimizations. Review papers [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] and [13]
predominantly analyze non-residential building benchmarking solutions, while
a recent survey [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] focuses on demand forecasting in the residential sector and
states that ”Residential energy performance prediction has historically received
less attention, as compared to commercial buildings.” and that there is a ”need
for the availability of more residential building data sources to be able to assess
and improve models, and further testing is needed including those models that
have not yet been significantly used for residential buildings” .
      </p>
      <p>
        With regards to specific methodologies, [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] separates the applied
methodologies into: Simple normalization, Ordinary least squares (OLS) and its
modifications, Stochastic frontier analysis (SFA), Data envelopment analysis (DEA),
simulations (model-based) and Artificial neural networks (ANN). As was
previously mentioned, most of the included use cases are exclusively related to the
non-residential domain. Schools are chosen as the main building type of interest
by [12] and [14] that apply OLS while [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] and [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] use a model-based approach to
eficiency estimation. A school is also used for benchmarking in [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] with
descriptive statistics and ANNs. Others focus on ofice buildings with [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] performing
benchmarking through simple normalization, [16], [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] and [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] through OLS, [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]
and [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] using DEA and finally [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] and [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] employing simulations.
      </p>
      <p>Given findings in the aforementioned analysis regarding relevant papers that
are dedicated to the subject of energy-use eficiency benchmarking, it can be
deduced that the current state-of-the-art solutions appear to be ill-equipped to
deal with an IoT future in which individual homes will be outfitted with a vast
number of sensors. Therefore, this paper aims to introduce a flexible
methodology that can be utilized for smart homes and that incorporates various factors
pertaining to the energy consumption of the analyzed households. Furthermore,
the same methodology could even be extended towards commercial objects that
are suficiently covered with smart sensors.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Methodology</title>
      <p>With the main goal of the presented methodology being the holistic and
comprehensive assessment of user behavior through multiple energy usage indicators,
the user benchmarking methodology is based on four diferent elements denoted
ri where each one of them depicts a diferent aspect of energy eficiency
(normalized comparison with others, normalized comparison to oneself, alignment
with intermittent renewable generation and engagement), as will be described in
greater detail in the following sections. With respect to the weights wi of each
of these criteria, the final unscaled score (rating) can be obtained as a linear
combination of these factors</p>
      <p>Runscaled =</p>
      <p>4
X wkrk = w1r1 + w2r2 + w3r3 + w4r4.</p>
      <p>k=1
However, these raw results are further processed before being presented to end
users. Namely, linear scaling is applied to convert the obtained interval of values
into the range of [40, 95]%, as specified in accordance with expert inputs, so
that less eficient users are not demotivated and so that the most eficient users
get the impression that there is still room for improvement.
2.1</p>
      <sec id="sec-2-1">
        <title>Data envelopment analysis</title>
        <p>According to [15], DEA represents a quantitative, nonparametric technique which
is used in operational research and most commonly economics to establish a best
practice group of decision making units (DMUs) (the so-called eficiency
frontier) and to determine which units are less eficient when compared to the best
practice groups and at what the magnitude of ineficiencies are.</p>
        <p>In consistence with the related literature, let the following symbols be
– j the order number of DMU,
– i the order number of input used by DMUs,
– r the order number of output used by DMUs,
– θ the eficiency/ineficiency rating,
– yrj the amount of output r by DMU j,
– xij the amount of input i by DMU j,
– ur the weight coeficient assigned to r-th output,
– vr the weight coeficient assigned to i-th input.</p>
        <p>Now, the DEA problem is posed as determining the maximum objective function
as defined by
θ j = max
u1y1j + u2y2j + · · · + usyrj
v1x1j + v2x2j + · · · + vmymj
= max</p>
        <p>Ps</p>
        <p>r=1 uryrj
Pim=1 vixij
where s is the total number of outputs and m is the total number of inputs. The
maximization is obtained under a set of constraints
(∀j)
u1y1j + u2y2j + · · · + usyrj
v1x1j + v2x2j + · · · + vmymj
=</p>
        <p>Ps</p>
        <p>r=1 uryrj
Pim=1 vixij
≤ 1
and</p>
        <p>u1, u2, . . . , us &gt; 0 and v1, v2, . . . , vm ≥ 0.</p>
        <p>However, DEA is most often implemented using linear programming, which
cannot be performed with the given set of constraints and the objective
function because the division between the numerator and denominator presents a
non-linear operation. This issue is circumvented by modifying the given set of
formulas through an additional constraint that specifies that all denominators
must be equal to one. In this modified form, DEA is formulated as maximizing
the objective function specified by
subject to
θ j = max
( s</p>
        <p>X uryrj
r=1</p>
        <p>)
(∀j)</p>
        <p>s
X uryrj −
r=1
m
X vixij ≤ 0
i=1
∧
m
X vixij = 1
i=1
!
while the constraints</p>
        <p>u1, u2, . . . , us &gt; 0 and v1, v2, . . . , vm ≥ 0
still apply.</p>
        <p>In general, DEA is capable of considering a wide variety of diferent input
parameters. For energy eficiency applications specifically, these parameters can
be grouped in two diferent categories
– Static parameters:
• heated area,
• heated volume,
• outward wall (and window) area,
• wall thickness,
• wall material (conductivity),
• number of reported tenants;
– Dynamic parameters:
• total energy consumed,
• avg. occupancy for the household/building,
• cooling/heating degree days,
• dif. between indoor and outdoor temperature.</p>
        <p>However, having in mind that for the specific use cases that will be demonstrated
in the following text, buildings from the same neighborhood were considered,
with all of them sharing the same construction properties and microclimate, the
number of considered parameters is limited to
– total energy consumed,
– average total occupancy,
– average absolute diference between indoor and outdoor temperature,
– total heated area,
as including others would add no additional information.</p>
        <p>A resulting arrangement of users in this space with the total energy consumed
as the primary output is illustrated in Figure 1 where those users on the
ineficiency frontier are assigned the rating of 0 and others are given a rating r1 = θ i
corresponding to their position between the origin and frontier, as dictated by
the DEA approach.
2.2</p>
      </sec>
      <sec id="sec-2-2">
        <title>ML-based consumption prediction</title>
        <p>The main idea of this novel approach was to exploit machine learning through
models like random forests, k nearest neighbors, support vector machines, linear
regression and neural networks as the estimator of the user’s expected energy
usage in accordance with his previous behavior making the most of machine
learning’s (ML) extraordinary estimation potential. It is intended to be used
in a way which would result in rewarding on penalizing the users depending on
their change in behavior. In other words, given a similar set of inputs as the DEA
approach uses, it is supposed to approximate what amount of energy a user is
expected to consume. Therefore, the estimated value Eˆ can then be compared
with measured (real) one Emeas, and reward or penalize the user proportional
to the diference that would be assigned to that user, as illustrated in Figure 2.
This concept could be considered as an example of the diferential part in control
theory, as it measures the diference from the previous behavior and proposes
the ”control” accordingly i.e., behavioral stimulus which is in form of positive
or negative rating in this particular case. The output of the discussed ML-based
part of the benchmarking methodology can therefore be defined as
r2 = tansig ln
ˆ</p>
        <p>E
Emeas
!!
=</p>
        <p>2
1 + e− ln(Eˆ/Emeas) − 1.</p>
        <p>Namely the idea of using the logarithm function was to obtain negative result
when the real measured consumption is greater than the one based on previous
behavior, as a negative penalty for ineficient behavior is supposed to be assigned,
and vice versa. Additionally, the tansig function has been chosen as it is an
odd limited function, so for the same positive and negative behavior the same
absolute penalty would be assigned and the output would be within the required
limits.
Having in mind the increasing penetration of RES installations with individual
users, one of the key goals to their eficient usage is maximizing self-consumption,
i.e., ensuring that as much of locally produced energy is also consumed locally.
Achieving this objective entails that the demand profile should be well aligned
with the generation profile meaning that peaks in the demand should follow the
peaks for production and vice versa for valleys. However, the stif character of
users’ daily habits can notably hinder this process as customs are not so easy
to adapt to, for example, the production profile of PV modules which generally
displays peak performance during the mid-day period when the sun is shining
the brightest.</p>
        <p>Therefore, in order to numerically quantify how well-aligned the consumption
profile X is to the renewable generation profile Y , their correlation coeficient σ
is calculated as
r3 = σ {X, Y } =</p>
        <p>Cov(X, Y )
pCov(X, X) · Cov(Y, Y )
and used as the third benchmarking contribution r3.
2.4</p>
      </sec>
      <sec id="sec-2-3">
        <title>Responsiveness</title>
        <p>The final part of the proposed energy eficiency performance evaluation
methodology considers user’s responsiveness to notifications and suggestions delivered
through a companion mobile application for their smart device management in
form of a reward for users that show motivation for behavioral improvements.
Namely, this part of the system is supposed to additionally encourage users
willing to adapt their demands in order to save energy. For example, if the
household/building owner promptly reacts to suggestions about energy conservation,
such behavior should be rewarded. Additionally, this factor is not meant for any
penalization if the suggestions are not considered because some of the events
that are being checked may not imply that energy is being wasted.</p>
        <p>The score rewarded in this category is obtained simply by ranking the users
by three equally weighted and combined factors that are considered to contribute
to the overall responsiveness: the percentage of the energy conservation
noticfiations that they have responded to in due time (less than 30 minutes), the total
number of controls actions sent using the app (turning appliances on or of) and
total number of sessions (discreet log-ins separated by more than 30 minutes).</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Conclusion</title>
      <p>In summary, this paper provides an outline of a benchmarking methodology
for smart homes of the future with a specific goal of further increasing energy
eficiency. It takes into account a multitude of diferent factors relating to the
collective energy consumption of a community as well as changes in individual
behavior. It also considers other factors such as integration with renewable
generation and interaction with installed smart devices through a provided platform.
Planned future eforts include the evaluation of the methodology on a real set
of users and illustrating the link between changes in the ranking and in energy
consumption.
https://doi.org/10.1016/j.enbuild.2007.07.001, https://www.sciencedirect.
com/science/article/pii/S0378778807001971
12. Monts, J.K., Blissett, M.: Assessing energy eficiency and energy conservation
potential among commercial buildings: A statistical approach 7(10), 861–869,
https://ideas.repec.org/a/eee/energy/v7y1982i10p861-869.html, publisher:
Elsevier
13. Nikolaou, T., Kolokotsa, D., Stavrakakis, G.: Review on methodologies
for energy benchmarking, rating and classification of buildings 5(1), 53–
70. https://doi.org/10.1080/17512549.2011.582340, https://doi.org/10.1080/
17512549.2011.582340
14. Sharp, R.: Benchmarking energy use in schools,
/paper/Benchmarking-Energy-Use-in-Schools-Terv-Sharp/
a25163f540515d0dc4f7e03c889feff49020d3e3
15. Sherman, H.D., Zhu, J.: Service Productivity Management: Improving
Service Performance using Data Envelopment Analysis (DEA). Springer US.
https://doi.org/10.1007/0-387-33231-6, https://www.springer.com/gp/book/
9780387332116
16. Terry Sharp: Energy benchmarking in commercial ofice buildings. In: Proceedings
of the ACEEE. vol. 7996, pp. 321–29</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Birtles</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grigg</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Energy eficiency of buildings: Simple appraisal method 18(2</article-title>
          ),
          <fpage>109</fpage>
          -
          <lpage>114</lpage>
          . https://doi.org/10.1177/014362449701800207, https://doi.org/ 10.1177/014362449701800207, publisher: SAGE Publications Ltd STM
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Chow</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ganji</surname>
            ,
            <given-names>A.R.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>D</given-names>
            , P.,
            <surname>Hackett</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Parkin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            ,
            <surname>Fetters</surname>
          </string-name>
          ,
          <string-name>
            <surname>A.</surname>
          </string-name>
          :
          <article-title>Energy Assessment of Selected Schools in Anchorage School District</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Chung</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          :
          <article-title>Review of building energy-use performance benchmarking methodologies 88(5</article-title>
          ),
          <fpage>1470</fpage>
          -
          <lpage>1479</lpage>
          . https://doi.org/10.1016/j.apenergy.
          <year>2010</year>
          .
          <volume>11</volume>
          .022, https: //www.sciencedirect.com/science/article/pii/S030626191000485X
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Chung</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hui</surname>
            ,
            <given-names>Y.V.</given-names>
          </string-name>
          :
          <article-title>A study of energy eficiency of private ofice buildings in hong kong 41(6</article-title>
          ),
          <fpage>696</fpage>
          -
          <lpage>701</lpage>
          . https://doi.org/10.1016/j.enbuild.
          <year>2009</year>
          .
          <volume>02</volume>
          .001, https: //www.sciencedirect.com/science/article/pii/S0378778809000243
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Do</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cetin</surname>
            ,
            <given-names>K.S.:</given-names>
          </string-name>
          <article-title>Residential building energy consumption: a review of energy data availability, characteristics, and energy performance prediction methods 5(1</article-title>
          ),
          <fpage>76</fpage>
          -
          <lpage>85</lpage>
          . https://doi.org/10.1007/s40518-018-0099-3, https://doi.org/ 10.1007/s40518-018-0099-3
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Hernandez</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Burke</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lewis</surname>
            ,
            <given-names>J.O.</given-names>
          </string-name>
          :
          <article-title>Development of energy performance benchmarks and building energy ratings for non-domestic buildings: An example for irish primary schools 40(3</article-title>
          ),
          <fpage>249</fpage>
          -
          <lpage>254</lpage>
          . https://doi.org/10.1016/j.enbuild.
          <year>2007</year>
          .
          <volume>02</volume>
          .020, https://www.sciencedirect.com/science/article/pii/S037877880700076X
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Hong</surname>
            ,
            <given-names>S.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Paterson</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Burman</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Steadman</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mumovic</surname>
            ,
            <given-names>D.:</given-names>
          </string-name>
          <article-title>A comparative study of benchmarking approaches for non-domestic buildings: Part 1 - top-down approach 2(2</article-title>
          ),
          <fpage>119</fpage>
          -
          <lpage>130</lpage>
          . https://doi.org/10.1016/j.ijsbe.
          <year>2014</year>
          .
          <volume>04</volume>
          .001, https://www.sciencedirect.com/science/article/pii/S2212609014000156
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Kinney</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Piette</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Development of a california commercial building benchmarking database 7</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Lee</surname>
            ,
            <given-names>S.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rajagopalan</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Building energy eficiency labeling programme in singapore 36(10</article-title>
          ),
          <fpage>3982</fpage>
          -
          <lpage>3992</lpage>
          . https://doi.org/10.1016/j.enpol.
          <year>2008</year>
          .
          <volume>07</volume>
          .014, https: //www.sciencedirect.com/science/article/pii/S0301421508003534
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Lee</surname>
            ,
            <given-names>W.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Burnett</surname>
          </string-name>
          , J.:
          <article-title>Benchmarking energy use assessment of HK-BEAM, BREEAM</article-title>
          and LEED
          <volume>43</volume>
          (
          <issue>11</issue>
          ),
          <fpage>1882</fpage>
          -
          <lpage>1891</lpage>
          . https://doi.org/10.1016/j.buildenv.
          <year>2007</year>
          .
          <volume>11</volume>
          .007, https://www.sciencedirect. com/science/article/pii/S0360132307002314
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Lee</surname>
            ,
            <given-names>W.S.:</given-names>
          </string-name>
          <article-title>Benchmarking the energy ecfiiency of government buildings with data envelopment analysis 40(5</article-title>
          ),
          <fpage>891</fpage>
          -
          <lpage>895</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>