<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Product Liability Directive and Software Updates of Automated Vehicles</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Michael Chatzipanagiotis</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Law University of Cyprus Nicosia</institution>
          ,
          <country country="CY">Cyprus</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Product Liability Directive, EU law</institution>
          ,
          <addr-line>Automated vehicles, Liability, Product Liability</addr-line>
        </aff>
      </contrib-group>
      <abstract>
        <p>The EU Product Liability Directive (Directive 85/374/EEC - PLD) provides for strict liability of producers for defective products. This paper examines its applicability de lege lata and de lege ferenda to software updates of automated vehicles. It is concluded that to regard software updates as 'products' under the PLD entails many legal and practical challenges. These relate to the notion of 'product', the time that the update is put into circulation, the notion of 'defect', the burden of proof especially as to causation, and the calculation of time bars. Applying the PLD to software updates seems to create more problems than the ones the Directive is meant to solve. Therefore, it is submitted that the PLD is inapplicable both de lege lata and de legel ferenda to software updates. It is simpler and more logical to consider software updates of automated vehicles as a maintenance service.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Automated vehicles (AV) are most probably the future of the car
industry and driving. They are expected to dramatically decrease
accidents and make roads safer, given that 94% of grave accidents
are due to human error, while at the same time significantly
reduce traffic congestion, driving down costs and CO2 emissions
[
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
      <p>
        AV are the result of combining and integrating multiple
sensors into a single system, which helps the vehicle adjust its
road behaviour to the environment in which it is moving [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. They
combine sensors and software to control, navigate, and drive the
vehicle [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. There are six levels of automation ranging from L0 (no
automation at all) to L5 (full self-driving capacity) [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Currently
there are mainly L2 vehicles in operation, which enable only
partial automation in strictly defined conditions, while the driver
retains control of the vehicle for most of the time. L5 vehicles are
not expected to become operational in the near future. AV of L2
and higher employ AI systems, which result in gradual
modification of these systems in a way that cannot be predicted
in advance.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>General Characteristics of the PLD</title>
      <p>According to recitals (2) and (7) of the PLD, the objective of the
PLD is the fair apportionment of the risks inherent in modern
technological production. It is a full-harmonization directive,
which means that EU member States are not allowed to establish
more victim-friendly provisions on strict liability for defective
products.</p>
      <sec id="sec-2-1">
        <title>3 ‘Product’</title>
        <p>
          The PLD applies to ‘products’, which it defines as mainly tangible,
movable objects. ‘Products’ are distinguished from ‘services’,
which are not covered by the Directive [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ].
        </p>
        <p>
          It is disputed whether software is covered by the PLD. Various
views have been suggested, but we will mention here only the
most wide-spread. The rather prevailing view is that software is
covered, as long as it is embedded into a tangible object [
          <xref ref-type="bibr" rid="ref8 ref9">8, 9</xref>
          ].
Another view holds that bespoke or custom-made software is not
covered, since the PLD aims at regulating mass-produced items
[
          <xref ref-type="bibr" rid="ref10">10</xref>
          ]. Both views have been criticised as arbitrary and reflecting
outdated concepts, unsuitable for modern needs [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ]. Especially
considering devices that operate on cloud-based software, these
distinctions make little sense, if at all [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ]. Nevertheless, under
both distinctions, it appears that software used for the operation
of an AV would be considered a ‘product’ under the PLD.
        </p>
        <p>Things become more complicated as to updates of software.
There are two main options here. One would be to think that a
software update remains a piece of software and if software is
covered, then so are its updates; this option would deem every
piece of update as a separate ‘product’. The other option would be
to consider software updates as services to the basic software, i.e.
a kind of maintenance of the basic software, which enables its
unproblematic function in the future; in this respect, software
updates are not a ‘product’.</p>
        <p>
          There is also an intermediate option, according to which there
must be a distinction between software updates, which are
services, and software upgrades, which are separate ‘products’; the
difference being that upgrades add functionalities to the previous
software versions [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ]. A similar distinction would be the
necessity of regulatory approvals: motor vehicles and their
components are subject to safety approvals, including any
important alterations to their original form [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ]. If a regulatory
approval is needed following a modification of the software used
in the vehicle, then such modification would amount to a new
‘product’.
        </p>
        <p>To consider software updates as ‘products’ would face serious
practical difficulties, because updates are designed to merge and
interact with the rest of the software, operating as a whole with
it. Thus, it may be challenging to distinguish the update from the
rest of the software. The distinction between updates and
upgrades makes more sense. However, it risks permitting the
software developer to determine at will whether it will be subject
to the Directive’s ambit or not, by characterizing a piece of
software as an update or an upgrade. The criterion of functionality
may not always be easy to implement, because minor
functionalities may be added as part of an update too. The
question will then be what is a ‘minor’ and what is a ‘major’
functionality. Such definitional challenges create legal
uncertainty.</p>
        <p>
          In addition, updates are often transmitted wirelessly to the AV
system [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ]. In such cases, the requirement of incorporation into a
tangible object will not be fulfilled.
        </p>
        <p>Therefore, it will be preferable to consider updates as a
category of maintenance service, lying outside the Directive’s
scope.</p>
        <p>Nevertheless, to finally decide which option is more
appropriate, we have to first examine the rest of the PLD’s
provisions, which interact with the notion of ‘product’. In the
course of such examination, we will deem, for the sake of
argument, software updates as a separate ‘product’.</p>
      </sec>
      <sec id="sec-2-2">
        <title>4 ‘Producer’</title>
        <p>Art. 3(1) PLD includes in the definition of ‘producers’ the
manufacturer of the end product, the component manufacturer,
the producer of any raw material, as well as any persons who, by
putting their name, trade mark or other distinguishing feature on
products present themselves as their producers. Furthermore, the
importer of the product in the EU is also deemed a ‘producer’ [Art.
3(2) PLD].</p>
        <p>Where the producer of the product cannot be identified, each
supplier of the product is treated as its producer, unless it informs
the injured person, within a reasonable time, of the identity of the
producer or of the person who supplied it with the product. The
same applies, in the case of an imported product, if this product
does not indicate the identity of the importer referred to in Art.
3(2) PLD, even if the name of the producer is indicated [Art. 3(3)
PLD]. Suppliers, against whom proceedings are brought by an
injured person, has to inform the latter, on their own initiative
and promptly, of the identity of the producer or their own supplier
– a mere denial of suppliers that they are not the producer is
insufficient.</p>
        <p>All these persons may be held jointly and severally liable (Art.
5 PLD).</p>
        <p>Regarding software updates, the manufacturer of the vehicle
will be a producer as to the software incorporated in the vehicle,
even if it has been developed by a third party, which will be also
a ‘producer’. AV importers will also be liable, potentially car
sellers too. Hence, all these persons could be liable in the case of
a software update.</p>
        <p>However, for software updates developed by third parties and
installed by the user, it is highly doubtful whether the producer of
the AV and the developer of the basic software are liable de lege
lata, or should be liable de lege ferenda. The answer thereto
depends on what is exactly a ‘product’ and when it is put into
circulation. If each piece of software update is a separate product,
then its developer is liable since its release. If such developer is
other than the original producer of the AV or the basic AV
software, then the latter would not be liable. The rationale for the
liability of the end-product producer for defects of components is
that the end product incorporates all components, under the
supervision and responsibility of that producer. In case of
software updates developed by third parties, such rationale is no
longer valid.</p>
        <p>As a result, odd results may be caused as to the notion of
‘producer’ of software updates.
5</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Time of Placement into Circulation</title>
      <p>
        Art. 7(b) PLD entails that liability is imposed only for defects that
existed at the time the product was put into circulation. A product
is put into circulation when it is taken out of the manufacturing
process operated by the producer and enters a marketing process
in the form in which it is offered to the public in order to be used
or consumed [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ].
      </p>
      <p>Software updates are put into circulation at the time of their
release. However, their release most often occurs after the AV and
its operating software have been put into circulation. Unless we
consider the software update a sperate ‘product’, there will be no
liability for software updates.</p>
      <p>However, the extension of liability combined with the strict
nature of such liability risks creating a serious counter-incentive
for producers to release updates, which could render AV quickly
obsolete and thus undermine the promise of enhanced safety that
these vehicles are supposed to bring. The same goes for security
updates. As a result, to consider a software update as a distinct
‘product’ may have an adverse impact on safety and security.</p>
      <sec id="sec-3-1">
        <title>6 ‘Defect’</title>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>6.1 PLD Provisions</title>
      <p>According to Art. 6(1) PLD, a product is ‘defective’, when it does
not provide the safety which a person is entitled to expect, taking
all circumstances into account, including (a) the presentation of
the product, (b) the use to which it could reasonably be expected
that the product would be put, (c) the time when the product was
put into circulation. As already mentioned, the time that the
product was put into circulation is critical, since ‘producers’ are
only liable for defects that existed at that time. Hence, the PLD
lays down no duty to warn on dangers after the product has been
put into circulation or to recall defective products.</p>
      <p>
        Recital (6) PLD clarifies that the defectiveness of the product is
determined by reference to the lack of the safety which the public
at large is entitled to expect. Therefore, the safety-expectations
are determined objectively, which means that reference is not
made to the expectations of the specific user [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. In addition, the
PLD establishes a duty to put into circulation products that are
reasonably safe, taking into account all the circumstances – not
products that are absolutely safe [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. In this regard, some
national courts have referred to a risk-benefit analysis of the
product’s characteristics, taking into account the kind and the
extent of the risks connected to the use of the product, the
possibility that such risks materialize, the cost of additional safety
measures and the benefits from the use of the product [
        <xref ref-type="bibr" rid="ref16 ref18">16, 18</xref>
        ].
Nonetheless, the compatibility of the risk-utility test with the
Directive’s liability system is disputed [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ].
      </p>
      <p>
        At the same time, recital (6) PLD makes clear that safety is
assessed by excluding any misuse of the product not reasonable
under the circumstances. Consequently, the reasonable safety
expectations of the user encompass cases of foreseeable product
misuse. Producers must consider foreseeable product misuse both
when designing the product and when issuing instructions and
warnings [
        <xref ref-type="bibr" rid="ref19 ref9">9, 19</xref>
        ].
      </p>
      <p>
        Moreover, the CJEU has ruled in the Boston Scientific
Medizintechnik case that, where it is found that products
belonging to the same group or forming part of the same
production series have a potential defect, an individual product of
such series may be classified as defective without there being any
need to establish that this product has such a defect [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ].
      </p>
    </sec>
    <sec id="sec-5">
      <title>6.2 Consequences for software updates</title>
      <p>Applying these principles to software updates is challenging.
Updates form part of a wider system of systems, i.e. they are part
of the basic software, which is part of the AV. Identifying the
reasonable user expectations as to updates themselves may be
hardly possible, given the highly complex nature of software used
in AV and its interaction with other pieces of software, including
other updates. Besides, users may often be unaware of the updates
installed in their system.</p>
      <p>Nevertheless, two main indications could be used. First, any
documentation accompanying the release of the update, such as
release notes, instructions and warnings - although these may be
hardly understandable to the average users to shape their
expectations. Second, any problems experienced by users or
vulnerabilities identified by third parties and made public, which
users would reasonably expect to be remedied. In this respect,
there is an interesting interaction between safety expectations of
users and the risk-utility test. The safety expectations may not be
able to be met under a risk-utility analysis. One could argue that,
in such cases, the expectations of the users would not be
reasonable. Nevertheless, this may not always be valid. For
example, there may be a major security vulnerability, which
would be reasonable to expect to be fixed as soon as possible; yet
fixing such vulnerability may not be possible, without affecting
other functionalities of the basic software.</p>
      <p>
        Things get more complicated, if we consider the evolving
behaviour of AV in view of their self-learning abilities. Each AV
may exhibit different behaviour under similar circumstances, so
that different users may have different expectations based on their
experience. In addition, such differences may render
inappropriate the application of the CJEU’s ruling on the Boston
Scientific Medizintechnik case [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ].
7 ‘Damage’
‘Damage’ is defined in Art. 9 PLD. It includes physical injury and
property damage. Nevertheless, the latter is actionable only under
certain requirements: no damage to the defective product itself is
covered, while damage to other property items requires that (a)
the damage exceeds 500€, (b) the damaged item is of a type
ordinarily intended for private use or consumption, and (c) the
item was used by the injured person mainly for his/her own
private use or consumption. Non-material damages can be
awarded according to the applicable national provisions.
      </p>
      <p>
        A first major challenge is to identify what would be damage to
the defective product itself, which is not covered. The distinction
between the component and the product is highly disputed in
cases of complex products [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. It is unclear whether this would
cover the basic software and the AV as such. It appears reasonable
to deem that the defective update and the basic software are one
‘product’, but things are less clear as to the AV as such. It can be
argued that since software is an integral part of the AV, the
update, the software and the AV are the same ‘product’. The
opposing view would be that software could be uninstalled and
re-installed just like e.g. a defective tire, so that there are two
distinct products.
      </p>
      <p>Another question is whether data are ‘property items’. One
might argue that a ‘property item’ refers only to tangible products
and data are intangible. However, it would be more correct to
interpret the term widely. A property item is any piece of property
that has monetary value as such, irrespective of its tangibility. In
modern economy, there can be no doubt that data as such have
value, given that they are the object of distinct economic
transactions. Besides, traditional property items, such as vinyl
discs and CDs, have been digitalized and are sold online as if they
were tangible objects.</p>
      <p>
        Third, it is to be examined whether damage related to personal
data is covered, e.g. a security flaw in a piece of software leads to
loss or theft of personal data of the driver, stored in his/her mobile
phone, which is connected to the infotainment system of the AV.
One might argue that personal data protection is regulated
exclusively in the General Data Protection Regulation (GDPR)
[
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]. However, the GDPR applies to the processing of personal
data [Art. 2(1) GDPR] and regulates the liability of the controller
and the processor of personal data (Art. 82 GDPR). The software
developer may not qualify as a controller or processor, as it may
not be involved in any processing of personal data. In such cases
the GDPR will be inapplicable. But even if the GPDR is applicable,
there is nothing indicating that it constitutes an exclusive remedy
– on the contrary, there are significant indications that the GDPR
does not regulate exclusively issues of personal data, e.g. the
wording of Arts 77(1), 78(1) and 79(1) “without prejudice to any
available administrative or non-judicial remedy”. At the same
time however, it is doubtful whether loss or theft of personal data
is damage to ‘a property item’ or ‘physical injury’. It would be
more appropriate to consider such cases as an infringement of
personality, for which non-material damage under the applicable
national law is due, per Art. 9 PLD.
8
      </p>
    </sec>
    <sec id="sec-6">
      <title>Defenses</title>
      <p>In the cases of software updates, the most significant defences
under the PLD are that the defect did not exist when the product
was put into circulation [Art. 7(b)], that the state of scientific and
technical knowledge at the time when he put the product into
circulation was not such as to enable the existence of the defect to
be discovered [state of the art defence - Art. 7(e)] and that there
was contributory negligence of the user [Art. 8(2)].</p>
      <p>
        The ECJ has clarified that Article 7(e) is not specifically
directed at the practices and safety standards in use in the
industrial sector in which the producer is operating, but,
unreservedly, at the state of scientific and technical knowledge,
including the most advanced level of such knowledge, at the time
when the product in question was put into circulation [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ].
Second, this defence is judged objectively, taking into account the
state of knowledge of which the producer is presumed to have
been informed. Nevertheless, it is implicit in the wording of
Article 7(e) that the relevant scientific and technical knowledge
must have been accessible at the time when the product in
question was put into circulation. Therefore, in order to have a
defence under Article 7(e) PLD, the producer of a defective
product must prove either that the objective state of scientific and
technical knowledge, including the most advanced level of such
knowledge at the time when the product in question was put into
circulation did not enable the discovery of the defect; or that such
knowledge was not accessible at the time when the product in
question was put into circulation. Concerning software updates,
the developer/ producer would have to prove that the defect was
not discoverable at all, at the time of the update release.
Impracticability of being discovered, e.g. due to the complexity of
the software code, will not suffice. Thus, the occasions of
successful invoking the defence will be rather rare.
      </p>
      <p>As to the user’s contributory negligence, it may relate to
inappropriate installation, e.g. installation while the vehicle is in
motion, while the producer warns that the vehicle must not be,
inappropriate settings or even installation of third-party software
that is incompatible with the installed update.
9</p>
    </sec>
    <sec id="sec-7">
      <title>Burden of Proof</title>
      <p>The injured person is required to prove the damage, the defect and
the causal link between defect and damage (Art. 4).</p>
      <p>
        According to the CJEU [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ], under the principle of procedural
autonomy and subject to the principles of equivalency and
effectiveness, evidentiary issues are governed by the national law
of each MS. The CJEU underlines the principle of effectiveness,
which requires that national procedural rules do not render
practically impossible or excessively difficult the exercise of rights
conferred by EU law. Yet, such rules must not undermine the
apportionment of the burden of proof established in the
PLD. Thus, circumstantial evidence may be allowed in certain
cases, to establish such relationship, and alleviate the plaintiff’s
burden of proof. However, this is allowed only on a case-by-case
basis and provided that the burden of proof is not practically
reversed. It would be a violation of the Directive’s rules, if a
presumption of a causal link could be automatically created when
specific facts, pre-identified by the legislature or supreme judicial
body, are proven.
      </p>
      <p>
        The provisions of the PLD on the burden of proof have
received criticism as being excessive for claimants, especially in
cases of complex products. However, such difficulties have been
mitigated mainly by the practice of courts in many MS by granting
evidentiary facilitations under specific circumstances [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ].
10
      </p>
    </sec>
    <sec id="sec-8">
      <title>Time Bars</title>
      <p>Concerning time bars, the PLD establishes a limitation period of
three years from the day on which the plaintiff became aware, or
should reasonably have become aware, of the damage, the defect
and the identity of the producer [Art. 10(1)]. In any case, the
producer’s liability is extinguished upon the expiry of a 10-year
period from the date on which the producer put into circulation
the actual product which caused the damage, unless the injured
person has in the meantime instituted proceedings against the
producer (Art. 11).</p>
      <p>
        The 10-year period is mainly justified by the fact that strict
liability puts a higher burden on producers than fault-based
liability; therefore, the liability period is limited in order not to
discourage technological innovation and to allow insurance cover
[
        <xref ref-type="bibr" rid="ref24">24</xref>
        ]. Nevertheless, it has been criticized as too short for some
categories of products [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], to which AV could be added. In the
long-run, the 10-year limitation period entails that manufacturers
will not be liable for defects of older vehicle models.
      </p>
      <p>If software updates are deemed separate products, then there
will be a separate ten-year period running for each one of them.
Whether this would lead to an extension of the liability of the end
manufacturer or at least the developer of the basic software is
uncertain. Should software updates have been developed by third
parties, the answer appears to be rather negative. Yet, things are
less clear if the updates come from the manufacturer itself or
entities cooperating with it. Besides, to distinguish cases of
thirdparty developers would be fair from one aspect, but could
incentivize producers to outsource production and release of
updates to escape liability.</p>
    </sec>
    <sec id="sec-9">
      <title>Conclusion</title>
      <p>To regard software updates as ‘products’ under the PLD entails
many legal and practical challenges. They relate to the notion of
‘product’, the time of placement into circulation, the notion of
‘defect’, the burden of proof especially as to causation and the
calculation of time bars. Applying the Directive to software
updates seems to create more problems than solutions.</p>
      <p>Therefore, it is submitted that the PLD is inapplicable both de
lege lata and de lege ferenda to software updates. It is simpler and
more logical to consider software updates of automated vehicles
as a maintenance service.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>NHTSA.</surname>
          </string-name>
          <article-title>Automated vehicles for safety</article-title>
          .
          <source>Retrieved November 16</source>
          ,
          <year>2020</year>
          from https://www.nhtsa.gov/technology-innovation/automated-vehicles-safety.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>Christian</given-names>
            <surname>Gilbertsen</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Here's how the sensors in autonomous cars work (March 27,</article-title>
          <year>2017</year>
          ).
          <source>Retrieved November 16</source>
          ,
          <year>2020</year>
          from http://www.thedrive.com/tech/8657/heres
          <article-title>-how-the-sensors-in-autonomouscars-work.</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <source>[3] Union of Concerned Scientists</source>
          .
          <year>2017</year>
          .
          <article-title>Self-Driving Cars Explained (January 26,</article-title>
          <year>2017</year>
          ).
          <source>Retrieved November 16</source>
          ,
          <year>2020</year>
          from https://www.ucsusa.org/cleanvehicles/how
          <article-title>-self-driving-cars-work#</article-title>
          .
          <source>W2xOmSQzapo</source>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>SAE</given-names>
            <surname>International</surname>
          </string-name>
          .
          <year>2018</year>
          .
          <article-title>Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles</article-title>
          .
          <source>Retrieved November 16</source>
          ,
          <year>2020</year>
          from https://www.sae.org/standards/content/j3016_
          <fpage>201806</fpage>
          /.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>Tesla</surname>
          </string-name>
          .
          <article-title>Software updates</article-title>
          .
          <source>Retrieved November 16</source>
          ,
          <year>2020</year>
          from https://www.tesla.com/support/software-updates
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <source>[6] Council Directive</source>
          <volume>85</volume>
          /374/EEC of 25
          <article-title>July 1985 on the approximation of the laws, regulations and administrative provisions of the Member States concerning liability for defective products</article-title>
          ,
          <source>OJ L 210 7 Aug</source>
          .
          <year>1985</year>
          , pp.
          <fpage>29</fpage>
          -
          <lpage>33</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <source>[7] CJEU, judgment of 21 December</source>
          <year>2011</year>
          , case C-
          <volume>495</volume>
          /10 Dutrueux and
          <article-title>Caisse primaire d'assurance maladie du Jura</article-title>
          , ECLI:EU:C:
          <year>2011</year>
          :
          <fpage>869</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>Martina</given-names>
            <surname>Barbero</surname>
          </string-name>
          et al.
          <year>2018</year>
          .
          <article-title>Study on emerging issues of data ownership, interoperability, (re-)usability and access to data, and liability, Final Report prepared for the European Commission by Deloitte et al</article-title>
          .,
          <source>Retrieved November 16</source>
          ,
          <year>2020</year>
          from https://ec.europa.
          <article-title>eu/digital-single-market/en/news/studyemerging-issues-data-ownership-interoperability-re-usability-and-accessdata-and</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>Peter</given-names>
            <surname>Rott</surname>
          </string-name>
          .
          <year>2018</year>
          .
          <article-title>Rechtspolitischer Handlungsbedarf im Haftungsrecht, insbesondere für digitale Anwendungen</article-title>
          .
          <source>Retrieved November 16</source>
          ,
          <year>2020</year>
          from https://www.vzbv.de/sites/default/files/downloads/2018/05/04/gutachten_han dlungsbedarf_im_haftungsrecht.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>Duncan</given-names>
            <surname>Fairgrieve</surname>
          </string-name>
          and Richard Goldberg.
          <year>2020</year>
          . Product Liability, 3rd ed., Oxford University Press, Oxford.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>Beta</given-names>
            <surname>Computers (Europe) Ltd v Adobe Systems (Europe) Ltd</surname>
          </string-name>
          , 1996
          <string-name>
            <surname>S.C.L.R.</surname>
          </string-name>
          <year>587</year>
          , 594 per
          <string-name>
            <given-names>Lord</given-names>
            <surname>Penrose</surname>
          </string-name>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <source>[12] Minutes of Meeting of the Expert Group on "Liability and New Technologies - Product Liability Formation</source>
          .
          <source>2018 (September 18</source>
          ,
          <year>2018</year>
          ).
          <source>Retrieved November 16</source>
          ,
          <year>2020</year>
          from https://ec.europa.eu/transparency/regexpert/index.cfm?do=groupDetail.group MeetingDoc&amp;docid=
          <fpage>24945</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <source>[13] Minutes of Meeting of the Expert Group on "Liability and New Technologies - Product Liability Formation</source>
          .
          <source>2019 (February 18</source>
          ,
          <year>2019</year>
          ).
          <source>Retrieved November 16</source>
          ,
          <year>2020</year>
          from https://ec.europa.eu/transparency/regexpert/index.cfm?do=groupDetail.group MeetingDoc&amp;docid=
          <fpage>31014</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <surname>Regulation</surname>
          </string-name>
          (EU)
          <year>2018</year>
          /
          <article-title>858 of the European Parliament and of the Council of 30 May 2018 on the approval and market surveillance of motor vehicles and their trailers, and of systems, components and separate technical units intended for such vehicles</article-title>
          ,
          <source>OJ L 151/1.</source>
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <surname>CJEU</surname>
          </string-name>
          ,
          <source>Judgment of 9 Febr</source>
          .
          <year>2006</year>
          , C-
          <volume>127</volume>
          /04 O' Byrne,
          <string-name>
            <surname>ECLI</surname>
          </string-name>
          :EU:C:
          <year>2006</year>
          :
          <fpage>93</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <surname>Bundesgerichtshof</surname>
          </string-name>
          , judgment of 16 June 2009 (Airbag),
          <source>NJW</source>
          <year>2009</year>
          ,
          <volume>2952</volume>
          (Ger.).
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>Rachel</given-names>
            <surname>Mulheron</surname>
          </string-name>
          .
          <year>2016</year>
          . Principles of Tort Law, Defective Products - Online
          <string-name>
            <surname>Content</surname>
          </string-name>
          , Oxford University Press, Oxford.
          <source>Retrieved November 16</source>
          ,
          <year>2020</year>
          from https://www.cambridge.org/files/6614/7610/6091/Defective_products_Mulhero n.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18] Wilkes v DePuy International Limited [2016]
          <article-title>EWHC 3096 (Eng</article-title>
          .).
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>Martin</given-names>
            <surname>Ebers</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Autonomes Fahren: Produkt und Produzentenhaftung</article-title>
          . In:
          <string-name>
            <surname>Autonomes Fahren Bernd H. Oppermann</surname>
            and
            <given-names>Jutta</given-names>
          </string-name>
          <string-name>
            <surname>Stender-Vorwachs (Eds). C.H.Beck</surname>
          </string-name>
          , Munich,
          <fpage>93</fpage>
          -
          <lpage>125</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          <source>[20] CJEU judgment of 5 March</source>
          <year>2015</year>
          , joined Cases C-
          <volume>503</volume>
          /13 and C-
          <volume>504</volume>
          /13 Boston Scientific Medizintechnik GmbH, ECLI:EU:C:
          <year>2015</year>
          :
          <fpage>148</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <surname>Regulation</surname>
          </string-name>
          (EU)
          <year>2016</year>
          /
          <article-title>679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data</article-title>
          ,
          <source>and repealing Directive</source>
          <volume>95</volume>
          /46/EC (
          <article-title>General Data Protection Regulation)</article-title>
          ,
          <source>OJ L 119</source>
          ,
          <issue>4</issue>
          .5.
          <year>2016</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>88</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          <source>[22] ECJ judgment of 29 May</source>
          <year>1997</year>
          , case C-
          <volume>300</volume>
          /95, Commission v UK, ECLI:EU:C:
          <year>1997</year>
          :
          <fpage>255</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          <source>[23] CJEU judgment of 21 June</source>
          <year>2017</year>
          , case C-
          <volume>621</volume>
          /15 - W and Others, ECLI:EU:C:
          <year>2017</year>
          :
          <fpage>484</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <surname>European</surname>
            <given-names>Commission</given-names>
          </string-name>
          ,
          <source>Report from the Commission on the Application of Directive</source>
          <volume>85</volume>
          /374 on Liability for Defective Products,
          <string-name>
            <surname>COM</surname>
          </string-name>
          (
          <year>2000</year>
          ) 893 final (
          <issue>31</issue>
          <year>Jan</year>
          .
          <year>2001</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>