<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>April</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Publishing L2TAP Logs to Facilitate Transparency and Accountability</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Data Provider Auditor</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Auditor</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Dataset MIMIC II</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Data Provider Research Team PhysioNet RT</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Mariano P. Consens University of Toronto</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Reza Samavi University of Toronto</institution>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2014</year>
      </pub-date>
      <volume>8</volume>
      <issue>2014</issue>
      <abstract>
        <p>We propose publishing L2TAP privacy logs to facilitate privacy auditing tasks that involve multiple auditors, an increasingly common requirement in the context of social computing and big data driven science. Our proposal utilizes two ontologies, L2TAP and SCIP, designed for deployment in a Linked Data environment. L2TAP provides provenance enabled logging of events. SCIP synthesizes contextual integrity concepts to express key privacy-related semantics associated with log events. We describe SPARQL query-based solutions for privacy log construction, obligation derivation, and compliance checking. The solutions facilitate accountability and transparency among participants (privacy auditors in particular).</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. INTRODUCTION</title>
      <p>
        The protection of individuals' privacy is becoming
increasingly more challenging in the era of social computing and
data driven science. While privacy protection has
implications in many application areas, it is clearly challenging
when health related data is involved. Big data enabled
biological and biomedical research involves massive datasets
of human genome, biological imaging, and clinical
information collected and aggregated from individual health records.
Protecting data subjects' privacy in clinical research is a
concern addressed by multiple legislations and regulations.
For example, the U.S. Department of Health and Human
Services (HHS) [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ] obliges investigators to protect the privacy
of data subjects and to maintain the con dentiality of data.
HHS also requires investigators to establish oversight
mechanisms and monitoring plans for research projects involving
human subjects, and to remain accountable to the subjects'
privacy rights. Auditing is essential to the enforcement of
accountability, and many scenarios involve auditors from
multiple institutions that monitor the ful llment of privacy
obligations.
      </p>
      <p>To illustrate the need for an audit mechanism that facilitates
accountability and transparency among multiple participants,</p>
      <p>RT1Auditor</p>
      <p>L2TAP</p>
      <p>Audit Log RT1  </p>
      <p>L2TAP</p>
      <p>
        Audit Log RT2  
consider a research study that analyzes the primary reasons
for intensive care unit (ICU) hospitalization, examining the
e ectiveness of di erent types of medications across patient
demographics (sex, age, and ethnicity). The scenario is
depicted in Fig. 1. The dataset used for the study is MIMIC
II, a Clinical Database provided by PhysioNet [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], where
records contain information about the ICU admission of
patients [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. Although MIMIC II database is a de-identi ed
public dataset, the access is available only under terms of
a data use agreement (DUA1). This DUA de nes a list of
obligations that a researcher agrees to ful ll. Some of these
obligations involves purposes and roles. For example, the
dataset should be used only for academic research purposes
and by a researcher (ob1). Some others are pre-obligations
which are actions that need to be performed prior to access.
For instance, the DUA states a researcher should complete a
training program in human research subjects protections prior
to access (ob2). There are also some post-obligations which
are actions that need to be performed after access has been
granted such as: If the researcher nds information within
restricted data that she believes might permit identi cation of
any individual, she will report the location of this information
promptly by email (ob3).
      </p>
      <p>
        Two research teams (RT1 and RT2) are collaborating on this
study. The teams could be based on related or unrelated
research institutions (i.e., RT1 is based on a hospital, while
RT2 is based on a university department, and the hospital
could be part of the university, or not). The privacy policies
mentioned above govern the access to MIMICII dataset. The
policies are designed by PhysioNet according to HIPPA [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ]
and other privacy regulations in order to protect privacy
1http://physionet.org/works/mimic2cdb/access.shtml
of individuals whose data are used in research studies. In
order to check if the research teams are compliant to these
policies multiple potential auditors must be able to audit
the log of access and ful lment of obligations. One of the
potential auditors is the Data Provider itself who oversees
the contract to ensure the usage of data is accordance to the
agreement. The auditors from two teams may also want to
audit the process with respect to the internal data protection
policies. In addition, an external auditor should be able to
ensure the research involving individuals health data are fully
HIPPA compliant.The challenge needs to be addressed is
that while multiple participants are involved in generating
privacy logs (e.g. the data provider, the research teams, and
the researchers), all potential auditora should be able to
check the log to see if the researchers are respecting privacy
of data subjects.
      </p>
      <p>
        In the past few years, we have observed multiple practical
proposals with focus on privacy of big datasets and linked
data ([
        <xref ref-type="bibr" rid="ref18 ref22 ref7 ref8">22, 18, 7, 8</xref>
        ]). The goal of these studies have been on
access control frameworks that de ne who can access which
resources. They achieve privacy through safeguarding of
data before the access is granted and provide no solutions
for privacy support after the access.There are also solid
theoretical and practical work to support privacy auditing
(data usage control after access is granted). However they
either exploit complex logic (e.g. [
        <xref ref-type="bibr" rid="ref2 ref3 ref5 ref9">2, 9, 3, 5</xref>
        ]) that jeopardizes
their practical bene ts or use system level logging standards
(e.g.[
        <xref ref-type="bibr" rid="ref15 ref6">15, 6</xref>
        ]) to generate privacy audit logs on an application by
application basis, thus generating privacy logs not exploitable
by multiple participants and auditors in an heterogenous
environment.
      </p>
      <p>
        In [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ] we proposed L2TAP ontology (Linked Data Log to
Transparency, Accountability and Privacy) that allows
participants to log in RDF [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ] the provenance assertions of
privacy related events. We also proposed a second pluggable
ontology SCIP (Simple Contextual Integrity Privacy) to
capture the privacy semantics of log events and enable SPARQL
query-based implementations of auditing and compliance
checking in a personalized health work ow2.The scalability
of the framework for compliance checking has been evaluated
by a set of queries described in [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ].
      </p>
      <p>
        Using L2TAP+SCIP, this paper proposes a standard way
of privacy auditing in the big data research context. We
propose multiple SPARQL query-based solutions (with a
limited reasoning support of RDFS) to facilitate the tasks
of constructing L2TAP privacy logs (when privacy policies
are applicable to the classes of individuals and data items),
deriving obligations from privacy policies, and compliance
checking. If research teams agree on the semantics of
publishing the log based on L2TAP+SCIP, they can show to the
auditors their compliance in only one e ort and auditors can
oversee the compliance of parties involved without additional
e orts. In other words, after the log has been created and all
obligations and their ful llments are captured the research
team can check the log and provide it as an evidence of
accountability [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]. Using the same log and the SPARQL
solutions, all other auditors including the data provider's
auditor, the institution auditors (described in [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ] as
Insti2L2TAP and SCIP are documented at http://l2tap.org.
tutional Review Board (IRB) for a single-site research and
Data and Safety Monitoring Board (DSMB) for multi-site
research), and the external auditor can check compliance.
The paper structure and contributions are as follows. Section
2 provides an overview of L2TAP and SCIP and shows how
the ontology can be used to capture the log events and their
privacy semantics. Section 3 describes our SPARQL
querybased solutions for constructing the log, obligation derivation,
and compliance checking. Section 4 describes the related
research. We conclude in Section 5.
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. L2TAP LINKED DATA LOG</title>
      <p>In this section we rst motivate the need for two ontologies
to generate privacy audit logs. Then using our motivating
scenario we describe L2TAP, an ontology for speci cations of
the header of privacy log events, and SCIP, an ontology that
provides necessary speci cations to encode privacy semantics
of the body of log events.</p>
      <p>
        The goal of L2TAP is to provide a set of classes and
properties that can be used to represent and publish a log of
privacy events as Linked Data. In the motivating scenario
expressing access policies and obligations, requesting access
to the dataset, ful lling obligations are some of the typical
privacy events that we expect L2TAP to be able to capture.
L2TAP follows the principles of Linked Data [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] to publish
logs. Everything in the l2tap:Log is expressed in terms of
some l2tap:LogEvents. URIs are used as names for logs, log
events, participants, and processes. Thus, the log events can
be published as web dereferenceable URIs by participants.
Participants who want to dereference a published log are
authenticated and communicated via a secure https channel.
After we describe L2TAP and SCIP ontologies, at the end
of Subsection 2.2 we will provide justi cation on why these
ontologies rely on dereferenceable URIs and how Linked Data
infrastructure allows to achieve log data integration when
multiple parties contribute into the log their privacy events
in di erent points in time.
      </p>
      <p>
        The L2TAP ontology describes the header of a log event
and is scoped to answer the provenance queries about log
events, such as who has contributed an event to the log and
when. The when in L2TAP can be expressed as simple xsd
time using two L2TAP properties, l2tap:eventTimestamp and
l2tap:publishingTimestamp. There are some subtlety in
capturing the who in L2TAP. Following the second principle of
Linked Data, using http:// URIs as names for participants,
amounts to a data publisher choosing part of an http://
namespace that the publisher controls, by virtue of owning the
domain name [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. In L2TAP, the publisher of the log events
is the logger who owns the domain of the log and can talk
about the events and their assertions (e.g. https://logRT.org).
If an L2TAP logger wishes to identify a participant as the who
in an event header, the logger must register the participant,
i.e. mint the URI of the participant with the namespace
in its domain. Registered participants will be considered
accountable for the assertions that they make in the log.
The privacy semantics of privacy events (e.g. what is an
obligation ful lment) are contained in the body of a log event
and expressed using the SCIP ontology. In designing SCIP,
1 &lt;https://logRT.org&gt; a l2tap:Log.
2 &lt;https://logRT.org/logevent/e1&gt; a l2tap:LogInitializationEvent;
3 l2tap:initializesLog &lt;https://logRT.org&gt;;
4 l2tap:logger &lt;https://RT.org/logger&gt;;
5 l2tap:publicationTimestamp "2014-01-26T12:00:00Z"^^xsd:dateTime;
6 l2tap:timeline &lt;https://RT.org/sitetime&gt;.
7 &lt;https://RT.org/logger&gt; a foaf:Agent.
8 &lt;https://RT.org/sitetime&gt; a l2tap:Timeline;
9 l2tap:physicalTimeline tl:universaltimeline;
10 l2tap:clock "wwp.greenwichmeantime.com/" ^^ xsd:string;
11 l2tap:clockSyncFreq [tl:duration "P7DT"^^ xsd:duration].
we are inspired by the contextual integrity (CI) perspective
[
        <xref ref-type="bibr" rid="ref20">20</xref>
        ]. The SCIP ontology provides mapping targets for
basic notions of participants in an information ow, privacy
contexts, and privacy norms as described in CI. The goal
of the SCIP ontology is to de ne a minimum set of classes,
properties and constraints that allows the basic compliance
queries (e.g. which access request is non-compliant?) to be
answered using SPARQL queries.
      </p>
      <p>Having two namespaces is the basis for the framework
exibility and extensibility. The proposed SCIP ontology is just
one instance of a class of pluggable ontologies to express
privacy semantics and can be substituted with an ontology
with more-or-less expressive power without impacting the
semantics of the log header.</p>
    </sec>
    <sec id="sec-3">
      <title>2.1 Log Event Types</title>
      <p>L2TAP speci es three types of log events, log initialization
events, participant registration events, and privacy events.
Log Initialization Events. This type of events de nes
which l2tap:Log is being initialized using the l2tap:initializesLog
property. It also records assertions on the log characteristics
such as who the logger is (l2tap:logger), and how the event
timestamps are captured (l2tap:logClock). Fig. 2 provides an
example of using the L2TAP ontology to encode a log event
that initializes a log with https://logRT.org URI (line 1). This
privacy log has a logger with https://RT.org/logger URI (line
4). The logger is a foaf:Agent3 (line 7). The physical timeline
for this log is a constant in the timeline ontology4 (line9).
Lines 10 and 11 encode the log's reference clock and the
syncing frequency.</p>
      <p>Participant Registration Events. This event type is used
to register a foaf:Agent as an L2TAP log participant who can
then submit the future log events. The l2tap:registersAgent
property links a log event to a foaf:Agent who will be
recognized by the logger as the registered agent. As described
above the participant registration event marks the time
instant that a participant's URI has been minted in the logger's
domain. So the registered participants will be kept
accountable with respect to the log events that they are contributing
to the log in the future. In our scenario research teams as
receivers of data and PhysioNet as the data provider are
participants in the log. If the data was not anonymized each
individual data subject or a class of data subjects could have
also been registered as participants.
3http://xmlns.com/foaf/spec/
4http://purl.org/NET/c4dm/timeline.owl#
1 https://logRT.org/logevent/e2&gt; a l2tap:ParticipantRegistrationEvent;
2 l2tap:memebrOf &lt;https://logRT.org&gt;;
3 l2tap:eventTimestamp "2014-01-27T12:00:00Z"^^xsd:dateTime;
4 l2tap:publicationTimestamp "2014-01-27T12:00:01Z"^^xsd:dateTime;
5 l2tap:registersAgent &lt;https://RT.org/ClinicalResearchers&gt;;
6 l2tap:eventParticipant &lt;https://logRT.org/participants/RT&gt;.
7 l2tap:eventData &lt;https://logRT.org/logng/ng2&gt;.
8 &lt;https://logRT.org/participants/RT&gt; a l2tap:Participant;
9 l2tap:registeredAgent &lt;https://RT.org/ClinicalResearchers&gt;.
10 &lt;https://RT.org/ClinicalResearchers&gt; a foaf:Agent.
11 &lt;https://logRT.org/logng/ng2&gt;={
12 &lt;https://RT.org/ClinicalResearchers/RT1&gt; a &lt;https://RT.org/</p>
      <p>ClinicalResearchers&gt; .
13 &lt;https://RT.org/ClinicalResearchers/RT2&gt; a &lt;https://RT.org/</p>
      <p>
        ClinicalResearchers&gt; .
14 &lt;https://RT.org/ClinicalResearchers/Mark&gt; a &lt;https://RT.org/RT1&gt; .
15 &lt;https://RT.org/ClinicalResearchers/Joe&gt; a &lt;https://RT.org/RT1&gt; .}
Fig. 3 shows an example of using the L2TAP ontology to
register the class of research teams as a foaf:Agent with
&lt;https://RT.org/ClinicalResearchers&gt; URI (line 5). Note that
this is the URI of a class of researchers. In lines 8-9 the
l2tap:Participant class and the l2tap:registeredAgent property
are used to capture the fact that the URI of the class of
researchers is minted in the logger's domain. It is optional for a
participant registration event to use the l2tap:participantData
property and add a named graph [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] as the event data
(payload) to the event. Suppose in our motivating scenario RT1
and RT2 are two classes of researchers. RT1 uses the dataset
to study patients under 18 and RT2 studies patients 18 year
and older. The optional named graph can be used to
capture this classi cations and additional information about the
members of each class. For example we used the named
graph (lines 11-15) to encode research team hierarchy and
memberships. Therefore the accountability can be cascaded
to a speci c individual.
      </p>
      <p>Privacy Events. A privacy event is used to encode privacy
processes such as expressing privacy policies, access requests,
and obligation ful lment. Fig. 4 shows how the L2TAP
ontology is used to log provenance assertions of privacy
policies applicable to our scenario. The quads in this privacy
event are grouped in two sets. The quads in lines 1-6 are the
header of the event and the quads in line 8 onward are the
body of the event. The data provider (PhysioNet) is the one
who submits the quads of the policies to the log (line 3). The
body of this log event (wrapped in https://logRT.org/logng/ng1
named graph) describes privacy policies and preferences as
the payload of the event. The SCIP ontology is used to
express the semantics of a privacy event's body.</p>
    </sec>
    <sec id="sec-4">
      <title>2.2 Log Event Privacy Semantics</title>
      <p>The L2TAP ontology described so far encodes a privacy
event and its accountable participant regardless of the privacy
semantics of the event. The SCIP ontology provides necessary
vocabularies to capture the privacy semantics. We categorize
the semantics in four groups: privacy preferences (policies),
access requests and responses, obligation ful llments, and
access activities.</p>
      <p>Privacy Preferences. The scip:PrivacyPreference class is
used to encode a context and the norms applicable to the
context. The context in SCIP is characterized using multiple
1 &lt;https://logRT.org/logevents/e3&gt; a l2tap:PrivacyEvent;
2 l2tap:memebrOf &lt;https://logRT.org//&gt;;
3 l2tap:eventParticipant &lt;https://logRT.org/participants/PhysioNet&gt;;
4 l2tap:eventTimestamp "2014-01-28T12:00:00Z"^^xsd:dateTime;
5 l2tap:publicationTimestamp "2014-01-28T12:01:00Z"^^xsd:dateTime;
6 l2tap:eventData &lt;https://logRT.org/logng/ng1&gt; .
7 &lt;https://logRT.org/logng/ng1&gt; = {
8 &lt;https://logRT.org/PhN_pp1&gt; a scip:PrivacyPreference; ...}
9 scip:expressedBy &lt;https://logRT.org/participants/PhysioNet&gt;;
10 scip:hasValidity [time:hasBegining "2014-01-01T00:00:00Z";
11 time:hasEnd "2015-01-01T00:00:00Z"];
12 scip:dataItem &lt;https://mimicii.org/patients/MEDITEM&gt;;
13 scip:requestorRole &lt;https://RT.org/roles/scientific_researcher&gt;;
14 scip:purpose &lt;https://RT.org/purposes/scientific_research&gt;;
15 scip:privacyPrivilege &lt;https://RT.org/privileges/read&gt;;
16 scip:obligation &lt;https://RT.org/obs/ob2&gt;;
17 scip:obligation &lt;https://RT.org/obs/ob3&gt;;
18 scip:propositionalExpression &lt;https://RT.org/exp/phy1&gt; .
19 &lt;https://RT.org/obs/ob2&gt; a scip:ObligationTemplate;
20 scip:performAction &lt;http://ontology.org/actions/</p>
      <p>obtain_training_certificate&gt;;
21 scip:occurrenceGap "-1"^^xsd:integer;
22 scip:performanceDuration "1"^^xsd:integer.}
classes: scip:DataItem, scip:Purpose, and scip:PrivacyPrivilege.
Use, collect, and disclosure are di erent types of privacy
privileges. Participants in a context interact with each
other in certain capacities or roles. In SCIP, roles of three
main participants in an information ow are encoded using
scip:dataSubjectRole, scip:dataRequestorRole, and scip:dataSender
Role properties. The scip:Role class is used to capture the
abstract and concrete roles. In SCIP, roles, purposes, data
items and privacy privileges are represented as lattice using
rdfs:subClassOf.</p>
      <p>Fig. 5 shows how the SCIP ontology is used to encode the
obligations described in our scenario. Note that the quads in
this gure are the continuation of the quads in Fig. 4. Line
9 describes by whom the privacy preferences are expressed
using the scip:expressedBy property. Note that the minted
PhysioNet URI is the participant who submits the privacy
policies. The quads in line 10 and 11 describe the validity
time interval of the policies. The rst obligation in our
scenario (ob1) is expressed as legitimate purpose (line 14)
for using the dataset (line 12) and the acceptable roles of
participants (lines 13) and the privilege that will be granted
if the obligations are ful lled (line 15).</p>
      <p>
        There are also norms associated with a context that
describe obligations or actions that need to be performed
before (pre-obligation) or after (post-obligation) the dataset
is accessed [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]. The scip:ObligationTemplate is a subclass
of scip:Obligation that captures these actions. Obligations,
expressed in privacy preferences, are templates for future
instantiation of executable obligations. The scip:Obligation is
rdfs:subClassOf scip:ObligationTemplate. Obligations has
properties to express temporal constraints associated with an
obligation. For example, the second obligation requires
taking the training course (obtain_training_certificate) prior to
access. This obligation is encoded using scip:performAction
1 &lt;https://logRT.org/logevents/e4&gt; a l2tap:PrivacyEvent;
2 l2tap:memebrOf &lt;https://logRT.org&gt;;
3 l2tap:eventParticipant &lt;https://RT.org/ClinicalResearchers/Mark&gt;;
4 l2tap:eventTimestamp "2014-01-29T12:00:00Z"^^xsd:dateTime;
5 l2tap:publicationTimestamp "2014-01-29T12:01:00Z"^^xsd:dateTime;
6 l2tap:eventData &lt;https://logRT.org/logng/ng2&gt;.
7 &lt;https://logRT.org/logng/ng2&gt; = {
8 &lt;https://RT.org/requests/req1&gt; a scip:AccessRequest;
9 scip:dataRequestor &lt;https://RT.org/ClinicalResearchers/Mark&gt;;
10 scip:dataSender &lt;https://RT.org/participants/physionet&gt;;
11 scip:dataSubject &lt;https://mimicii.org/patients&gt;;
12 scip:dataItem &lt;https://mimicii.org/MEDITEM&gt;;
13 scip:purpose &lt;https://RT.org/purposes/clinical_research&gt;;
14 scip:requestorRole &lt;https://RT.org/roles/clinical_researcher&gt;;
15 scip:requestedPrivilege &lt;https://RT.org/privileges/read&gt; .}
(line 20). scip:occurrenceGap property in line 21 encodes the
relative time interval for performing the obligation (a
positive integer indicates occurrence after the access activity,
and a negative integer before). The scip:performanceDuration
property in line 22 encodes the time required to perform
the obligation. The third obligation is a post-obligation and
requires to be ful lled after access has been granted and
when a record deem to be identi able.
      </p>
      <p>Access Requests and Responses. The scip:AccessRequest
class is used to encode a request by a researcher to access
a dataset. A number of classes that we used to express
privacy policies (such as scip:DataItem, scip:Role, scip:Purpose,
scip:DataItem, and scip:DataRequestor) will also be used to
express access requests. An access request can be initiated by
a class of participants or an individual participant. In our
motivating scenario, we assume one of the researchers in the
team (Mark) uses the framework to log its access request
(cf. Fig. 6). Note that the who in the header of this log
event is Mark's URI (line 3) who is a member of clinical
researcher class. Line 8 encodes the Mark's access request
as an instance of scip:AccessRequest. The scip:dataRequestor
property in line 9 captures the URI of the data requestor
(Mark), scip:dataSender (line 10) captures who should send
the data (PhysioNet) while scip:dataSubject (line 11) captures
whose data has been requested (Patients class in MIMIC II
dataset). Similar to the privacy policies, we encode in line
12 the URI of requested data items (MEDITEMS: class of
all medications taken by patients), the purpose for accessing
data (line 13), and the roles of the participants requesting
access (line 14). The privacy privilege that has been requested
is encoded by scip:requestedPrivilege in line 15.</p>
      <p>
        The scip:AccessResponse class encodes the boolean response to
an access request as well as the applicable obligations. The
log event shown in Fig. 7 records the access response to the
Mark's request by dereferencing the corresponding access
request URI (line 9). Line 10 encodes the access decision.
Associated with each access response there could be a set of
applicable obligations. The quads in lines 11-17 encode one
of the obligations derived from privacy policies applicable to
the study. Lines 11 in this listing refers to the URI of the
corresponding obligations using scip:contextObligation. When
multiple obligations arise from an access request, a
propositional formula ' describes how the satisfaction of these
obligations relates to the overall compliance of the access
request. In our example scenario ' ob1 ^ ob2 ^ ob3, i.e.
1 &lt;https://logRT.org/logevents/e5&gt; a l2tap:PrivacyEvent;
2 l2tap:memebrOf &lt;https://logRT.org&gt;;
3 l2tap:eventParticipant&lt;https://logRT.org/participants/PN_ACLAgent&gt;;
4 l2tap:eventTimestamp "2014-01-30T19:01:00Z"^^xsd:dateTime;
5 l2tap:publicationTimestamp "2014-01-30T19:01:01Z"^^xsd:dateTime;
6 l2tap:eventData &lt;https://logRT.org/logng/ng4&gt;.
7 &lt;https://logRT.org/logng/ng4&gt; = {
8 &lt;https://RT.org/responses/res1&gt; a scip:AccessResponse;
9 scip:responseTo &lt;https://RT.org/requests/req1&gt;;
10 scip:accessDecision "True"^^xsd:boolean;
11 scip:contextObligation &lt;https://logRT.org/req1/obs/ob2&gt;;
12 scip:contextObligation &lt;https://logRT.org/req1/obs/ob3&gt;;
13 scip:propositionalExpression &lt;https://logRT.org/exp/phy1&gt; .
14 &lt;https://RT.org/req1/obs/ob2&gt; a scip:Obligation;
15 scip:createdFrom &lt;https://RT.org/obs/ob2&gt;.
16 &lt;https://RT.org/req1/obs/ob3&gt; a scip:Obligation;
17 scip:createdFrom &lt;https://RT.org/obs/ob3&gt;.}
all three obligations must be ful lled for the access to be
compliant. The scip:propositionalExpression property in line
13 encodes this formula. The rest of the quads in Fig. 7 links
each of the performable obligations to the corresponding
obligation templates in the privacy policy. So the
characteristics of each obligation such as the action and the temporal
constraints associated with the obligation become resolvable.
The who in this log event (line 3) is https://logRT.org/participa
nts/PN_ACLAgent indicating that the participant who has logged
the response is an ACL agent of PhysioNet, implementing
access control and obligation derivation. These mechanisms
are usually domain-dependent. In [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ] we described how
we can derive obligations from privacy preferences using
SPARQL queries. Obligations also can be derived using
moreor-less complex mechanisms. From the logging perspective
what is necessary is to have a mechanism in place to log
the access decisions and obligations, regardless of which
mechanism is used to control access or derive obligations.
When the obligations are derived from the privacy
preferences (obligation templates) and logged, the obligation
performer who can be the same participant as the data
requestor (Mark, the researcher) or a di erent participant
must ful ll the obligation in an acceptable time interval
and log its ful llment. SCIP has a number of properties
to capture the participant who should perform an
obligation (scip:obligationPerformer), the participant who actually
performs the obligation (scip:performedBy), the one who can
witness the violation of an obligation (scip:obligationWitness)
and the one who actually witnesses (scip:attestsViolation).
Obligation Acceptance. When the access response has
been logged, the research team (as the obligation performer)
accepts to perform the obligations. This event captures
the researcher's commitment as a performative act. The
performative act is the utterance of a self-describing act
which is performed by declaring that one is doing it [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Fig. 8
shows the log event for obligation acceptance. The event's
participant (line 3) is Mark, one of the registered researchers.
This event refers to the URI of the access response (line
9). By the virtue of logging this event, the researcher not
only acknowledges existence of the obligations but also as a
performative act commits himself to perform the obligations
as conditions to access.
1 &lt;https://logRT.org/logevents/e61&gt; a l2tap:PrivacyEvent;
2 l2tap:memebrOf &lt;https://logRT.org&gt;;
3 l2tap:eventParticipant &lt;https://RT.org/ClinicalResearchers/Mark&gt;;
4 l2tap:eventTimestamp "2014-01-31T12:01:00Z"^^xsd:dateTime;
5 l2tap:publicationTimestamp "2014-01-31T12:01:01Z"^^xsd:dateTime;
6 l2tap:eventData &lt;https://logRT.org/logng/ng9&gt;.
7 &lt;https://logRT.org/logng/ng9&gt; = {
8 &lt;https://RT.org/acceptances/acpt1&gt; a scip:ObligationAcceptance;
9 scip:accepts &lt;https://RT.org/responses/res1&gt;.}
Performing Obligation. In the scenario, one of the
research team members (Mark) is the participant who must
perform the obligations as conditions to access to the dataset.
The rst obligation (obtain_training_certificate) is a
preobligation, meaning that the research team must obtain the
certi cate and log this action as an evidence prior to access.
Fig. 9 shows a log event that captures the fact that Mark
has performed the rst obligation. Line 8 de nes the
performed obligation as an instance of scip:PerformedObligation
class. Line 9 refers to the URI of the corresponding
obligation logged in the access response. The participant who has
performed the obligation and the time instant of performing
the obligation are encoded using the scip:performedBy (line 10)
and scip:occurredIn (line 11) respectively. Note that Mark is
the who has submitted these quads to the log (line 3).
Access activity. Finally, SCIP has a class scip:AccessActivity
to record the occurrence of an access activity. Fig. 11 shows
the log event of an access activity when the research team
(including all its members) has accessed the dataset. Line 9
refers to the URI of the corresponding obligation acceptance
event using scip:forObligationAcceptance. Line 10 captures the
time instant that the access activity occurred. The
provenance assertions for this log event (line 3) shows that the
researcher is the participant who logs the access activities. We
assume that the data provider (PhysioNet) has also a
mechanism in place to log all accesses to its dataset. Therefore, if
the researcher fails to log an access activity the discrepancy
between the provider's access log and the L2TAP audit log
will trigger a non-compliance incident.
      </p>
      <p>The justi cation for leveraging the Linked Data
infrastructure and derferenceable URIs become evident as we walk
through the log events for the motivating scenario described
above. We summarized registration of the log events in
Fig. 11. Participants make statements about the events
in the log. Therefore, they need to access the events data
to dereference the past events URIs that may have been
1 &lt;https://logRT.org/logevents/e7&gt; a l2tap:PrivacyEvent;
2 l2tap:memebrOf &lt;https://logRT.org&gt;;
3 l2tap:eventParticipant&lt;https://RT.org/ClinicalResearchers/Mark&gt;;
4 l2tap:eventTimestamp "2014-02-02T00:01:00Z"^^xsd:dateTime;
5 l2tap:publicationTimestamp "2014-02-02T00:01:01Z"^^xsd:dateTime;
6 l2tap:eventData &lt;https://logRT.org/logng/ng6&gt; .
7 &lt;https://logRT.org/logng/ng6&gt; = {
8 &lt;https://RT.org/access/req1/ac1&gt; a scip:AccessActivity;
9 scip:forObligationAcceptance &lt;https://RT.org/acceptances/acpt1&gt;;
10 scip:occurredIn "2014-02-02T00:00:01Z"^^xsd:dateTime .}
logged by other participants in the di erent points in time.
For example, the privacy policies are registered by
PhysioNet on Jan 01, 2014, then the access request has been
logged by the research teams on Jan 29, 2014. The access
response event has been logged by the Physionet access
control agent on Jan 30th referring the URI of the access request
(scip:responseTo &lt;https://RT.org/requests/req1&gt;). The access
response also refers to the URIs of obligations registered by
PhysioNet as part of the privacy policies (e.g. scip:createdFrom
&lt;https://RT.org/obs/ob2&gt;). Analogously the log events encoding
the acceptance of obligations, ful lment of an obligation by
one of the researchers and the access activity logged by the
research team refer to the URIs of the other past log events.
The statements that each of these participants wants to make
depends on the URIs of the statements have been previously
logged.</p>
      <p>The events in Fig. 11 do not necessarily occur in the sequence
shown. Consider a scenario in which the researcher logs an
access to the dataset referencing an obligation acceptance's
URI. However, the researcher happens to not log an
obligation ful lment event corresponding to the access response.
So the access response's URI not be referred by a performed
obligation event and in turn the corresponding access request
would also not be referred. This results in a non-compliant
access request and the researcher would become accountable
for not logging the obligation ful lment event. Therefore,
the L2TAP+SCIP ontology relies on the URI dereferencing
to make actions of each participant transparent for other
participants involved in the process (of course for the
participants who have been authenticated) and provide support
for accountability and privacy.</p>
    </sec>
    <sec id="sec-5">
      <title>3. QUERY-BASED AUDITING</title>
      <p>The fundamental aspect of leveraging RDFS and Linked
Data to generate L2TAP logs is to facilitate privacy audit
tasks by queries over the created logs. In this section we
will rst discuss how the standard RDFS and computation
of transitive closures for the refs:subClassOf relationship can
be exploited to support query-bases audit tasks. Then we
describe three major audit tasks (constructing the log with
data usage policies, obligation derivation and ful lment, and
compliance checking ) that all can be supported by SPARQL
queries with a limited RDFS reasoning support. These tasks
involve several classes of participants including data provider,
data receiver (research teams), and auditors.</p>
      <p>RDFS Reasoning Support. By leveraging Linked Data
for privacy audit log we can achieve a exible way to deal
with data items granularity, participants granularity, and</p>
      <p>L2TAP Audit Log  
Access Request</p>
      <p>(Fig.6)
Obligation Acceptance</p>
      <p>(Fig. 8)
Performed Obligation</p>
      <p>(Fig. 9)
Access Activity
(Fig. 10)</p>
      <p>Privacy Policies</p>
      <p>(Fig. 4 &amp; 5)
Access Response
(Fig. 7)
applicable privacy policies. An individual's personal
information can span from a very speci c data item (e.g. the glucose
level in a blood work) to a very general data item (e.g. the
personal health record of an individual). Privacy policies and
regulations (e.g. HIPPA) are not only applicable to an entire
dataset but also may apply to a speci c class of data items
(e.g. mental health data) or a speci c class of individuals (e.g.
children under age of 12). Individuals (e.g. data subjects
in our scenario) may have options to express their personal
privacy preferences applicable to the instances of their data.
Expressing everything in the log (including data items,
participants, etc.) using dereferencable URIs provides the most
exible and generic way of representing resources involved in
privacy processes. Furthermore, RDF representation of audit
logs using L2TAP and SCIP ontologies allows both the URI
of a class of resources or URI of an instance of a resource
(participants or data items) to be dereferenced and reasoned
about using RDFS. As shown in Fig. 3 members of the class
of researchers are de ned using a named graph as a log event
payload. Exploiting rdfs:subClassOf allows to reason about
the entire class of researchers or a speci c individual in the
class when evaluating an obligation derivation query or a
compliance query as described below. With the same token
applicable privacy policies and preferences can be determined
for a class of data subjects, a class of data items, or for one
instance of the same classes.</p>
      <p>
        Log Construction. In our motivating scenario, the
research institute is the one who needs access to the datasets
for its researchers and also wants to keep its researchers
accountable with respect to the dataset usage policy.
Therefore, the research institute initializes the log and registers the
participants. The institute then uses the log in the future
and show to the interested auditors that its researchers are
compliant with the policies. On the other hand, the data
provider wants to be able to express the norms and
policies that govern the data usage. So the provider wants to
contribute to the log these policies and record all accesses
to datasets. We illustrated throughout Fig. 1-4 the set of
quads that need to be stored in an L2TAP log for these tasks.
All quads in these gures can be appended to an L2TAP
log using SPARQL 1.1 [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ] commands in three steps: rst
a named graph will be created for a log event using CREATE
GRAPH &lt;g&gt;, second the quads of the log header will be inserted
to the log default graph and then the quads of the log event
body will be inserted into the named graph using INSERT DATA
{GRAPH &lt;g&gt; { }}.
      </p>
      <p>
        Obligation Derivation. After the log is constructed, the
research teams (or an individual researcher) want to be able
to derive the obligations applicable to the class of data items
or data subjects that they want to access. This task can be
accomplished through computation of transitive closures for
the rdfs:subClassOf relationship. Norms in the SCIP ontology
are de ned in terms of data items, roles of participants who
want to use data items, purpose of usage, and requested
access privilege. All these concepts are expressed in SCIP by
a lattice using rdfs:subClassOf. For example children under
12 are rdfs:subClassOf data subjects. Therefore, a SPARQL
query with the RDFS reasoning support allows to match the
context of a set of privacy policies with the context of an
access request. The query conditions check that all instances
of data items, data subjects, roles, privacy privileges asked
by the research teams in the access request graph, can be
subsumed by the corresponding items in the privacy policies
graph. Then the output of the query will be applicable
obligations to that access request. The method has been
described in more details in our earlier publication
([
        <xref ref-type="bibr" rid="ref23">23</xref>
        ]Section 3).
      </p>
      <p>Compliance Checking. An important audit task is to
identify, at any given point in time, if an access request is in
compliance with the applicable privacy policies. Compliance
of an access request is decided based on the status of its
corresponding obligations. Therefore, a typical compliance
checking task will be performed in three steps as illustrated in
Algorithm 1. First multiple SPARQL ASK queries evaluate
the status of all individual obligation and return true for an
obligation if it is ful lled and false otherwise. The template
query shown in Fig. 12 can be used for evaluating the ful
lment of an obligation after the parameter @ob is substituted
with the URI of an obligation. A similar template query can
be used to evaluate a pending obligation (an obligation that
the conditions for its ful llment not yet settled).
For each access response a propositional formula will be
also logged indicating how the ful lment of an individual
obligation contributes to the overall compliance of an access
request. In our scenario the formula is ' ob1 ^ ob2 ^ ob3 i.e.
all three obligations must be ful lled for the access request
to be compliant. The second step in the algorithm is to
substitute the propositional variable in ' with the
truthvalues representing the state of every derived obligation.
Each obi in this formula will be substituted with oi which
can be true or false depending on the evaluation of the query
in Fig. 12.</p>
      <p>The third step in the algorithm is to substitute ' as a
propositional variable and evaluate the template query in Fig. 13
to check the overall compliance of the corresponding access
request. Note that in line 3 of the query in Fig. 13, we
include the graph encoding the access decision of the access
request. The ?accessDecision variable is a propositional
vari1 ASK
2 WHERE {
3 ?obAcc scip:accepts ?response.
4 ?response scip:responseTo ?request.
5 ?response scip:contextObligation @ob.
6 @ob rdf:type scip:Obligation.
7 @ob scip:occurrenceGap ?occGap.
8 @ob scip:performanceDuration ?pD.
9 OPTIONAL {?accessActivity scip:forObligationAcceptance ?obAcc}.
10 OPTIONAL {?accessActivity scip:accessedTime ?accessTime}.
11 OPTIONAL {?performedOb scip:performedFor @ob}.
12 OPTIONAL {?performedOb scip:performedBy ?performAgent}.
13 OPTIONAL {?performedOb scip:occurredIn ?obligationTime}.
14 OPTIONAL {?witness scip:attestsViolation @ob}.
15 FILTER (((!bound(?performAgent) &amp;&amp; !bound (?accessTime))
16 ||(bound (?accessTime) &amp;&amp; (xsd:integer(@currentTime) &lt; =
17 fn:max((xsd:integer(?accessTime) + xsd:integer(?occGap) + xsd:
integer (?pD)),
18 (xsd:integer(?accessTime) + xsd:integer(?occGap)))))) &amp;&amp;
19 (!bound(?witness))) }</p>
      <p>Algorithm 1: An algorithm for compliance checking
able that will be used in the expression in line 4 to evaluate
the access request compliance queries. The FILTER statement
is the conjunction of ' and ?accessDecision meaning that if
the access decision logged by the access control mechanism
is false even if all obligations are ful lled the access request
would be non-compliant.</p>
      <p>1 ASK
2 WHERE { ?response scip:responseTo @rq .
3 ?response scip:accessDecision ?accessDecision .</p>
      <p>
        4 FILTER (@phi &amp;&amp; xsd:boolean(?accessDecision)) }
A number of other compliance queries (e.g. which obligation
is pending or which access request is not compliant at time t ),
the experimental validation of the scalability of our solution,
and the practical bene ts of our approach are described in
[
        <xref ref-type="bibr" rid="ref23">23</xref>
        ].
      </p>
    </sec>
    <sec id="sec-6">
      <title>4. RELATED WORK</title>
      <p>
        Our research study is inspired by the concept of information
accountability as described by Witzner et al. [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ], that is
ensuring whether the policies and con gured preferences that
govern the ow of personal information, are respected by
the parties that collect, use, and share users' data. In an
early work on the management of policies and the
semantic web [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ], Kolovski et al. emphasize on the need for a
declarative access policies to support scalable information
sharing among parties. The authors then propose a
rulebased discretionary access control language for the web. In
[
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], Kagal et al. propose Rein, a policy framework grounded
in semantic web technologies. The authors acknowledge and
respect the diversity and heterogeneity of policy languages
on the web and propose Rein as an ontological framework
for policy interoperability. The ontology proposed in this
paper supports information accountability via privacy audit
logs and complements the Rein proposal [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] by providing
a SPARQL query based solutions for the basic compliance
checking queries.
      </p>
      <p>
        There are solid theoretical foundations for policy auditing
over logs [
        <xref ref-type="bibr" rid="ref2 ref3 ref5 ref9">2, 9, 3, 5</xref>
        ]. Barth et al. use Alternating-time
Temporal Logic to build a logical privacy model and design
a privacy language (LPU) to express norms [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. The concept
of norms in this work has been adapted from the
Contextual Integrity perspective [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ]. The LPU language allows all
communications between agents to be recorded in a logical
trace. Norms are expressed as logical constraints and privacy
compliance is related to the logical concepts of satis ability
and entailment. Datta et al. [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] extended the LPU language
with reasoning about information accountability over
incomplete logs. Basin et al. use metric rst order temporal logic
(MFOTL) to express policies, which are then monitored to
verify whether the trace of actions satis es desired temporal
properties [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Cederquist et al. describe a framework that
uses audit logs to enforce compliance with discretionary
access control policies [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. While this body of work propose
highly expressive privacy logic, lack of support by an scalable
semantic technology prevents the approaches to be applied
outside of research labs.
      </p>
      <p>
        An important related work is the recently proposed RDF
provenance model (PROV-DM) [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. The focus of PROV-DM
is on providing a domain independent ontology for asserting
provenance of a resource on the web. While the provenance
assertions of the L2TAP+SCIP log events (log event header)
can be expressed using PROV-DM ontology, the ontology
cannot support the structure needed to encode the semantics
of the body of privacy events (e.g. privacy preferences,
obligations, and purpose of usage). A simple mapping between
L2TAP and PROV-DM allows a log event (regardless of its
content) to be expressed by the PROV-DM ontology. The
mapping requires adding a prov:Activity (i.e. de ning a URI
for the act of generating the l2tap:LogEvent as a prov:Entity).
Then the assertion of the who, l2tap:eventParticipant, will
be mapped to the prov:wasAssociatedWith property. The two
L2TAP properties capturing the when assertions are mapped
to prov:startedAtTime and prov:endedAtTime respectively.
In recent years, we have seen several proposals addressing
privacy in the Linked Data context ([
        <xref ref-type="bibr" rid="ref18 ref22 ref7 ref8">22, 18, 7, 8</xref>
        ]). This body
of research are mainly proposing access control frameworks
based on access control lists (ACLs). Authors in [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ] propose
a privacy preferences vocabulary that can be utilized to
express ne-grained access policies in Linked Data environment.
Muhleisen et al. propose an access control mechanism for
social web applications [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]. This framework uses SWRL to
express access rules. Authors in [
        <xref ref-type="bibr" rid="ref12 ref7 ref8">12, 7, 8</xref>
        ] leverage the Linked
Data architecture for providing authorizations and access
restrictions at the document level [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. The authorization
mechanism in [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] is based on WebID [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ]. To address the
privacy concerns in the emerging domains of linked data
applications, Speiser et al. [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ] propose a privacy framework
for policy speci cation and access control enforcement.While
access control is a necessary mechanism to protect
individuals' privacy, it is not su cient to express and control data
usage policies. The work introduced in this paper addresses
privacy concepts such as usage purposes and obligations after
access.
      </p>
    </sec>
    <sec id="sec-7">
      <title>5. CONCLUSIONS</title>
      <p>
        While compliance auditing is mandated in di erent privacy
legislation (e.g. [
        <xref ref-type="bibr" rid="ref21 ref26">26, 21</xref>
        ]), it has received less attention from
the research community. In this paper we continued our work
in [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ] and showed that regardless of what logic is used to
express privacy policies there is a standard way for privacy
logging that allows basic privacy events to be logged and
provides a scalable query-based solution for answering
compliance queries. We also demonstrated that L2TAP Linked
Data Log is capable of facilitating basic privacy auditing
tasks such as: constructing the log, obligation derivation,
and compliance checking in the big data and linked data
research context. In our approach, the convenience of Linked
Data and RDFS has been sought for privacy log
interoperability and facilitating accountability and transparency among
participants.
      </p>
    </sec>
    <sec id="sec-8">
      <title>6. ACKNOWLEDGMENTS</title>
      <p>Financial supports from the NSERC Canada and Privacy
Awards from IBM and the Information and Privacy
Commissioner of Ontario are greatly acknowledged.We thank the
anonymous reviewers for their comments.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>J.</given-names>
            <surname>Austin</surname>
          </string-name>
          .
          <article-title>How to do things with words</article-title>
          , volume
          <volume>88</volume>
          . Harvard University Press,
          <year>1975</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>A.</given-names>
            <surname>Barth</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Datta</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. C.</given-names>
            <surname>Mitchell</surname>
          </string-name>
          , and
          <string-name>
            <given-names>H.</given-names>
            <surname>Nissenbaum</surname>
          </string-name>
          .
          <article-title>Privacy and contextual integrity: Framework and applications</article-title>
          .
          <source>In Proc. SP</source>
          , pages
          <volume>184</volume>
          {
          <fpage>198</fpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>D.</given-names>
            <surname>Basin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Klaedtke</surname>
          </string-name>
          , and
          <string-name>
            <surname>S.</surname>
          </string-name>
          <article-title>Muller. Policy monitoring in rst-order temporal logic</article-title>
          .
          <source>In Proc. CAV</source>
          , pages
          <volume>1</volume>
          {
          <fpage>18</fpage>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>J.</given-names>
            <surname>Carroll</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Bizer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Hayes</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P.</given-names>
            <surname>Stickler</surname>
          </string-name>
          .
          <article-title>Named graphs</article-title>
          .
          <source>Web Semantics: Science, Services and Agents on the World Wide Web</source>
          ,
          <volume>3</volume>
          (
          <issue>4</issue>
          ),
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>J.</given-names>
            <surname>Cederquist</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Corin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Dekker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Etalle</surname>
          </string-name>
          , J. den Hartog, and
          <string-name>
            <given-names>G.</given-names>
            <surname>Lenzini</surname>
          </string-name>
          .
          <article-title>Audit-based compliance control</article-title>
          .
          <source>Int. J. of Info. Security</source>
          ,
          <volume>6</volume>
          :
          <fpage>133</fpage>
          {
          <fpage>151</fpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>A.</given-names>
            <surname>Chuvakin</surname>
          </string-name>
          , E. Fitzgerald,
          <string-name>
            <given-names>R.</given-names>
            <surname>Marty</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Gula</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Heinbockel</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>McQuaid</surname>
          </string-name>
          .
          <source>Common event expression</source>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>L.</given-names>
            <surname>Costabello</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Villata</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Delaforge</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Gandon</surname>
          </string-name>
          , et al.
          <article-title>Linked data access goes mobile: Context-aware authorization for graph stores</article-title>
          .
          <source>In LDOW- WWW</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>L.</given-names>
            <surname>Costabello</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Villata</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O. R.</given-names>
            <surname>Rocha</surname>
          </string-name>
          , and
          <string-name>
            <given-names>F.</given-names>
            <surname>Gandon</surname>
          </string-name>
          .
          <article-title>Access control for http operations on linked data</article-title>
          .
          <source>In ESWC</source>
          , pages
          <volume>185</volume>
          {
          <fpage>199</fpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>A.</given-names>
            <surname>Datta</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Blocki</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Christin</surname>
          </string-name>
          , H. DeYoung,
          <string-name>
            <given-names>D.</given-names>
            <surname>Garg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Jia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Kaynar</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Sinha</surname>
          </string-name>
          .
          <article-title>Understanding and protecting privacy: formal semantics and principled audit mechanisms</article-title>
          .
          <source>In Proc. ICISS</source>
          , pages
          <volume>1</volume>
          {
          <fpage>27</fpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>A. L.</given-names>
            <surname>Goldberger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. A.</given-names>
            <surname>Amaral</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Glass</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. M.</given-names>
            <surname>Hausdor</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. C.</given-names>
            <surname>Ivanov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. G.</given-names>
            <surname>Mark</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. E.</given-names>
            <surname>Mietus</surname>
          </string-name>
          , G. B. Moody, C.
          <article-title>-</article-title>
          K. Peng, and
          <string-name>
            <given-names>H. E.</given-names>
            <surname>Stanley</surname>
          </string-name>
          . Physiobank, physiotoolkit, and
          <article-title>physionet components of a new research resource for complex physiologic signals</article-title>
          .
          <source>Circulation</source>
          ,
          <volume>101</volume>
          (
          <issue>23</issue>
          ):e215{
          <fpage>e220</fpage>
          ,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>T.</given-names>
            <surname>Heath</surname>
          </string-name>
          and
          <string-name>
            <given-names>C.</given-names>
            <surname>Bizer</surname>
          </string-name>
          .
          <article-title>Linked data: Evolving the web into a global data space</article-title>
          .
          <source>Synthesis Lectures on the Semantic Web: Theory and Tech</source>
          .,
          <volume>1</volume>
          (
          <issue>1</issue>
          ):1{
          <fpage>136</fpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>J.</given-names>
            <surname>Hollenbach</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Presbrey</surname>
          </string-name>
          , and
          <string-name>
            <given-names>T.</given-names>
            <surname>Berners-Lee</surname>
          </string-name>
          .
          <article-title>Using RDF metadata to enable access control on the social Semantic Web</article-title>
          .
          <source>In Proc. CCMLSK WS at CK</source>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>L.</given-names>
            <surname>Kagal</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Berners-Lee</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Connolly</surname>
          </string-name>
          , and
          <string-name>
            <given-names>D.</given-names>
            <surname>Weitzner</surname>
          </string-name>
          .
          <article-title>Using semantic web technologies for policy management on the web</article-title>
          .
          <source>In Proc of the National Conference on Arti cial Intelligence</source>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>V.</given-names>
            <surname>Kolovski</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Katz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Hendler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Weitzner</surname>
          </string-name>
          , and
          <string-name>
            <given-names>T.</given-names>
            <surname>Berners-Lee</surname>
          </string-name>
          .
          <article-title>Towards a policy-aware web</article-title>
          .
          <source>In Semantic Web and Policy Workshop at the ISWC</source>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>S.</given-names>
            <surname>Loosemore</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Stallman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>McGrath</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Oram</surname>
          </string-name>
          , and
          <string-name>
            <given-names>U.</given-names>
            <surname>Drepper</surname>
          </string-name>
          .
          <article-title>The GNU C library reference manual</article-title>
          .
          <source>Free software foundation</source>
          ,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>G. B.</given-names>
            <surname>Moody</surname>
          </string-name>
          and L.
          <string-name>
            <surname>Lehman</surname>
          </string-name>
          .
          <article-title>Predicting acute hypotensive episodes: The 10th annual physionet/computers in cardiology challenge</article-title>
          .
          <source>In Computers in Cardiology</source>
          , pages
          <volume>541</volume>
          {
          <fpage>544</fpage>
          . IEEE,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>L.</given-names>
            <surname>Moreau</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.</given-names>
            <surname>Missier.</surname>
          </string-name>
          PROV-DM:
          <article-title>The PROV data model</article-title>
          .
          <source>W3C Recomm</source>
          .,
          <source>W3C</source>
          ,
          <year>June 2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>H.</given-names>
            <surname>Mu</surname>
          </string-name>
          <article-title>hleisen, M. Kost, and</article-title>
          <string-name>
            <given-names>J.-C.</given-names>
            <surname>Freytag</surname>
          </string-name>
          .
          <article-title>SWRL-based Access Policies for Linked Data</article-title>
          .
          <source>In Proc. SPOT Workshop at SSW</source>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>Q.</given-names>
            <surname>Ni</surname>
          </string-name>
          , E. Bertino, and
          <string-name>
            <given-names>J.</given-names>
            <surname>Lobo</surname>
          </string-name>
          .
          <article-title>An obligation model bridging access control policies and privacy policies</article-title>
          .
          <source>In Proc. SACMAT</source>
          , pages
          <volume>133</volume>
          {
          <fpage>142</fpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>H.</given-names>
            <surname>Nissenbaum</surname>
          </string-name>
          .
          <article-title>Privacy in Context: Technology, Policy, and the Integrity of Social Life</article-title>
          . Stanford Law Books,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <article-title>O cial Journal of the EC</article-title>
          .
          <article-title>EU directive 95/46/EC on the protection of individuals rights with regard to the processing of personal data</article-title>
          ,
          <year>1995</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>O.</given-names>
            <surname>Sacco</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Passant</surname>
          </string-name>
          .
          <article-title>A privacy preference ontology (PPO) for Linked Data</article-title>
          .
          <source>In Proc. LDOW</source>
          , WWW,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>R.</given-names>
            <surname>Samavi</surname>
          </string-name>
          and
          <string-name>
            <given-names>M. P.</given-names>
            <surname>Consens.</surname>
          </string-name>
          <article-title>L2TAP+SCIP: An audit-based privacy framework leveraging Linked Data</article-title>
          .
          <source>In CollaborateCom (TrustCol)</source>
          , pages
          <fpage>719</fpage>
          {
          <fpage>726</fpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>S.</given-names>
            <surname>Speiser</surname>
          </string-name>
          .
          <article-title>Policy of composition? composition of policies</article-title>
          .
          <source>In Proc. POLICY</source>
          , pages
          <volume>121</volume>
          {
          <fpage>124</fpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>H.</given-names>
            <surname>Story</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Harbulot</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Jacobi</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Jones</surname>
          </string-name>
          . FOAF+
          <article-title>SSL: RESTful Authentication for the Social Web</article-title>
          .
          <source>In Proc. SPOT</source>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>US</given-names>
            <surname>Congress</surname>
          </string-name>
          .
          <source>Health Insurance Portability and Accountability Act of</source>
          <year>1996</year>
          ,
          <string-name>
            <given-names>Privacy</given-names>
            <surname>Rule</surname>
          </string-name>
          .
          <volume>45</volume>
          CFR 164,
          <string-name>
            <surname>Aug</surname>
          </string-name>
          .
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          <source>[27] US Department of Health and Human Services. Code of Federal Regulations, Title 45 - Part 46 - Protection of Human Subject, Revised January 15</source>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          <source>[28] W3C. RDF Vocabulary Description Language 1</source>
          .0:
          <string-name>
            <given-names>RDF</given-names>
            <surname>Schema. W3C</surname>
          </string-name>
          ,
          <year>April 2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          <source>[29] W3C. SPARQL 1</source>
          .
          <article-title>1 Query Language, W3C Proposed Recommendation</article-title>
          . W3C,
          <year>November 2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <given-names>D. J.</given-names>
            <surname>Weitzner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Abelson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Berners-Lee</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Feigenbaum</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Hendler</surname>
          </string-name>
          , and
          <string-name>
            <given-names>G. J.</given-names>
            <surname>Sussman</surname>
          </string-name>
          .
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          <article-title>Information accountability</article-title>
          .
          <source>Commun. ACM</source>
          ,
          <volume>51</volume>
          (
          <issue>6</issue>
          ):
          <volume>82</volume>
          {
          <fpage>87</fpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>