<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Privacy Requirement Modeling and Verification in Cloud Computing</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>College of Computer Science and Technology Nanjing University of Aeronautics and Astronautics Nanjing</institution>
          ,
          <country country="CN">China</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>-Cloud computing, the architecture which shares dynamic heterogeneous characteristics in the cross-layer service composition, has affected traditional security, trust and privacy mechanisms which are mainly based on data encryption and access control. Approaches that can support accurate privacy requirement description and verifiable compliance between the privacy requirement and system practice need to be developed to fit this new paradigm. To tackle the issues of privacy requirement modeling and verification in cloud computing, a framework that supports model checking consistency, entailment and compliance with the formal definition of privacy requirements and privacy model of cloud application is proposed. This paper provides an overview of the scientific research problem, approaches to solve the problem and ways to evaluate the solution found by the research related PhD thesis.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>I. PROBLEM</title>
      <p>
        Scalability, on-demand access and network-based message
delivery are three core characteristics of cloud computing [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
As a scalable and hierarchical distributed collaboration
paradigm, cloud computing is envisioned as an XaaS (X As a
Service) architecture, combined with the advantage of reducing
cost by sharing computing and storage resources [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Although
there is a large push towards cloud computing, security and
privacy are the major challenges which inhibit the cloud
computing’s wide acceptance in practice. A survey conducted
by the US Government Accountability Office (GAO) states
that “22 of 24 major federal agencies reported that they were
either concerned or very concerned about the potential
information security and privacy risks associated with cloud
computing” [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Different from the traditional architecture in
which users have full control of their privacy data, the internal
operations of cloud computing software systems are usually
transparent to the users and once the privacy data of the users
are collected, they will lose control over it.
      </p>
      <p>
        The essence of privacy protection in cloud computing is the
rights and obligations of individuals and service providers with
respect to the collection, use, disclosure, and retention of PII
(Personally Identifiable Information) [
        <xref ref-type="bibr" rid="ref4 ref5">4,5</xref>
        ]. Providing verifiable
mechanism in design phase to ensure that the practice of
software is compliant with the privacy requirement is one of
the most important principles in privacy related standards and
regulations such as OECD [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] and ISO29100 [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. The issues
appearing in this principle are manifold.
      </p>
      <p>Firstly, we need an approach to precisely describe the
privacy requirement. On the one hand, due to the ambiguous
and inconsistent essence, natural language is essentially
unusable to depict a user concerned privacy requirement. On
the other hand, directly using a specification language, such as
Linear Temporal Logic (LTL) and Description Logics (DL), is
too complicated to be implemented by the requirements
analysts and system designers. Therefore, we must establish
one privacy requirement description method that can make a
balance between the expressiveness and the applicability.</p>
      <p>Secondly, considering the multi-participant and outsource
nature of cloud computing, we must guarantee there is no
conflict among different participants which means the privacy
requirement among different participants should be
consistent with each other.</p>
      <p>Thirdly, some laws and regulations in different
application contexts, such as the Children Online Privacy
Protection Act (COPPA), the Health Information Portability
and Accountability Act (HIPAA) and the Gramm–Leach–
Bliley Act (GLBA), are proposed to enforce the privacy
requirements of each participant and we must make sure the
privacy requirements entail certain privacy regulations and
laws.</p>
      <p>Finally, we need to verify the compliance between the
cloud computing system practice and requirements. To
support the verification, a formal model of privacy
requirements and the specified cloud computing privacy model
are needed. Moreover, to overcome the space explosion
dilemma in traditional model checking, there should be some
reduction method to make our verification represent real-life
systems and not just toy examples.</p>
    </sec>
    <sec id="sec-2">
      <title>II. RELATED WORK</title>
    </sec>
    <sec id="sec-3">
      <title>A. Privacy Requirement Description</title>
      <p>Current privacy policy definition methods can be classified
into four categories, access control model based on
RBAC(Role-Based Access Control), access control models
using Markup Language, Semantic-web policy frameworks
using description logic and declarative language with formal
semantics.</p>
      <p>
        For the first category, RBAC is an access control model in
which access rights are specified in terms of roles. As an access
control model, RBAC lacks the notion of privacy data and
purpose and is insufficient for directly modeling privacy policy.
Privacy-Aware Role-Based Access Control (PARBAC) model
[
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] notices the partial relations in roles, purpose and data
subject and combined RBAC with Chandramouli’s DAFMAT
framework. There is no formal semantics about the relations
and interactions in the model, therefore consistency and
compliance checking is not feasible with it. P-RBAC [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], is the
first privacy data centric RBAC expansion. However, the
authors did not present any formal model for the condition and
obligation except the policy in natural language which makes
that policy unusable for verifying compliance and can only
check the consistency in a limited context.
      </p>
      <p>
        For access control models using Markup Language,
XACML defines a general-purpose access control system and
provides a privacy profile in [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. XACML leaves obligation
interpretation and rule conflict detection to the application.
Therefore, the semantics of an XACML policy cannot be fully
specified by the policy itself which makes the formal semantics
rely on specified application and cannot do the consistency and
compliance checking with the model itself. IBM proposed a
language called EPAL [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] to encode privacy policies. Similar
to XACML, the language is based on XML and uses a set of
attributes called vocabularies. The main issue about EPAL is
that the obligation definition is natural language based and hard
to expand to support formal semantics. The Platform for
Privacy Preferences (P3P) is a privacy language intended for
use by web site operators in informing their visitors of their
data practices [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. P3P policies were not originally intended to
describe the exchange of privacy data among multi participants
context. In describing data collection requirements, all
requirements in P3P are categorical with fixed options which
makes it impossible to expand to adapt different domains and
application contexts. P3P also lacks a formal semantics, which
may have led to language misuse.
      </p>
      <p>
        For Semantic-web policy frameworks, naturally, the Web
Ontology Language (OWL) and its predecessors can depict
classification hierarchies with data type constraints. The
Description logic behind those languages is a subset of
firstorder logic for expressing knowledge. Some frameworks such
as KAoS [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] and Rei [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] that contains an OWL policy
ontology are proposed for expressing rights, prohibitions, and
obligations. Eddy [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] further extends previous work with the
formal model and consistency checking method. Bearing on the
limitation of Description logic, these methods cannot describe
temporal constraints and can hardly work with the data
implementation model of a specified system to check the
compliance.
      </p>
      <p>
        For declarative language with formal semantics, May et al.
[
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] introduce privacy APIs, which is a logical framework that
includes a language to express permissions using commands.
The policies are further formalized in the Promela
modelchecking language and can be checked using the model checker
SPIN. However, the only temporal constraints in this method
are “Opt-In” and “Opt-Out” that restricts the expressiveness to
a very limited scale. Barth et al. [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] propose a Linear
Temporal Logic (LTL) based framework CI (Contextual
Integrity) for expressing and reasoning about norms of
transmission of personal information. This method describes
requirements with the logic formula directly which are proven
too awkward to implement by the requirement analyzer and do
not have the feasibility of reality. S4P, a declarative language
to express privacy preferences and policies are proposed in [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ].
The method provides a formal semantics and proof rules for
their language. S4P is at a higher abstraction level than our
work. The purpose of S4P is to check the consistency between
user preference and privacy policy.
      </p>
    </sec>
    <sec id="sec-4">
      <title>B. Privacy Requirement Verification</title>
      <p>
        Y. Li et al. [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ] establish the mapping between business
process execution language (BPEL) and P3P policy and verify
the privacy requirements in P3P. A state machine based
model is proposed and extended to monitor the compliance of
privacy agreements and verify the time properties in privacy
requirements at the runtime [
        <xref ref-type="bibr" rid="ref20 ref21">20,21</xref>
        ]. Barth et. al [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ] use LTL
formula to depict and verify privacy properties in service
composition. Our team also does research on privacy modeling
and verification with interface automaton and hyper-graph.
These works, however, mostly focus on the SOAP web service
and do not consider the hierarchical and the heterogeneous
feature of cloud computing.
      </p>
    </sec>
    <sec id="sec-5">
      <title>C. Cloud Computing Modeling and Verification</title>
      <p>
        In Cloud computing environments, different types of
services co-exist and collaborate with each other to offer a final
system. Numerous studies have already been carried out on
modeling the most common cloud computing service, Restful
and SOAP services, and their combination. In Restful Service
modeling, some semi-formal and formal models, such as UML
state diagram, Petri Net and finite state machine, are proposed
to depict the Restful service from different aspects. In SOAP
service modeling, some standards, such as BPEL and
WSCDL, have been proposed to reduce the complexity required to
compose web services, hence reducing time and costs, and
increase overall efficiency in businesses. To verify functional
and non-functional properties, these standards are further
extended and formalized by transition system [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ], process
algebra [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ] and Petri Net [
        <xref ref-type="bibr" rid="ref31">31</xref>
        ]. Some research realize the
cross-layer service composition nature of cloud computing and
propose some approaches to analyze different aspects ranging
from resource management model [
        <xref ref-type="bibr" rid="ref32">32</xref>
        ] to information store
model [
        <xref ref-type="bibr" rid="ref33">33</xref>
        ]. None of the aforementioned approaches focus on
privacy analysis which makes modeling privacy properties in
cloud computing still an open challenge.
      </p>
    </sec>
    <sec id="sec-6">
      <title>III. PROPOSED SOLUTION</title>
      <p>To mitigate the aforementioned challenges in Section I, an
approach considering four aspects, i.e., definition,
formalization, reduction and verification, respectively, is
proposed.</p>
      <p>On the privacy requirement side, the start point of our
solution is to precisely describe privacy actions and constraints.
Based on refinement of current privacy protection standards
and regulations, we systematically analyze the partial order
relation among privacy datum, roles and purposes and define
the meta-model of privacy action(Fig 1) as a basis for the
privacy model checking.</p>
      <p>Fig 1 Privacy Action meta model.</p>
      <p>To express the occurrence condition and obligations of
privacy action, we further design three categories of event
templates, EXISTENCE, BINARY RELATION and PLURAL
RELATION, respectively. The declarative nature of our event
templates makes them easy to use by privacy analyzers. To
support the formal verification, we map each event to the
corresponding LTL formula. Table 1 are some typical events
and their corresponding LTL mapping. Considering the
influence of partial order relations, we also give the formal
definition and detection algorithm of privacy action inclusion
relationship. Different from traditional LTL formulas which
can monitor two or more properties simultaneously, our model
is safely assumed to be a single event system. Using generated
LTL formula and inclusion relationship, we can finally achieve
the single event finite automaton to do the consistency and
entailment checking.</p>
      <p>Let us take one key constraint , “Online Service does not
collect personal information from any visitor prior to collecting
age information”, in §312. 2 of COPPA as an example. With
our language, this term can be represented by two privacy
actions and one event constraint as follow ( we use T to
represent universal set and \ for relative complement , OS and
SP are the abbreviation of Online Service and Service
Provider):</p>
      <p>p1 = &lt;{(User, age) },(Collect, T), (Operator, User),
( OS,SP),Φ&gt;</p>
      <p>p2 = &lt;{(User, PII \ age)},(Collect, T), (Operator, User),
(OS, SP),Φ&gt;</p>
      <p>e1= Prior( p1, p2)</p>
      <p>On the cloud computing system side, when services in SaaS
usually use SOAP/WS-*, most products in IaaS and PaaS, such
as OCCI, OpenStack, mOSAIC, Google Map, Yahoo!Local,
are Restful service based. To verify the privacy requirement in
cloud computing system, we need to formally define these two
kinds of service and present a model can depict the multi-layer
collaboration between these heterogeneous services. Firstly, a
TABLE1 EVENT TEMPLATE EXAMPLES</p>
      <p>Template Description LTL Mapping
Least(n, a) a will occur at least n ◇(a∧○( Least(n-1,a) )
times.</p>
      <p>Response(a, b) Every a is eventually (a  ◇(b))
followed by at least
one b.
(Mau,Blti)OptionResp Ibfeaatoclecausrts,ontheerperimvaucsyt (a  ◇(b1  b2  ... bn))
action in B occurs
after a.
formal model that can map privacy action and atomic service
request/response are stated. For SOAP service, this mapping is
apparent and directly based on WSDL description. For Restful
service, on the other hand, the HATEOAS (Hypermedia As
The Engine Of Application State) constraint makes the internal
transition more complex. To correctly represent those
transitions caused by the iteration relation between resources
and links, our approach defines a resource link mapping tree
and then transforms that tree to the automaton. Furthermore, a
cross-layer interaction model will be created based on the
atomic service model and control flow.</p>
      <p>One of the most severe challenges for verifying the
crosslayer model is the state space explosion. The state space for 30
services composition can reach 106 or more which makes
verifying real-life cases impossible before reduction. In our
approach, both the privacy requirement and the privacy
operations of the cloud computing system can be formalized as
a transition system where the privacy actions are used as the
transition guards. A lot of elements in privacy actions are
disjoint with each other, privacy datum and participant for
example. Taking advantage of these disjoint elements, we can
achieve the partial model from the original formal model. For
example, the privacy datum set we want to verify is { name,
address, email }, we can obtain the sub-models for name ,
address and email respectively and just check each sub-model
instead of checking the whole formal model. To generate the
sub-model of one specified privacy datum, we firstly get all the
privacy actions containing that privacy datum. Then we
analyze the transitions that will affect or be affected by these
privacy actions and finally remove those transitions which have
no relation to the specified privacy datum from the original
formal model.</p>
    </sec>
    <sec id="sec-7">
      <title>IV. PRELIMINARY WORK</title>
      <p>
        We started our work by examining the minimum privacy
disclosure in SOA architecture [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ]. When analyzing the state
of art privacy regulations and standards, we realized most
current privacy requirement definition methods lack a
theoretical foundation and therefore is not amenable to
verification or reasoning. Futhermore, developed from SOA,
cloud computing introduces multi-layer and heterogeneous
service collaboration which makes privacy protection a more
complex challenge. We list most relevant up-to-date work and
achieved results as below:
- We have introduced an XML based privacy requirement
language which preliminarily approaches the problem of
expressing temporal constraints [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ]. To give the privacy
requirement more precise and formal semantics, we
further defined a declarative privacy policy language with
its formal model [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ];
We have focused on the privacy data in SOAP and
Restful service and established the formal privacy model
for these two types of services [
        <xref ref-type="bibr" rid="ref26 ref27">26,27</xref>
        ] which are the basis
of cloud computing;
We have analyzed the privacy data with the predicate
constraints in SOAP service composition and get a
feasible path generation method that can support our
future verification [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ].
      </p>
      <p>
        We have conducted a study aimed at reducing the state
space of privacy requirement and verifying the
consistency among different privacy requirements [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ].
      </p>
    </sec>
    <sec id="sec-8">
      <title>V. EXPECTED CONTRIBUTIONS</title>
      <p>We are currently working on several directions, that will
address the following contributions.</p>
      <p>From the privacy requirement modeling aspect, a privacy
action meta-model and declarative requirements definition
language are proposed. Constraints templates and their LTL
mapping are stated to support formal specification generation.
A Formal semantics of that language based on an automaton
are established to support further model checking. The privacy
action inclusion relationships are introduced to reduce the state
space in model checking.</p>
      <p>From the cloud computing privacy modeling aspect, the
privacy model for most common service –Restful and SOAP
in cloud computing are proposed based on mapping between
system behavior and privacy action. A formal model
supporting multi-layer structure and heterogeneous service
collaboration in cloud computing will be represented based on
Restful and SOAP privacy model.</p>
      <p>From the privacy requirement verification aspect, an
automaton partition method will be presented to mediate the
state space explosion issue in model checking. A series of
prototype toolkits will be implemented to provide
semiautomated privacy data extraction, privacy requirement
definition and verification.</p>
      <p>The main contribution can be summarized as follows.
- A declarative privacy requirement language with
formal semantics
- A formal privacy model for cloud computing
- A model checking Reduction method based on
transition relationship and privacy datum feature.</p>
    </sec>
    <sec id="sec-9">
      <title>VI. PLAN FOR EVALUATION AND VALIDATION</title>
      <p>We plan to validate and evaluate our work from three
aspects: correctness, feasibility and performance.</p>
      <p>
        At the correctness side, to measure the expressive power of
our privacy requirements modeling approach, we will compare
our method with other related works using the following
criterias: Hierarchical data structure support, Role support,
Purpose Specification support, Temporal constraints support,
Privacy operation definition support, Compliance checking
support, Consistency checking support and User readable.
Those criterias are retrived from the OECD, ISO 29100 and
other related standards. To evaluate the verification
correctness, we plan to conduct an experiment using the same
data in [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] and compare our conflict detection result with
theirs.
      </p>
      <p>At the feasibility side, we intend to conduct a set of real
case study to model COPPA, HIPAA and the policies from the
related service providers to check the limitation of our privacy
requirements modeling method and determine which kind of
policies can be or cannot be modeled with our approach.
Furthermore, we aim to model some open-source cloud
computing applications which include both Restful and SOAP
service interactions to analyze the compliance of the privacy
requirement.</p>
      <p>At the performance side, we intend to conduct several
experiments based on the benchmark from [34] and to
investigate the following indicators:
− Number of specifications
− Number of privacy datum items;
− Number of constraints
− Number of privacy action inclusion constraints;
− Number of application states in cloud system</p>
    </sec>
    <sec id="sec-10">
      <title>VII. CURRENT STATUS</title>
      <p>Currently, we are proposing a declarative privacy policy
language with the formal semantics that is expected to be the
input of our further consistency and entailment verification.
The case study and performance evaluation will be performed
in parallel with our theoretical research. To finalize our work,
we identify the following tasks that will lead to a Ph.D.
dissertation. The planned timeline in terms of the expected
contributions and current status (dash line) is shown in Figure 2.
•
•
•
•
•
•
To model the privacy requirement with the formal
semantics (T1);
To verify the consistency of privacy requirements
based on reduction formal specification (T2);
To provide a verification approach for the entailment
of privacy regulation and laws (T3);
To define mappings between cloud computing
behavior and privacy action (T4);
To study the privacy model of cloud computing that
can reflect the hierarchical and heterogeneous
characteristics (T5);
To implement a semi-automated privacy framework
for supporting to extract privacy, data definition from
the system (T6);
•</p>
      <p>To evaluate our work by case study and performance
experiment (T7);
To finish the Ph.D. thesis and dissertation (T8).</p>
    </sec>
    <sec id="sec-11">
      <title>ACKNOWLEDGMENT</title>
      <p>This research has been supported by This work is
supported in part by the National Science Foundation of China
under grants (No.61272083, No.61373137, No.61373017)</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Foster</surname>
          </string-name>
          ,
          <string-name>
            <surname>Ian</surname>
          </string-name>
          , et al.
          <article-title>"Cloud computing and grid computing 360- degree compared</article-title>
          .
          <source>" Grid Computing Environments Workshop</source>
          ,
          <year>2008</year>
          . GCE'
          <volume>08</volume>
          .
          <string-name>
            <surname>Ieee</surname>
          </string-name>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>Fox</surname>
          </string-name>
          ,
          <string-name>
            <surname>Armando</surname>
          </string-name>
          , et al.
          <article-title>Above the clouds: A Berkeley view of cloud computing</article-title>
          .
          <source>Dept. Electrical Eng. and Comput. Sciences</source>
          , University of California, Berkeley, Rep. UCB/EECS 28 (
          <year>2009</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>GAO</surname>
          </string-name>
          , “Information Security:
          <article-title>Additional Guidance Needed to AddressCloud Computing Concerns,” United States Government Accountability Office (GAO</article-title>
          ),
          <source>October 6</source>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Pearson</surname>
            ,
            <given-names>Siani.</given-names>
          </string-name>
          <article-title>"Taking account of privacy when designing cloud computing services</article-title>
          .
          <source>" Proceedings of the 2009 ICSE Workshop on Software Engineering Challenges of Cloud Computing. IEEE Computer Society</source>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>Pearson</surname>
            , Siani, and
            <given-names>Andrew</given-names>
          </string-name>
          <string-name>
            <surname>Charlesworth</surname>
          </string-name>
          .
          <article-title>"Accountability as a way forward for privacy protection in the cloud." Cloud computing</article-title>
          . Springer Berlin Heidelberg,
          <year>2009</year>
          .
          <fpage>131</fpage>
          -
          <lpage>144</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <article-title>[6] Organisation for Economic Co-operation and Development. OECD Guidelines on the Protection of Privacy and Transborder Flows of Personal Data</article-title>
          .
          <source>OECD Publishing</source>
          ,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7] ISO/IEC 29100.
          <article-title>Information technology - Security techniquesPrivacy framework</article-title>
          .
          <source>ISO/IEC 29100 (1st edition)</source>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>Q.</given-names>
            <surname>He</surname>
          </string-name>
          .
          <article-title>Privacy enforcement with an extended role-based access control model</article-title>
          ,
          <source>NCSU Computer Science Technical Report TR2003-09</source>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>Q.</given-names>
            <surname>Ni</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Bertino</surname>
          </string-name>
          &amp;
          <string-name>
            <surname>J. Lobo</surname>
          </string-name>
          ,“
          <article-title>An Obligation Model Bridging Access Control Policies and Privacy Policies,”</article-title>
          <source>in Proc. of ACM SACMAT</source>
          , pp.
          <fpage>133</fpage>
          -
          <lpage>142</lpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <article-title>OASIS</article-title>
          .
          <article-title>XACML's Privacy profile</article-title>
          . Available: http://www.oasisopen.org/committees/document.php?document _id=37643&amp;wg_abbrev=xacml
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>P.</given-names>
            <surname>Ashley</surname>
          </string-name>
          et al.,
          <source>“Enterprise Privacy Authorization Language (EPAL)</source>
          ,
          <source>” Research Report RZ 3485, IBM Research</source>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>Cranor</surname>
            <given-names>L</given-names>
          </string-name>
          et al,
          <article-title>Platform for privacy preferences (P3P) specification</article-title>
          . W3C working group note,
          <year>2006</year>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>Uszok</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bradshaw</surname>
            <given-names>JM</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lott</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Breedy</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bunch L</surname>
          </string-name>
          .
          <article-title>New developments in ontology-based policy management: increasing the practicality and comprehensiveness of KAoS</article-title>
          , In: IEEE workshop
          <article-title>on policies for distributed systems and networks</article-title>
          ,pp
          <fpage>145</fpage>
          -
          <lpage>152</lpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <surname>Tonti</surname>
            <given-names>G</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bradshaw</surname>
            <given-names>JM</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jeffers</surname>
            <given-names>R</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Montanari</surname>
            <given-names>R</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Suri</surname>
            <given-names>N</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Uszok</surname>
            <given-names>A</given-names>
          </string-name>
          .
          <article-title>Semantic web languages for policy representation and easoning: a comparison of KAoS, Rei</article-title>
          , and Ponder, LNCS
          <volume>2870</volume>
          :
          <fpage>419</fpage>
          -
          <lpage>437</lpage>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <surname>T. D. Breaux</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          <string-name>
            <surname>Hibshi</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Rao</surname>
          </string-name>
          .
          <article-title>Eddy, a formal language for specifying and analyzing data flow specifications for conflicting privacy requirements</article-title>
          ,
          <source>Requirements Engineering</source>
          , pages
          <fpage>1</fpage>
          -
          <lpage>27</lpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <surname>May MJ. Privacy</surname>
          </string-name>
          <article-title>APIs: formal models for analyzing legal and privacy requirements</article-title>
          ,
          <source>Ph.D. Thesis</source>
          , University of Pennsylvania,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>A.</given-names>
            <surname>Barth</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Datta</surname>
          </string-name>
          , J. Mitchell, and
          <string-name>
            <given-names>H.</given-names>
            <surname>Nissenbaum</surname>
          </string-name>
          .
          <article-title>Privacy and contextual integrity: Framework and applications</article-title>
          ,
          <source>In IEEE Symposium on Security and Privacy</source>
          , pages
          <fpage>184</fpage>
          -
          <lpage>198</lpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>M. Y.</given-names>
            <surname>Becker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Malkis</surname>
          </string-name>
          , L. Bussard,
          <article-title>S4P: A generic language for specifying privacy preferences and policies</article-title>
          ,
          <source>Technical Report MSR-TR-2010-32</source>
          , Microsoft Research,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Benbernou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Paik</surname>
          </string-name>
          , and
          <string-name>
            <given-names>B.</given-names>
            <surname>Benatallah</surname>
          </string-name>
          .
          <article-title>Formal consistency verification between bpel process and privacy policy</article-title>
          .
          <source>Proc of Privacy</source>
          Security Trust PST'
          <year>2006</year>
          . New York, NY, USA : ACM
          <year>2006</year>
          :
          <fpage>212</fpage>
          -
          <lpage>224</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <surname>Salima</surname>
            <given-names>Benbernou</given-names>
          </string-name>
          , Hassina Meziane,
          <string-name>
            <surname>Mohand-Said Hacid</surname>
          </string-name>
          .
          <article-title>RunTime Monitoring for Privacy-Agreement Compliance</article-title>
          .
          <source>LNCS 4749 : Proc of ICSOC</source>
          <year>2007</year>
          , Berlin: Springer,
          <year>2007</year>
          :
          <fpage>353</fpage>
          -
          <lpage>364</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <surname>Karima</surname>
            <given-names>Mokhtari</given-names>
          </string-name>
          , Salima Benbernou,
          <string-name>
            <surname>Mohand-Said</surname>
            <given-names>Hacid</given-names>
          </string-name>
          , Emmanuel Coquery, Frank Leymann.
          <article-title>Verification of Privacy Timed Properties in Web Service Protocols</article-title>
          .
          <source>Proc of IEEE SCC</source>
          <year>2008</year>
          , Washington: IEEE 2008:
          <fpage>593</fpage>
          -
          <lpage>594</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <surname>Adam</surname>
            <given-names>Barth</given-names>
          </string-name>
          , John Mitchell, Anupam Datta, and
          <string-name>
            <given-names>Sharada</given-names>
            <surname>Sundaram</surname>
          </string-name>
          .
          <article-title>Privacy and utility in business processes</article-title>
          .
          <source>Proc of Computer Security Foundations Symposium</source>
          , Washington: IEEE,
          <year>2007</year>
          :
          <fpage>279</fpage>
          -
          <lpage>294</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <surname>Liu</surname>
            , Linyuan,
            <given-names>Haibin</given-names>
          </string-name>
          <string-name>
            <surname>Zhu</surname>
            , and
            <given-names>Zhiqiu</given-names>
          </string-name>
          <string-name>
            <surname>Huang</surname>
          </string-name>
          .
          <article-title>"Analysis of the minimal privacy disclosure for web services collaborations with role mechanisms."</article-title>
          <source>Expert Systems with Applications 38.4</source>
          (
          <year>2011</year>
          ):
          <fpage>4540</fpage>
          -
          <lpage>4549</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <surname>Lu</surname>
            <given-names>Jiajun</given-names>
          </string-name>
          , Huang Zhiqiu,
          <string-name>
            <surname>Wang Jin</surname>
          </string-name>
          , et al.
          <article-title>Behavior-oriented privacy policy description for Web services composition</article-title>
          .
          <source>Journal of Frontiers of Computer Science and Technology</source>
          ,
          <year>2013</year>
          ,
          <volume>7</volume>
          (
          <issue>7</issue>
          )：
          <fpage>592</fpage>
          -
          <lpage>601</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <surname>Wang</surname>
            <given-names>Jin</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Huang</given-names>
            <surname>Zhiqiu</surname>
          </string-name>
          .
          <article-title>Privacy Requirement Modeling and Consistency Checking in Cloud Computing</article-title>
          .
          <source>Journal of Computer Research and Development</source>
          .
          <year>2015</year>
          ,
          <volume>52</volume>
          (
          <issue>10</issue>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <surname>Cai</surname>
            Zheng-ping, Huang Zhi-Qiu,
            <given-names>Wang</given-names>
          </string-name>
          <string-name>
            <surname>Jin</surname>
          </string-name>
          , et. al.
          <source>Research of Web Services Composition Transaction Coordination Framework based on BPEL and WS-TX. Computer Science</source>
          .
          <volume>39</volume>
          .6 (
          <year>2012</year>
          ):
          <fpage>120</fpage>
          -
          <lpage>124</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <surname>Tie</surname>
            <given-names>Wei</given-names>
          </string-name>
          , Huang Zhi-Qiu,
          <article-title>Wang Jin</article-title>
          .
          <article-title>BPEL based asynchronous interaction and composition of RESTful Web Service</article-title>
          .
          <source>Computer Engineering &amp; Science. 35.4</source>
          (
          <year>2013</year>
          ):
          <fpage>29</fpage>
          -
          <lpage>36</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <surname>Wang</surname>
            <given-names>Jin</given-names>
          </string-name>
          ,
          <article-title>Huang Zhi-qiu ,Tang Jiajun, et</article-title>
          . al.
          <article-title>Predicate Constraint Oriented BPEL Modeling and Feasible Path Analysis</article-title>
          .
          <source>Journal of Computer Research and Development</source>
          .
          <year>2015</year>
          ,
          <volume>51</volume>
          (
          <issue>4</issue>
          ):
          <fpage>838</fpage>
          -
          <lpage>847</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <surname>Foster</surname>
            <given-names>H</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Uchitel</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Magee</surname>
            <given-names>J</given-names>
          </string-name>
          , et al .
          <article-title>Model-based verification of web service compositions</article-title>
          .
          <source>Proc of 18th IEEE Int Conf on Automated Software Engineering. Piscataway</source>
          , NJ: IEEE,
          <year>2003</year>
          :
          <fpage>152</fpage>
          -
          <lpage>163</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <surname>Ferrara</surname>
            <given-names>A.</given-names>
          </string-name>
          <article-title>Web services: A process algebra approach</article-title>
          .
          <source>Proc of 2nd ACM Int Conf on Service Oriented Computing. Yew York : ACM</source>
          ,
          <year>2003</year>
          :
          <fpage>242</fpage>
          -
          <lpage>251</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [31]
          <string-name>
            <surname>Ouyang</surname>
            <given-names>Chun</given-names>
          </string-name>
          , Verbeek Eric,
          <string-name>
            <surname>Wil M.P</surname>
          </string-name>
          , et al.
          <article-title>Formal semantics and analysis of control flow in WS-BPEL</article-title>
          .
          <source>Science of Computer Programming</source>
          ,
          <year>2007</year>
          ,
          <volume>67</volume>
          (
          <issue>2</issue>
          /3),
          <fpage>162</fpage>
          -
          <lpage>198</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          [32]
          <string-name>
            <surname>De</surname>
            <given-names>Boer</given-names>
          </string-name>
          , Frank S., et al.
          <article-title>"Formal modeling of resource management for cloud architectures: An industrial case study." Service-Oriented and Cloud Computing</article-title>
          . Springer Berlin Heidelberg,
          <year>2012</year>
          .
          <fpage>91</fpage>
          -
          <lpage>106</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          [33]
          <string-name>
            <surname>Fitch</surname>
          </string-name>
          , Daniel F., et. al.
          <article-title>"A Petri Net Model for Secure</article-title>
          and
          <source>FaultTolerant Cloud-Based Information Storage." SEKE</source>
          .
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          <string-name>
            <surname>Westergaard</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Better Algorithms for Analyzing and Enacting Declarative Workflow Languages Using LTL</article-title>
          , In: Rinderle,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Toumani</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            ,
            <surname>Wolf</surname>
          </string-name>
          ,
          <string-name>
            <surname>K. (eds.) BPM</surname>
          </string-name>
          <year>2011</year>
          .
          <article-title>LNCS</article-title>
          , vol.
          <volume>6896</volume>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>