<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Capturing Scientific Knowledge for Water Resources Sustainability in the Rio Grande Area</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Natalia Villanueva-Rosales</string-name>
          <email>nvillanuevarosales@utep.edu</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Deana Pennington</string-name>
          <email>ddpennington@utep.edu</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Luis Garnica Chavira1</string-name>
          <email>luis@gitgudconsulting.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Raul Alejandro Vargas-Acosta</string-name>
          <email>ravargasaco@miners.utep.edu</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Alex S. Mayer</string-name>
          <email>asmayer@mtu.edu</email>
          <xref ref-type="aff" rid="aff4">4</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Smriti Rajkarnikar Tamrakar1</string-name>
          <email>smritirtamrakar@gmail.com</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Frank Ward</string-name>
          <email>fward@nmsu.edu</email>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Center for Environmental Resources &amp;</institution>
          ,
          <addr-line>Management</addr-line>
          ,
          <institution>University of Texas at El Paso</institution>
          ,
          <country country="US">US</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Cyber-ShARE Center of Excellence, Department of Computer Science, University of Texas at El Paso</institution>
          ,
          <country country="US">US</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Cyber-ShARE Center of Excellence, Geology Department, University of Texas at El Paso</institution>
          ,
          <country country="US">US</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Department of Agricultural Economics, and Agricultural Business, New Mexico State University</institution>
          ,
          <country country="US">US</country>
        </aff>
        <aff id="aff4">
          <label>4</label>
          <institution>Department of Civil and Environmental, Engineering, Michigan Technological University</institution>
          ,
          <country country="US">US</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>This paper presents our experience in capturing scientific knowledge for enabling the creation of user-defined modeling scenarios that combine availability and use of water resources with potential climate in the middle Rio Grande region. The knowledge representation models in this project were created and validated by an international, interdisciplinary team of scientists and engineers. These models enable the automated generation of water optimization models and visualization of output data and provenance traces that support the reuse of scientific knowledge. Our efforts include an educational and outreach component to enable students and a wide variety of stakeholders (e.g., farmers, city planners, and general public) to access and run water models. Our approach, the Integrated Water Sustainability Modeling Framework, uses ontologies and light-weight standards such as JSON-LD to enable the exchange of data across the different components of the system and third-party tools, including modeling and visualization tools. Future work includes the ability to automatically integrate further models (i.e., model integration).</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>CCS CONCEPTS</title>
      <p>• Computer methodologies → Artificial intelligence
Knowledge representation and reasoning
→
1</p>
    </sec>
    <sec id="sec-2">
      <title>INTRODUCTION</title>
      <p>
        The Middle Rio Grande watershed is comprised of parts of southern
New Mexico and far west Texas in the U.S. and northern
Chihuahua in Mexico. Figure 1 contains a map illustrating the
study area of this project modified from [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ] using Google My
Maps. Over the past 100 years, the Middle Rio Grande has been the
primary source of water in this desert region, providing water for
substantive irrigated agriculture and to three municipalities with a
combined population of over 2 million people. The surface water
in the region is highly managed in accordance with national
treaties, state compacts, and water rights that date back well over a
century [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ]. However, due to recent periods of severe drought and
growing demand, the river alone no longer meets regional water
needs, leading to increased groundwater use and dropping water
tables [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]. Sustainable water management in this region faces a
number of drivers of change, including: 1) climate change that is
impacting both water supply and demand [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]; 2) agricultural
practices and trends, including high water demand crops and
greater reliance on groundwater for irrigation [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]; 3) urban growth
[
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]; and 4) growing demand for environmental services such as
riverside habitat and environmental flows [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. A core question is
how can water be managed so that the three competing sectors—
agricultural, urban, and environmental—can realize a
sustainable future in this challenged water system?
      </p>
      <p>
        Investigating potential ways to achieve long term water
sustainability requires the use of simulation models that integrate
the biophysical workings of the natural system with human choices
that impact the system. Such modeling approaches enable the
computational testing of alternative climate, population, and water
use scenarios that can improve understanding of the coupled
human-natural system and facilitate discussion among researchers,
water managers, and other stakeholders [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ]. A wide range of water
models exist – typically focusing on one aspect of the system (e.g.
groundwater, surface water, or water economics). Exploring
potential solutions to water sustainability requires integration
across these aspects, addressed by researchers from different
disciplines using different modeling approaches [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Yet the
resulting infrastructure must be lightweight, usable, and useful for
people with a wide range of technical skills –
including
stakeholders who may have limited modeling and technical
experience [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
      </p>
      <p>
        This paper discusses the efforts of a large, interdisciplinary
group to create a water modeling framework to address this
problem. Our solution, the Integrated Water Sustainability
Modeling Framework or IWASM for short, combines hydrologic
biophysical models [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] with an economic optimization model [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ]
into a “bucket model” implemented in the General Algebraic
Modeling System (GAMS) [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. Bucket model is a longstanding
phrase used by hydrologic modelers for models that consider water
storage as a set of buckets that have inflows (increasing storage)
and outflows (decreasing storage). The IWASM bucket model
simulates major water sources, uses and losses and water supply
constraints to improve our understanding of hydrology, agronomy,
institutions, and economics that guide analysis of policy and
management and answer questions important to stakeholders. A
key challenge in this collaborative project was developing a shared
understanding of team members’ expertise and how their research
could contribute to a more comprehensive whole. Integration of
deep knowledge has been identified as one of seven key challenges
confronting interdisciplinary teams [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. One approach to
overcoming this challenge is to facilitate structured team
interactions that expose team members to vocabulary, concepts,
and methods with which they may be unfamiliar [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ]. The team
must evolve their understanding of the problem from initially
illstructured, vague, and incomplete to well-structured, explicitly
represented, and integrated across disciplines.
      </p>
      <p>
        Our approach uses knowledge representation languages and
tools to automate the exchange of data between IWASM modules
and third-party tools. IWASM Web-based interfaces support the
use of the bucket model by stakeholders. A provenance trace
describes the people, institutions, entities, and activities involved in
producing, influencing, or delivering some of data or thing [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ].
Capturing provenance for the execution model, including
information about the model, input parameters, and output
variables aims to support the understanding and reusability of the
bucket model. The representation of data and provenance in this
project is further described in sections 2 and 3. One example of
reusing provenance trace is the visualization of provenance through
a third-party visualization suite with minimal effort. We envision
that other tools that can ingest data in standard Web-based
languages such as JSON-LD [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] and the Web Ontology Language
- OWL [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ] will further demonstrate the ability to share and reuse
scientific knowledge and resources using knowledge representation
languages.
      </p>
    </sec>
    <sec id="sec-3">
      <title>IDENTIFIYING DATA AND KNOWLEDGE</title>
    </sec>
    <sec id="sec-4">
      <title>FOR WATER SUSTAINABILITY</title>
    </sec>
    <sec id="sec-5">
      <title>MODELING IN THE RIO GRANDE AREA</title>
      <p>
        Due to the interdisciplinary nature of this project, the modeling
team was exposed in the early stages to artifacts such as concept
maps that allowed them to represent and negotiate the minimal
information needed to communicate with members from
disciplines including Computer Science, Civil Engineering,
Hydrology and Agriculture. Concept maps, diagrams, and Excel
files were generated to create a shared understanding of the bucket
model, its inputs, output, and parameters as well as the semantics
of these data. Through several workshops and meetings, the
modeling and the development team identified the importance of
keeping track of data sources, user-defined parameters, and
workflow steps every time an instance of the model was generated.
The need of tracking provenance information was also identified
by potential end-users of IWASM through a survey [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]. This
survey was taken by 36 scientists and students working on water
resources modeling in the El Paso – Juarez border area during the
Regional Water Symposium in January 2017 at the University of
Texas at El Paso. Respondents came from a diverse pool of
disciplines, including: Water Sustainability, Hydrology, Geology,
Environmental Science, Economics, and Computer Science. After
a short demo of IWASM, the respondents answered a list of
questions using a five-point from “strongly disagree” to “strongly
agree” and open-ended questions. Survey results showed that most
of the respondents considered it important to know the source of
the data (88% of respondents responded agree or strongly agree).
Moreover, 88% of the respondents indicated that knowing the
source of the parameters used in the model would instill trust in the
model and 81% of respondents indicated that data and model
provenance increased their trust to use or reproduce a water model
generated from IWASM. Similarly, 88% of the respondents
considered important to know how the data was manipulated to
generate a water model. In addition, 85% of respondents considered
that it would be easier for them to replicate a water model if the
provenance of data and workflow is provided to them along with
the model outputs. A slightly smaller percentage of respondents
(69%) indicated that they were willing to spend additional time
annotating data sources and workflows so that other people could
reuse them. In general, respondents indicated that a provenance
trace is important for them. This survey, along with input of the
research team influenced the design decisions for modelling
metadata, including provenance, in IWASM.
3
      </p>
    </sec>
    <sec id="sec-6">
      <title>CAPTURING DATA AND KNOWLEDGE</title>
    </sec>
    <sec id="sec-7">
      <title>FOR WATER SUSTAINABILITY</title>
      <p>
        The bucket model requires a variety of data inputs that originate
from multiple decoupled sources and heterogeneous formats, e.g.,
spreadsheets, database records or full text documents. To integrate
these data and formats, JSON-LD was chosen due to its lightweight
characteristic of serializing Linked Data. Most of the data retrieved
to execute the bucket model in IWASM is transformed
semiautomatically by using third-party transformation, e.g.,
CSV-toJSON [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Data is manually curated and annotated with vocabulary
describing modeling or provenance concepts e.g., agriculture, thus
IWASM extends JSON-LD standards.
      </p>
      <p>{ "modelOutputs" : [{
"varLabel" : "Discounted Net Regional Farm Income",
"varCategory" : "Summary",
"varName" : "T_ag_ben_v",
"varValue" : [{
"p" : "1-policy_hist",
"w" : "1-w_supl_base",
"value" : 1884324.28 }],
"varDescription" : "Discounted net present value of regional
farm income",
"varUnit" : "1000 USD" }],
"@context": {
"modelOutputs": "http://purl.org/wf4ever/wfdesc#Output",
"rdfs" : "http://www.w3.org/2000/01/rdf-schema/",
"sio" : "http://semanticscience.org/resource/"
"varLabel": { "@id": "rdfs:label", "@type": "xsd:string"},
"varCategory": { "@id": "sio:SIO_000137",</p>
      <p>"@type": "xsd:string"
} } }</p>
    </sec>
    <sec id="sec-8">
      <title>AUTOMATING THE DATA INTEGRATION</title>
    </sec>
    <sec id="sec-9">
      <title>AND EXCHANGE OF DATA IN THE</title>
    </sec>
    <sec id="sec-10">
      <title>WATER SUSTAINABILITY MODEL</title>
      <p>{"@id": "Step5: model-outputs",
"@type": "prov:Entity",
"wasGeneratedBy": "review-and-run",
"wasAttributedTo": "Modeling Agent",
"wasDerivedFrom": "List of Variables",
"Modeling Agent": [{
"@id": "prov:SoftwareAgent",
"@type": "@id",
"hasName": "The General Algebraic
(GAMS)",</p>
      <p>"hasURL": "https://www.gams.com/" }],
"@context": {
"prov" : "http://www.w3.org/ns/prov#",
"sch" : "http://schema.org/",
"wasGeneratedBy" : "prov:wasGeneratedBy",
"wasAttributedTo" : "prov:wasAttributedTo",
"wasDerivedFrom" : "prov:wasDerivedFrom",
"hasName" : "sch:name",
"hasURL" : "sch:url"</p>
      <sec id="sec-10-1">
        <title>Modeling</title>
        <p>} }</p>
      </sec>
      <sec id="sec-10-2">
        <title>System</title>
      </sec>
    </sec>
    <sec id="sec-11">
      <title>CAPTURING PROVENANCE IN IWASM</title>
      <p>
        The bucket model requires a large number of data sources, fixed
parameters, and customizable parameters. In this project, we used
a design pattern for workflow execution described in the wprov
namespace which has also been used by the research team in the
context of biodiversity modeling [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]. A design pattern in the
context of this project is a generic, yet customizable, solution that
prov:wasInformedBy
wprov:humanintervention
wprov:hadNextStep
wprov:climate
      </p>
      <p>selection
wprov:hadNextStep
prov:used
water-model
wprov:userworkflow
prov:wasInformedBy</p>
      <p>prov:wasInformedBy
prov:wasInformedBy
wprov:customizeparameters
wprov:hadParameter
wprov:review-and</p>
      <p>run
wprov:hadNextStep</p>
      <p>Water Stocks
prov:hadMember</p>
      <p>Urban Water Use</p>
      <p>Farm Income
prov:hadMember
prov:hadMember
prov:wasGeneratedBy</p>
      <p>prov:wasDerivedFrom
prov:wasAssociatedWith</p>
      <p>prov:wasAttributedTo
list-of-variables
model-outputs
wprov:Modeling</p>
      <p>Agent</p>
      <p>Water Price Elasticity</p>
      <p>of Demand
Urban Average Cost
prov:hadMember list-of-parameters
prov:hadMember</p>
      <p>
        Namespaces
prov: https://www.w3.org/ns/prov-o
wprov: http://ontology.cybershare.utep.edu/wprov
provides a template to represent generic elements and their
relationships. The provenance captured in IWASM is mapped to
PROV-O and other widely-used controlled vocabularies including
the Workflow Description (wfdesc) [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ] and Dublin Core
Metadata Initiative (dcterms) [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ]. The provenance trace captured
in IWASM captures the main components of the user-scenario
execution including: workflow information, user-scenario
execution steps, inputs, parameter collection, and output (variable)
results.
      </p>
      <p>Figure 4 shows a graphical representation of a user-scenario
execution provenance trace in IWASM. The wprov:user-workflow
represents the overall user-scenario execution composed by a series
of steps and uses the water-model (bucket model), as a guideline to
execute a series of steps. The PROV-O property
prov:wasInformedBy links the wprov:user-workflow with specific
steps executed, e.g., wprov:human-intervention. Each workflow
step is connected to the previous step by the wprov:hadNextStep
relation.</p>
      <p>The wprov:list-of-parameters, an extension of prov:Collection,
is linked to each parameter wprov:Parameter sent to the bucket
model implementation in GAMS through the property
prov:hadMember. Steps in the user-scenario execution, e.g.,
wprov:review-and-run, are linked to the wprov:ModelingAgent that
is an extension of prov:Agent, using the property
prov:wasAssociatedWith relation. The outputs of the
wprov:review-and-run step are annotated as wprov:model-outputs
and linked to this step with the prov:wasGeneratedBy property.
The wprov:model-outputs are linked to a wprov:list-of-variables,
an extension of prov:Collection, through the property
prov:wasDerivedFrom. The wprov:list-of-variables is linked to
output variables and their values through the property
prov:hadMember.</p>
      <p>
        The automated generation of provenance in IWASM uses
metadata from the bucket model and the workflow provenance
pattern currently stored in an instance of the MongoDB [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]
database. The wprov workflow provenance pattern, also
represented in JSON, is used to automatically generate the
provenance trace of a user-scenario execution. The user-scenario
execution provenance is merged with additional model metadata
into a single provenance JSON-LD file illustrated in Figure 5. The
integrated JSON-LD file can be directly downloaded or shared as a
link with other users and can be consumed by third-party tools such
as the JSON visualization tool used in IWASM - described in the
following section.
6
      </p>
    </sec>
    <sec id="sec-12">
      <title>VISUALIZING PROVENANCE TO INSTILL</title>
    </sec>
    <sec id="sec-13">
      <title>TRUST AND PROMOTE REUSABILITY</title>
      <p>
        The JSON-LD generated by IWASM can be reused by third-party
applications due to the use of standard languages. A module to
visualize metadata and provenance trace of user-scenario execution
is provided by IWASM using the third-party tool jsonld-vis [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]
(Figure 5). This open-source visualization tool constructs a
visualization graph of JSON-LD files. A few modifications to the
services provided by jsonld-vis were performed in order to generate
a workflow-like visualization. Figure 5 shows the provenance for
the outputs of the model including the modeling agent.
      </p>
    </sec>
    <sec id="sec-14">
      <title>PRELIMINARY EVALUATION</title>
      <p>
        From the scientific perspective, a standard model evaluation
approach was used to verify that the model works as intended and
produces believable results. This approach relies on selecting a time
period to simulate for which observational data exists - in this case
reservoir capacity, streamflow at two gauges, and groundwater
depth in specific wells were used. The data are subdivided into two
parts [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. The first part is used to calibrate the model (training
dataset) and the second part is used to test how well results match
observations. A twenty-year period from 1994 to 2013 was used.
Simulated results for this time period were strongly correlated with
observations, indicating the model has acceptable validity.
      </p>
      <p>To verify that the infrastructure created was generating the same
results as if the modeling tool GAMS was executed directly we
used a black box approach - a model with the same inputs was
generated both using GAMS directly and using the Web interface.
The outputs of the two models were compared to make sure they
were the same and thus verify that the Web-based graphical user
interface, web service executions, and the infrastructure created
was generating the expected results.</p>
      <p>From the end-user perspective, we evaluated the usability of the
graphical user interface in a number of ways. Initially we asked
team members and others affiliated with the project to step through
a series of tasks and provide feedback through a survey as described
in section 2. Then, we asked other participants in two workshops to
step through the same tasks and provide feedback, both through a
survey and facilitated discussion. Lastly, we recruited five students
with agricultural backgrounds to test the interface, assuming they
would more closely represent our agricultural stakeholders.</p>
      <p>We are in the process of incorporating suggestions from
endusers into current versions of the bucket model and graphical user
interface.
8</p>
    </sec>
    <sec id="sec-15">
      <title>CONCLUSIONS</title>
      <p>This paper reports in our efforts towards providing a Web-based
platform – IWASM that enables the generation of user-scenario
executions of the bucket model that integrates biophysical
workings of nature with human choices that impact IWASM. User
scenarios include alternative climate, population, and water usage
that can improve understanding of the coupled human-natural
system and facilitate discussions and policy making among a wide
range of stakeholders. This highly-interdisciplinary endeavor used
proven techniques for knowledge negotiation, including the
creation of concept models, and the development of common
vocabularies through ontologies and knowledge representation
languages that enable the integration and exchange of data through
the Web. The requirements elicitation process as well as the
development of IWASM was driven by the interdisciplinary
research team of this project along with input from potential
endusers. As a result, IWASM provides a friendly interface that
enables user-scenario executions of the bucket model as well as
outputs of the system with a provenance trace serialized as a
JSONLD file. The provenance visualization module illustrates the reuse
of JSON-LD files by third-party tools and fosters the understanding
and reusability of models by end-users, including stakeholders that
may not be familiar with modeling systems.
9</p>
    </sec>
    <sec id="sec-16">
      <title>FUTURE WORK</title>
      <p>
        The bucket model is constantly evolving to support additional
features such as the dynamic generation of parameters. IWASM is
also being updated to support these changes. We are in the process
of incorporating additional models of water including simulation
models of water consumption using different modeling tools. Our
ultimate goal is to enable users to ask English-like scientific
questions that will trigger the automatic selection and execution of
a modeling algorithm exposed as a Semantic Web Service based on
our previous work on workflow orchestration for biodiversity
sciences [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. This new feature will also assist end-users in the
selection of parameters using context provided by ontologies.
Additional data will be needed for new versions of the data model,
including data provided by members of the research team in
Mexico. These data introduces the challenge of integrating data
collected through different survey protocols, different unit scales
(e.g., Metric instead of English) and languages (e.g., Spanish). We
will pursue the use of further ontologies and ontology mappings to
automate the integration of these data that ultimately represents
different perspectives in studying water sustainability.
ACKNOWLEDGMENTS
This material is based upon work that is supported by the National
Institute of Food and Agriculture, U.S. Department of Agriculture,
under award number 2015-68007-23130 “Sustainable water
resources for irrigated agriculture in a desert river basin facing
climate change and competing demands: From characterization to
solutions”. Authors would like to thank the valuable contributions
of the research team (scientists and students) participating in this
project and the GAMS developers. Special thanks to Bill Hargrove,
Joe Heyman, Dave Gutzler, Alfredo Granados, Zhuping Sheng,
Jose Caballero, and Sarah Sayles for their contributions to this
work, and Ismael Villanueva-Miranda for the generation of Figure
1. This work used resources from Cyber-ShARE Center of
Excellence, which is supported by National Science Foundation
grant number HRD-0734825.
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Belete</surname>
            ,
            <given-names>G.F.</given-names>
          </string-name>
          et al.
          <year>2017</year>
          .
          <article-title>An overview of the model integration process: From pre-integration assessment to testing</article-title>
          .
          <source>Environmental Modelling &amp; Software. 87</source>
          ,
          <string-name>
            <surname>Supplement</surname>
            <given-names>C</given-names>
          </string-name>
          (
          <year>Jan</year>
          .
          <year>2017</year>
          ),
          <fpage>49</fpage>
          -
          <lpage>63</lpage>
          . DOI:https://doi.org/10.1016/j.envsoft.
          <year>2016</year>
          .
          <volume>10</volume>
          .013.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>Bennett</surname>
            ,
            <given-names>N.D.</given-names>
          </string-name>
          et al.
          <year>2013</year>
          .
          <article-title>Characterising performance of environmental models</article-title>
          .
          <source>Environmental modelling &amp; software. 40</source>
          , (
          <year>2013</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>20</lpage>
          . DOI:https://doi.org/10.1016/j.envsoft.
          <year>2012</year>
          .
          <volume>09</volume>
          .011.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Consortium</surname>
            ,
            <given-names>W.W.W.</given-names>
          </string-name>
          <year>2014</year>
          .
          <article-title>JSON-LD 1.0 : a JSON-based serialization for linked data</article-title>
          .
          <source>(Jan</source>
          .
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Cooke</surname>
            ,
            <given-names>N.J.</given-names>
          </string-name>
          <year>2015</year>
          .
          <article-title>Enhancing the Effectiveness of Team Science</article-title>
          . The National Academies Press.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5] CSV to JSON - CSVJSON:
          <year>2014</year>
          . http://www.csvjson.com/csv2json. Accessed:
          <fpage>2017</fpage>
          -11-22.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>Del</given-names>
            <surname>Rio</surname>
          </string-name>
          ,
          <string-name>
            <surname>N.</surname>
          </string-name>
          et al.
          <year>2013</year>
          .
          <article-title>ELSEWeb meets SADI: Supporting Data-to-model Integration for Biodiversity Forecasting</article-title>
          .
          <source>Discovery Informatics Symposium</source>
          (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>Dumontier</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          et al.
          <year>2014</year>
          .
          <article-title>The Semanticscience Integrated Ontology (SIO) for biomedical research and knowledge discovery</article-title>
          .
          <source>J. Biomedical Semantics</source>
          .
          <volume>5</volume>
          , (
          <year>2014</year>
          ),
          <fpage>14</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>GAMS</given-names>
            <surname>- Cutting Edge</surname>
          </string-name>
          Modeling:
          <year>2017</year>
          . https://www.gams.com/. Accessed:
          <fpage>2017</fpage>
          -10-05.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>Green</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          et al.
          <year>2015</year>
          .
          <article-title>Freshwater ecosystem services supporting humans: Pivoting from water crisis to water solutions</article-title>
          .
          <source>Global Environmental Change</source>
          .
          <volume>34</volume>
          ,
          <string-name>
            <surname>(Sep</surname>
          </string-name>
          .
          <year>2015</year>
          ),
          <fpage>108</fpage>
          -
          <lpage>118</lpage>
          . DOI:https://doi.org/10.1016/j.gloenvcha.
          <year>2015</year>
          .
          <volume>06</volume>
          .007.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Guha</surname>
            ,
            <given-names>R.V.</given-names>
          </string-name>
          et al.
          <year>2016</year>
          . Schema.Org:
          <article-title>Evolution of Structured Data on the Web</article-title>
          .
          <source>Commun. ACM</source>
          .
          <volume>59</volume>
          ,
          <issue>2</issue>
          (Jan.
          <year>2016</year>
          ),
          <fpage>44</fpage>
          -
          <lpage>51</lpage>
          . DOI:https://doi.org/10.1145/2844544.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Gutzler</surname>
            ,
            <given-names>D.S.</given-names>
          </string-name>
          <year>2013</year>
          .
          <article-title>Regional climatic considerations for borderlands sustainability</article-title>
          .
          <source>Ecosphere. 4</source>
          ,
          <issue>1</issue>
          (Jan.
          <year>2013</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>12</lpage>
          . DOI:https://doi.org/10.1890/ES12-00283.1.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <article-title>jsonld-vis: Turn JSON-LD into pretty graphs: 2015</article-title>
          . https://github.com/scienceai/jsonld-vis.
          <source>Accessed: 2017-11-26.</source>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>Kelly</surname>
          </string-name>
          (Letcher), R.A. et al.
          <year>2013</year>
          .
          <article-title>Selecting Among Five Common Modelling Approaches for Integrated Environmental Assessment and Management</article-title>
          .
          <source>Environ. Model. Softw</source>
          . 47,
          <string-name>
            <surname>C (</surname>
          </string-name>
          <article-title>Sep</article-title>
          .
          <year>2013</year>
          ),
          <fpage>159</fpage>
          -
          <lpage>181</lpage>
          . DOI:https://doi.org/10.1016/j.envsoft.
          <year>2013</year>
          .
          <volume>05</volume>
          .005.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <surname>Lebo</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          et al.
          <year>2013</year>
          .
          <article-title>Prov-o: The prov ontology</article-title>
          .
          <source>W3C Recommendation</source>
          , 30th April.
          <article-title>(</article-title>
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <surname>Loucks</surname>
            ,
            <given-names>D.P.</given-names>
          </string-name>
          <article-title>and</article-title>
          <string-name>
            <surname>van Beek</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          <article-title>Water Resource Systems Planning</article-title>
          and Management - An | Daniel P. Loucks | Springer.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <surname>McDonald</surname>
            ,
            <given-names>R.I.</given-names>
          </string-name>
          et al.
          <year>2014</year>
          .
          <article-title>Water on an urban planet: Urbanization and the reach of urban water infrastructure</article-title>
          .
          <source>Global Environmental Change</source>
          .
          <volume>27</volume>
          ,
          <string-name>
            <surname>(Jul</surname>
          </string-name>
          .
          <year>2014</year>
          ),
          <fpage>96</fpage>
          -
          <lpage>105</lpage>
          . DOI:https://doi.org/10.1016/j.gloenvcha.
          <year>2014</year>
          .
          <volume>04</volume>
          .022.
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17] MongoDB:
          <year>2007</year>
          . https://www.mongodb.com. Accessed:
          <fpage>2017</fpage>
          -11-22.
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <surname>Moreau</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Groth</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <year>2013</year>
          .
          <article-title>Provenance: An Introduction to PROV</article-title>
          .
          <source>Synthesis Lectures on the Semantic Web: Theory and Technology</source>
          .
          <volume>3</volume>
          ,
          <issue>4</issue>
          (Sep.
          <year>2013</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>129</lpage>
          . DOI:https://doi.org/10.2200/S00528ED1V01Y201308WBE007.
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19] OWL 2
          <string-name>
            <given-names>Web</given-names>
            <surname>Ontology Language Document Overview (Second Edition</surname>
          </string-name>
          ):
          <year>2012</year>
          . https://www.w3.org/TR/owl2-overview/. Accessed:
          <fpage>2017</fpage>
          -07-10.
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <surname>Pennington</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          et al.
          <year>2016</year>
          .
          <article-title>The EMBeRS project: employing model-based reasoning in socio-environmental synthesis</article-title>
          .
          <source>Journal of Environmental Studies and Sciences. 6</source>
          ,
          <issue>2</issue>
          (Jun.
          <year>2016</year>
          ),
          <fpage>278</fpage>
          -
          <lpage>286</lpage>
          . DOI:https://doi.org/10.1007/s13412- 015-0335-8.
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>Rajkarnikar</given-names>
            <surname>Tamrakar</surname>
          </string-name>
          ,
          <string-name>
            <surname>S.</surname>
          </string-name>
          <year>2017</year>
          .
          <article-title>Describing Data and Workflow Provenance Using Design Patterns and Controlled Vocabularies</article-title>
          . ETD Collection for University of Texas, El Paso.
          <source>(Jan</source>
          .
          <year>2017</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>72</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <surname>Sheng</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          <year>2013</year>
          .
          <article-title>Impacts of groundwater pumping and climate variability on groundwater availability in the Rio Grande Basin</article-title>
          .
          <source>Ecosphere. 4</source>
          ,
          <issue>1</issue>
          (Jan.
          <year>2013</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>25</lpage>
          . DOI:https://doi.org/10.1890/ES12-00270.1.
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <article-title>The Wfdesc ontology (wfdesc</article-title>
          ):
          <year>2015</year>
          . http://lov.okfn.org/dataset/lov/vocabs/wfdesc. Accessed:
          <fpage>2017</fpage>
          -10-26.
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>USDA</given-names>
            <surname>Project CAP Study Area</surname>
          </string-name>
          :
          <year>2015</year>
          . http://purl.org/iwasm/basemapmeta. Accessed:
          <fpage>2017</fpage>
          -11-22.
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <surname>Walsh</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <year>2013</year>
          .
          <article-title>Water infrastructures in the U.S./Mexico borderlands</article-title>
          .
          <source>Ecosphere. 4</source>
          ,
          <issue>1</issue>
          (Jan.
          <year>2013</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>20</lpage>
          . DOI:https://doi.org/10.1890/ES12-00268.1.
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <surname>Ward</surname>
            ,
            <given-names>F.A.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Crawford</surname>
            ,
            <given-names>T.L.</given-names>
          </string-name>
          <year>2016</year>
          .
          <article-title>Economic performance of irrigation capacity development to adapt to climate in the American Southwest</article-title>
          .
          <source>Journal of Hydrology</source>
          .
          <volume>540</volume>
          , (
          <year>2016</year>
          ),
          <fpage>757</fpage>
          -
          <lpage>773</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <surname>Weibel</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          et al.
          <year>1998</year>
          .
          <article-title>Dublin core metadata for resource discovery</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <surname>Zvoleff</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          and
          <string-name>
            <surname>An</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          <year>2014</year>
          .
          <article-title>Analyzing Human-Landscape Interactions: Tools That Integrate</article-title>
          .
          <source>Environmental Management</source>
          .
          <volume>53</volume>
          ,
          <issue>1</issue>
          (Jan.
          <year>2014</year>
          ),
          <fpage>94</fpage>
          -
          <lpage>111</lpage>
          . DOI:https://doi.org/10.1007/s00267-012-0009-1.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>