<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Uncertainty Aware Wildfire Management</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Tina Diao</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Samriddhi Singla</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ayan Mukhopadhyay</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ahmed Eldawy</string-name>
          <email>eldawyg@ucr.edu</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ross Shachter</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Mykel Kochenderfer</string-name>
          <email>mykelg@stanford.edu</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Stanford University</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>University of California</institution>
          ,
          <addr-line>Riverside</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2020</year>
      </pub-date>
      <abstract>
        <p>Recent wildfires in the United States have caused many lives and billions of dollars, destroying countless structures and forests. Fighting wildfires is extremely complex. It is difficult to observe the true state of fires due to smoke and risk associated with ground surveillance. There are limited resources to be deployed over a massive area and the spread of the fire is challenging to predict. This paper proposes a decisiontheoretic approach to combat wildfires. We model the resource allocation problem as a partially observable Markov decision process. We also present a data-driven model that lets us simulate how fires spread as a function of relevant covariates. A major problem in using data-driven models to combat wildfires is the lack of comprehensive data sources that relate fires with relevant covariates. We present an algorithmic approach based on large-scale raster and vector analysis that can be used to create such a dataset. Our data with over 2 million data points is the first open-source dataset that combines existing fire databases with covariates extracted from satellite imagery. Through experiments using real-world wildfire data, we demonstrate that our forecasting model can accurately model the spread of wildfires. Finally, we use simulations to demonstrate that our response strategy can significantly reduce response times compared to baseline methods.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        In 2018, a large wildfire (named Camp Fire) in California
resulted in the loss of 88 lives, displaced countless more, and
destroyed more than 18,500 structures. The estimated cost
of the destruction was a staggering $15 billion. As we write
this manuscript at the start of the wildfire season in the state,
more than a million acres have already burned in California
this year alone due to more than 7,000 wildfires. Wildfires
have destroyed many towns and structures across the state.
At one point in August 2020, the entire northern half of the
state had been instructed to prepare for evacuation
        <xref ref-type="bibr" rid="ref25">(State of
California 2020)</xref>
        . Crucially, the time of the year that is
referred to as the “wildfire season” in the state has only just
begun.
      </p>
      <p>
        Fighting wildfires is difficult. Rapid urbanization and the
effects of climate change make urban and suburban areas
particularly susceptible to wildfires. Known to be
notoriously unpredictable, sudden changes in wind directions or
weather can change the way fires spread
        <xref ref-type="bibr" rid="ref10">(Garza 2020)</xref>
        .
Firefighters need to allocate limited resources in dynamic and
uncertain environments to intervene and stop the spread of
fire.
      </p>
      <p>The problem of combating wildfires is an example of
dynamic resource allocation. Such an approach to combat
natural calamities like wildfires, floods, and earthquakes are
difficult for several reasons. The dynamics of the events are
unknown and complicated to model in closed-form. There
are multiple covariates that affect the spread of fire like
the vegetation, fuel, altitude, and wind, and the exact
relationship between each covariate and fire spread is
uncertain. Resource allocation is extremely challenging because
of the difficulty of making predictions about the spread of
fire and expected damage. Designing principled approaches
to deploy resources is important to mitigate the effects of
wildfires and emergencies in general (Mukhopadhyay et al.
2020).</p>
      <p>Events like fires affect large areas, and it is difficult to
correlate large-scale data from various sources to analyze
and study fires. To the best of our knowledge, there exists
no comprehensive data source that combines fire occurrence
with geospatial features, fuel levels, and weather to allow the
research community to develop approaches to combat
wildfires. Finally, the problem of deploying resources to manage
wildfires is full of uncertainties. As fires spread, it becomes
increasingly difficult to observe the true state on the ground
due to the presence of smoke. As a result, first responders
only have imperfect information to allocate their resources.</p>
      <p>
        Contributions: We make the following contributions in
this paper. 1) We present a decision-theoretic approach to
dynamically allocate resources in uncertain environments to
intervene against wildfires. Specifically, we model the
response problem as a partially observable Markov decision
process (POMDP) and present an approach to find
optimal actions for suppression for a given state of the
problem. Our approach accommodates the constraint that the
true state of the fire is difficult to observe in practice. 2)
Instead of focusing on physics-based models, we present a
data-driven approach that can simulate the spread of
wildfires. We extract relevant covariates such as fuel levels,
vegetation type, height of canopy, and elevation from satellite
imagery to drive the simulation. 3) The calculation of
accurate zonal statistics is a bottleneck for large scale
geospatial data analysis
        <xref ref-type="bibr" rid="ref23">(Singla and Eldawy 2018)</xref>
        . We
demonstrate how extremely large-scale geospatial data pertaining
to wildfires can be combined with other covariates through
large-scale distributed raster and vector analysis. Crucially,
we release the dataset open-source for the research
community. 4) Through experiments using real-world wildfire
data from California, we demonstrate that our forecasting
model can accurately model the spread of wildfires and our
response strategy results in significant improvement in
suppression efforts compared to baseline methods that do not
consider potential fire spread.
      </p>
    </sec>
    <sec id="sec-2">
      <title>Prior Work</title>
      <p>
        The dynamics of fire spread are usually modeled
using physics-based models. Popular fire spread models
include BehavePlus
        <xref ref-type="bibr" rid="ref2">(Andrews 1986)</xref>
        and Farsite
        <xref ref-type="bibr" rid="ref7">(Finney
1998)</xref>
        . They are based on mathematically modeled surface
fire spread as a function of heat flux and fuel
availability
        <xref ref-type="bibr" rid="ref19">(Rothermel 1972)</xref>
        . Such models are widely used by first
responders and fire fighters to forecast the spread of fires. A
relatively modern approach is to predict the rate of spread by
integrating real-time information about weather from
sensors
        <xref ref-type="bibr" rid="ref1">(Altintas et al. 2015)</xref>
        . Data-driven modeling has also
been used to model fire spread. Supervised machine
learning techniques have been applied to uncover strong
associations of factors to wildfire sizes and frequency using
different data sources. For example,
        <xref ref-type="bibr" rid="ref13">Joseph et al. (2019)</xref>
        investigated weather conditions and geographic
characteristics of extreme fire patterns in the contiguous United States
and
        <xref ref-type="bibr" rid="ref11">Ghorbanzadeh et al. (2019)</xref>
        examined wildfire
susceptibility using geographic data in northern Iran.
      </p>
      <p>
        Response to wildfires traditionally uses simulation-based
approaches to select locations of intervention that maximize
the expected utility of suppression efforts.
        <xref ref-type="bibr" rid="ref18">Petrovic,
Alderson, and Carlson (2012</xref>
        ) model wildfire dynamics and
examine the trade-off between multiple competing
suppression efforts to compute an optimal strategy for fire
responses. Stochastic simulation and multi-agent coordination
has also been explored to combat wildfires
        <xref ref-type="bibr" rid="ref17 ref8">(Fried, Gilless,
and Spero 2006; Martin-fernA´ ndez, Mart´ınez-Falero, and
Pe´rez-Gonza´lez 2002)</xref>
        .
      </p>
      <p>
        <xref ref-type="bibr" rid="ref12">Griffith et al. (2017)</xref>
        explore how suppression efforts can
be optimized by solving a mixed-integer linear program and
by using Monte Carlo approaches to find optimal actions in a
Markov decision process (MDP). Our approach to optimize
suppression improves upon prior work
        <xref ref-type="bibr" rid="ref12">(Griffith et al. 2017)</xref>
        to address the uncertainty in state information. We also
integrate a data-driven generative model to simulate the spread
of fire to aid decision-making under uncertainty.
      </p>
    </sec>
    <sec id="sec-3">
      <title>Problem Description</title>
      <p>We consider a spatial area divided into a set of spatial cells
G. Let gi 2 G denote the ith cell. We represent the
neighbors of a cell gi by Ni, for some definition of neighborhood
(for example, neighbors of a cell can be the set of its
adjacent cells). Consider that the total time in consideration
is divided into T time steps. We assume access to
historical data of fire incidents D, which is a vector of tuples
f(t1; `1; u1; w1); (t2; `2; u2; w2); : : : ; (tn; `n; un; wn)g,
where each incident di 2 D is identified by its time of
occurrence ti, location `i (mapping to a cell in G), intensity
of fire observed ui 2 R+, and a vector of spatio-temporal
features wi 2 Rm. The features w capture potential
determinants of fire such as weather and the type of vegetation in
a cell.</p>
      <p>
        Observing the true state of the world is almost always
impossible when wildfires occur. Gathering real-time
information by visiting the affected areas by land is
naturally difficult. Therefore, information must be gathered
through air surveillance obstructed by smoke. Consequently,
the true dynamics of wildfires are only partially
observable. We model the fire suppression problem more
realistically as a partially observable Markov decision
process (POMDP). A POMDP can be defined by the tuple
fS; A; O; Z; T; R; g
        <xref ref-type="bibr" rid="ref15">(Kochenderfer 2015)</xref>
        . We define each
component of the POMDP formulation below:
1. States: S is a finite set of states. The state at time t is
denoted by st = fXt; Ftg, where Xt = fXt1; Xt2; : : : ; Xtkg
and Ft = fFt1; Ft2; : : : ; F k
      </p>
      <p>t g denote the status of the fire
and fuel level in each of the cells in G, respectively. We
consider the status of the fire X as a binary variable such
that
xit =
1 if uit
0
where uit 2 R+ denotes the measured intensity of the fire
in cell gi 2 G at time step t. We consider that the fuel level
F is a discrete variable, such that F 2 f0; 1; : : : ; mg. The
exogenous parameters and m can be estimated from data
or through domain knowledge.
2. Actions: A is a finite set of actions. The actions denote the
different permutations of cell indices that fire suppression
efforts can be applied to, up to a maximum number of
cells specified as a resource constraint.
3. State Transitions: T defines conditional transition
probabilities, with T (s0 j s; a) denoting the transition
probability from state s to s0 when action a is taken. The transition
model T includes the following three components:
(a) Burning: If cell gi 2 G is burning at time step t, we
assume that the fuel level decreases by one unit in the
next time step. Therefore, Fti+1 = Fti 1 if xit .
(b) Action effectiveness: At any time step t, if an action,
i.e. fire suppression effort(s) is applied to a cell gi 2 G
such that xit , there is probability q that the effort
successfully puts out the fire.
(c) Fire dynamics: We use a generative model to
simulate the spread of fire. We represent spread dynamics
by the probability distribution f (Xti+1 j xtj ; w), where
gi 2 Nj . Therefore, given that a specific cell gj 2 G
is on fire at time step t, f denotes the likelihood of its
neighboring cells being on fire at the subsequent time
step t + 1.</p>
      <p>
        We assume that in each time step, fire from a cell can
spread only to its neighboring cells. This assumption aids
computational tractability, but is without loss of
generality because the decision-maker can discretize time fine
enough such that the assumption is realistic.
4. Reward function: R : S A ! R is the reward
function, such that R(st; a) = Pgi2G xitU (gi), where U (gi)
denotes the utility for a cell gi 2 G to be on fire.
Naturally, U varies across the cells. A cell with human
occupants is presumably more valuable and more costly to
burn than a cell composed of forested land. Cells can also
carry unequal ecological utilities
        <xref ref-type="bibr" rid="ref3">(Bradshaw and Lueck
2012)</xref>
        . Without loss of generality, we consider three tiers
of damage across cells, representing costs of residences
(red), valuable ecological resource (yellow), and wildland
(green) in decreasing values. Figure 1 shows an example
grid with different types of cells.
5. Observations and Observation Transitions: O represents
the set of observations with Z(o j s; a) denoting the
probability of receiving observation o at state s when action
a is taken. We denote specific observations by oit, which
correspond to whether cell gi 2 G is seen to be burning or
not at time step t. Its transitions Z(o j s; a) are
deterministic, i.e. ot;a = uit if an action has been applied to cell
i
gi 2 G. This is because we assume to have “eyes on
location” when an action is applied to a cell. Otherwise, for
cells where action for suppression is not applied (denoted
by a in the expression below), a generative
representation is used based on prior work
        <xref ref-type="bibr" rid="ref14">(Julian and Kochenderfer
2019)</xref>
        such that
i
ot;a =
1 if P rt(Xti) &gt;
0
otherwise
in state s
where is an exogenous parameter.
      </p>
      <sec id="sec-3-1">
        <title>6. Discount factor:</title>
        <p>2 [0; 1] denotes the discount factor.</p>
        <p>In a POMDP, the decision-maker cannot directly observe
the state. Instead, they only have access to beliefs that are
generated probabilistically based on the actions taken.
Information about states can be inferred from the history (h)
of observations and actions. It is common to maintain a
distribution over states given the history; this distribution is
known as the belief B, such that B(s j h) denotes the
probability of being in state s given history h. The goal for the
decision-maker is to find a mapping from belief states to
actions that maximizes the expected future discounted reward.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Approach</title>
      <sec id="sec-4-1">
        <title>Modeling Fire Spread</title>
        <p>In order to accurately simulate the spread of fire, we model
the fire dynamics f using a data-driven model. Recall that f
is a probability distribution over a cell being on fire in time
step t + 1, conditional on its neighbors being on fire at the
previous time step t. The goal of modeling the function f is
to understand the effect of various covariates like wind,
vegetation type, canopy height, altitude, etc. on fire spread.
Typically, covariates in geospatial analysis are heterogeneous.</p>
        <p>
          We use random forests
          <xref ref-type="bibr" rid="ref16">(Liaw, Wiener et al. 2002)</xref>
          which
involves constructing a large number of decision trees at
training time and then aggregating the outputs of the trees.
The aggregation technique is typically using the mode of
the outputs for classification and the mean of the outputs for
regression. The central idea behind using random forests is
to average many noisy but (approximately) unbiased
models, thereby reducing the variance of the overall forecasting
model.
        </p>
      </sec>
      <sec id="sec-4-2">
        <title>Resource Allocation</title>
        <p>The general dynamic decision framework following the
POMDP formulation is shown in Figure 2. Recall that the
sources of uncertainty are the current state of the fire (S)
and the dynamics of the spread (driven by the set of
covariates w). At each time step, the available set of actions
(A) is a combination of the fire location(s) to suppress. The
decision-maker acts based on a belief distribution of the true
state of the world and receives an observation. Utility (U)
reflects a measure of the expected damage of having a fire in a
specific cell (e.g. residence versus wildland).</p>
        <p>
          Due to the large state space and action space (the
action space is combinatorial), we use the sampling-based
online Monte Carlo tree search (MCTS)
          <xref ref-type="bibr" rid="ref15">(Kochenderfer 2015)</xref>
          .
To address the computational complexity of POMDPs,
approaches based on MCTS typically use a particle filter to
represent beliefs in the search tree. Specifically, an approach
that is of relevance to our problem is the partially observable
Monte Carlo planning algorithm with observation
widening (POMCPOW)
          <xref ref-type="bibr" rid="ref12 ref26 ref5">(Sunberg and Kochenderfer 2017)</xref>
          .
POMCPOW differs from other online MCTS algorithms in that in
the simulation step, given a state (s), history (h), and depth
(for tree exploration), it weights the belief nodes and
expands the belief updates gradually as more simulations are
added. At each step, a single simulated new state is added to
the particle collection, weighted to approximate the belief in
every tree node, which is then used to sample the next new
state.
        </p>
        <p>
          Although POMCPOW is shown to outperform other
algorithms
          <xref ref-type="bibr" rid="ref12 ref26 ref5">(Sunberg and Kochenderfer 2017)</xref>
          , an issue with
directly using POMCPOW on our problem is that the
observation space is large and complex. This leads to a severe
sparsity of particles, i.e., the probability of sampling a relevant
observation is very small. To alleviate this, we modify the
routine used to update belief in POMCPOW. Specifically,
we replace the weighted particle filter with the standard
particle filter without rejection
          <xref ref-type="bibr" rid="ref15">(Kochenderfer 2015)</xref>
          . As shown
in Algorithm 1, given a current belief (b), action (a), and
observation o, jbj samples are generated from the simulator,
weighted, and subsequently resampled by its weights.
Before the resampling step, all weights of an observation o may
be 0 due to the large observation space. If all the weights of
an observation are 0, the probabilities of the sampled states
are normalized to be proportional to the number of states
already sampled. This reweighting step makes an
approximation to importance resampling that seeks to estimate
properties of a target distribution by sampling from a different
distribution.
        </p>
        <sec id="sec-4-2-1">
          <title>Algorithm 1: UpdateBelief (b; a; o)</title>
        </sec>
        <sec id="sec-4-2-2">
          <title>Input : Belief b, action a, observation o Output: Updated belief b0</title>
          <p>f1; : : : ; j b jg do
random state in b
G(si; a)</p>
          <p>O(o j s0i; a)
;
1 b0
2 for i
3 si
4 s0i
5 wi
6 end
8
9 end
10 for i
11
7 if Pjib=j1 wi = 0 then
wi = len1(w) ;
wk</p>
          <p>
            Add s0k to b0
12
13 end
14 return normalized b0
// reweight states
f1; : : : ; j b jg do
Randomly select k with probability proportional to
Data needed to model the spread of wildfires comes from
varied sources. The temporal and spatial resolutions of such
data sources are typically different. The data sources can
also be of different forms (vector or raster). The vector
model uses points and line segments to identify spatial
locations while the raster model uses a set of cells for the
same purpose. Combining large-scale vector and raster data
is known to be a difficult problem
            <xref ref-type="bibr" rid="ref23">(Singla and Eldawy 2018)</xref>
            .
          </p>
          <p>
            We collected fire occurrence data in vector form from the
Visible Infrared Imaging Radiometer Suite (VIIRS) thermal
anomalies/active fire database
            <xref ref-type="bibr" rid="ref21">(Schroeder et al. 2014)</xref>
            . The
spatial resolution of VIIRS data is in the form of pixels
representing 375 375 meter square cells
            <xref ref-type="bibr" rid="ref21">(Schroeder et al.
2014)</xref>
            . The latitude and longitude values correspond to the
center. Evidence of fire was read from the daily fire
radiative power (FRP) levels in the VIIRS dataset. The data used
to build the feature space was collected in raster form from
the LANDFIRE project
            <xref ref-type="bibr" rid="ref20">(Ryan and Opperman 2013)</xref>
            . The
foundation of the LANDFIRE project is based on satellite
imagery. The raster files had a spatial resolution of 30 30
meter square cells. This included features like canopy base
density, canopy cover, and vegetation type. We list features
used and the years from which the data was collected in
Table 1.
          </p>
        </sec>
        <sec id="sec-4-2-3">
          <title>Name</title>
        </sec>
        <sec id="sec-4-2-4">
          <title>Canopy Base Density</title>
          <p>Canopy Base Height
Canopy Cover
Canopy Height
Existing Vegetation Cover
Existing Vegetation Height
Existing Vegetation Type
Elevation
Slope
Year(s)
2012, 2014, 2016
2012, 2014, 2016
2012, 2014, 2016
2012, 2014, 2016
2012, 2014, 2016
2012, 2014, 2016
2012, 2014, 2016
2016
2016</p>
          <p>To reconcile the different spatial resolutions, we divide
the state of California into a grid G of 375 375 meter
cells. The center of each fire pixel from the vector data can
therefore overlap with exactly one cell in G. To compute
the feature vector associated with each data point, we
compute zonal statistics for the vector data using the raster data.
The method of zonal statistics refers to calculating summary
statistics using a raster dataset within zones defined by
another dataset (typically in vector form).</p>
          <p>Traditional systems to compute zonal statistics require the
data to be converted into the same format, either raster or
vector. Automated tools can then be used to either vectorize
the raster dataset or rasterize the vector dataset. The first
approach converts each pixel in the raster to a point and then
tests the point against each polygon in the vector data to find
a match. This approach has a computational complexity of
O(np log np c r), where np is the number of polygons in
the vector data, and c and r are the number of columns and
rows in the raster data respectively. The second approach
Vector Data
Raster Data</p>
          <p>Input</p>
          <p>Intersections
Computation</p>
          <p>Intersections
Files</p>
          <p>Distribute
Zonal Statistics
Computation
rasterizes the vector data by converting each polygon to a
raster (mask) layer with the same resolution as the input
raster layer. It then combines the two raster layers to
compute the desired aggregate function. Most systems that use
this approach keep the mask layer in memory. If the input
raster layer has a very high resolution, the size of the mask
layer can become too large to be kept in memory. This
approach has a computational complexity of O(np c r).</p>
          <p>
            Neither of the two approaches mentioned above scale for
the high resolution raster and vector data due to the
requirement of converting between vector and raster formats.
Specifically, in our problem, the vector data consist of over 3
million polygons and each of the raster data sources consists
of over 1 billion entries. To deal with the large-scale
geospatial data, we create a fully decentralized approach to
compute large-scale zonal statistics based on
            <xref ref-type="bibr" rid="ref24">Singla and Eldawy
(2020)</xref>
            . Our approach does not require data to be converted
from one form to another (vector or raster). Instead, it
computes an intermediate data structure, called an intersections
file between the raster and vector data. The intersections file
can be computed using only the vector data and the
metadata of the raster data (coordinate reference, resolution, etc.).
Further, our approach can leverage parallel computation by
using the intersection files. Our approach, with a
computational complexity of O(np log np + c r), is scalable and
efficient for large raster and vector datasets. Furthermore, as
a by-product, our approach makes it easier to find the
neighborhoods of polygons by performing a spatial self-join
operation using the predicate intersects on all the cells in the
vector data. We show the architecture of our approach in
Figure 3.
          </p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Experiments</title>
      <p>We used fire data from California, USA spanning 2012–
2018 for the prediction modeling. We divided the state into
a set of 375 375 meter cells. Our goal was to capture how
fire spreads given an initial occurrence of fire. As a result, we
only considered cells and days that exhibited the possibility
of fire spreading from an existing fire. Specifically, each cell
in our data has a fire in its neighborhood. Our data has a total
of 2,367,209 data points. Each row in our data represents a
cell gi at a specific time t, a set of spatial-temporal features
wit, and the status of fire uit as well as the spatial-temporal
features wjt+1 and the status of fire ut+1 of gj 2 Ni, a
j
neighboring cell of gi at time step t + 1. To calculate the
features for a specific cell gi 2 G at a specific time step,
we calculated summary statistics (maximum, minimum,
median, sum, mode, count, and mean of the feature values)
using all raster cells within gi at time step t. To the best of our
knowledge, our data is the first comprehensive open-source
dataset that combines fire occurrence with relevant
covariates extracted from satellite imagery. The data is available at
https://wildfire-modeling.github.io. We used data from 2012
to 2017 as our training set and data from 2018 as our test set.
We set the time step for our experiments to a day, based on
the minimum time fidelity of the VIIRS dataset. All
experiments were run on an Intel Xeon 2.2 GHz processor with
125 GB of memory.</p>
      <sec id="sec-5-1">
        <title>Fire Spread</title>
        <p>We label a forecast as a true positive prediction when both
the predicted fire intensity and the recorded fire intensity are
greater than the pre-specified threshold . We observe that
the random forest regression model is insensitive to the
number of trees used (5, 50, 100, and 500). We also observed
similar accuracy across training and test sets. We tested
several realizations of to examine the robustness of our
forecasting approach on different sizes of fire. Our results show
that while it is relatively difficult to predict spread from
extremely small fires ( = 0:5), our forecasting model achieves
high accuracy (&gt; 90%) in predicting spreads from relatively
larger fires. We summarize the results in Table 2.</p>
        <sec id="sec-5-1-1">
          <title>FRP Threshold ( ) Accuracy on Test Set 0.5 1</title>
        </sec>
      </sec>
      <sec id="sec-5-2">
        <title>Fire Response</title>
        <p>
          Our goal is to create a pipeline for modeling response to
wildfires by utilizing the data-driven model of fire spread
to optimize response decisions. However, in this paper,
we present experimental results based on a simple spread
model. Specifically, we simulate the spread of fire using
fixed environmental conditions (for example, we use a fixed
y
ti
itl 5,500
U
e
v
ti
eag 5,000
N
4,500
q=1
1,400
8,000
y
itlit
evU 7,000
it
a
g
e
N
6,000
q=1
wind direction and rate of spread in each simulation). We
calculate the probability of fire spread following a
simplified version of the deterministic fire dynamics model in prior
work
          <xref ref-type="bibr" rid="ref12">(Griffith et al. 2017)</xref>
          .
        </p>
        <p>
          We conducted experiments on different sized square grids
(42; 62; 82; 102; 122 and 162). We varied the starting states
by random initialization of fire maps and cell types. We
experimented with 6 different initial states. For each
initial state, we created 256 spread scenarios by varying wind
and rate of spread. For each initialization, a fixed
percentage (10%) of cells was considered to be on fire. The
proportions of red, yellow, and green cells were set to be 20%,
30%, and 50% respectively, consistent with the distribution
of land use in California
          <xref ref-type="bibr" rid="ref27">(United States Department of
Agriculture 2016)</xref>
          . In all experiments, we set the fuel level in
each cell to 5, i.e., each cell takes 5 days to completely burn
out and deplete its fuel. We use a baseline model consistent
with fire suppression strategies used in practice. Specifically,
our baseline fire suppression targets the cell with the
maximum utility that shows evidence of fire (through
observations). Our open-source code is built using the POMDPs.jl
framework
          <xref ref-type="bibr" rid="ref5">(Egorov et al. 2017)</xref>
          and is available at https:
//github.com/wildfire-modeling/response model.
        </p>
        <p>Figure 4 shows the mean negative utility averaged across
start states and spread scenarios. We also vary the action
effectiveness q since in practice, suppression efforts do not
always completely puts out wildfires. We see that our
approach (referred to as “Uncertainty Aware Fire Response”
or UAFR) consistently outperforms the baseline method in
all scenarios with more significant improvements in larger
grids and increased action effectiveness.</p>
        <p>Discussion
combat due to difficulties in surveillance and scarcity of
resources. In this paper, we built a data-driven
forecasting model by extracting relevant determinants of fire spread
through satellite imagery. Then, we developed an approach
to wildfire suppression that explicitly takes state uncertainty
into account. To the best of our knowledge, we were the first
to create a comprehensive dataset on wildfires that combines
historical fire data with relevant covariates. Our dataset, with
over two million data points, and our codebase are
opensource for the research community to use.</p>
        <p>There are some limitations to our current work. While our
forecasting model shows high accuracy, we observe that the
random forest regression model is insensitive to the number
of decision trees in the ensemble. As a result, simpler
methods like classification and regression trees (CART) (Breiman
et al. 1984) might result in better generalization to unseen
data. Second, our approach to suppression needs to be
integrated with the data-driven fire spread model. Finally, while
we simulated wind for our experiments, our open-source
dataset does not contain information about wind. We are
currently incorporating hourly wind data from the National
Oceanic and Atmospheric Administration (NOAA)1 with
our fire data to develop a more comprehensive dataset.</p>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>Acknowledgements</title>
      <p>We would like to acknowledge the Department of
Management Science &amp; Engineering at Stanford University, USDA
NIFA AFRI (Grant 2019-67022-29696), and the Center of
Automotive Research at Stanford (CARS) for funding this
research.</p>
      <p>Wildfires have caused massive damage in the last decade.
They are particularly challenging for first responders to
1https://www.climate.gov/maps-data/dataset/wind-rosescharts-and-tabular-data</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Altintas</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ; Block, J.; De Callafon, R.; Crawl,
          <string-name>
            <given-names>D.</given-names>
            ;
            <surname>Cowart</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            ;
            <surname>Gupta</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ;
            <surname>Nguyen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ;
            <surname>Braun</surname>
          </string-name>
          , H.-W.; Schulze,
          <string-name>
            <surname>J.</surname>
          </string-name>
          ; Gollner,
          <string-name>
            <surname>M.</surname>
          </string-name>
          ; et al.
          <year>2015</year>
          .
          <article-title>Towards an integrated cyberinfrastructure for scalable data-driven monitoring, dynamic prediction and resilience of wildfires</article-title>
          .
          <source>Procedia Computer Science</source>
          <volume>51</volume>
          :
          <fpage>1633</fpage>
          -
          <lpage>1642</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Andrews</surname>
            ,
            <given-names>P. L.</given-names>
          </string-name>
          <year>1986</year>
          .
          <article-title>BEHAVE: fire behavior prediction and fuel modeling system: BURN subsystem, Part 1</article-title>
          , volume
          <volume>194</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Bradshaw</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ; and
          <string-name>
            <surname>Lueck</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <year>2012</year>
          .
          <article-title>Wildfire policy: Law and Economics Perspectives</article-title>
          . Routledge.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          1984.
          <article-title>Classification and regression trees</article-title>
          . CRC Press.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Egorov</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Sunberg</surname>
            ,
            <given-names>Z. N.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Balaban</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Wheeler</surname>
            ,
            <given-names>T. A.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Gupta</surname>
            ,
            <given-names>J. K.</given-names>
          </string-name>
          ; and Kochenderfer,
          <string-name>
            <surname>M. J.</surname>
          </string-name>
          <year>2017</year>
          .
          <article-title>POMDPs.jl: A Framework for Sequential Decision Making under Uncertainty</article-title>
          .
          <source>Journal of Machine Learning Research</source>
          <volume>18</volume>
          (
          <issue>26</issue>
          ):
          <fpage>1</fpage>
          -
          <lpage>5</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          URL http://jmlr.org/papers/v18/
          <fpage>16</fpage>
          -
          <lpage>300</lpage>
          .html.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <surname>Finney</surname>
            ,
            <given-names>M. A.</given-names>
          </string-name>
          <year>1998</year>
          . FARSITE,
          <string-name>
            <surname>Fire Area</surname>
          </string-name>
          Simulator
          <article-title>-model development and evaluation. 4</article-title>
          . US Department of Agriculture, Forest Service, Rocky Mountain Research Station.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Fried</surname>
            ,
            <given-names>J. S.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Gilless</surname>
            ,
            <given-names>J. K.</given-names>
          </string-name>
          ; and
          <string-name>
            <surname>Spero</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <year>2006</year>
          .
          <article-title>Analysing initial attack on wildland fires using stochastic simulation</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <source>International Journal of Wildland Fire</source>
          <volume>15</volume>
          (
          <issue>1</issue>
          ):
          <fpage>137</fpage>
          -
          <lpage>146</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <surname>Garza</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <year>2020</year>
          .
          <article-title>AI Is Helping Fight Wildfires Before They Start</article-title>
          . https://time.com/5497251/wildfires-artificialintelligence/.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>Ghorbanzadeh</surname>
            ,
            <given-names>O.; Valizadeh</given-names>
          </string-name>
          <string-name>
            <surname>Kamran</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Blaschke</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Aryal</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Naboureh</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Einali</surname>
          </string-name>
          , J.; and
          <string-name>
            <surname>Bian</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <year>2019</year>
          .
          <article-title>Spatial prediction of wildfire susceptibility using field survey gps data and machine learning approaches</article-title>
          .
          <source>Fire</source>
          <volume>2</volume>
          (
          <issue>3</issue>
          ):
          <fpage>43</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <surname>Griffith</surname>
            ,
            <given-names>J. D.</given-names>
          </string-name>
          ; Kochenderfer,
          <string-name>
            <given-names>M. J.</given-names>
            ; Moss, R. J.; Misˇic´, V. V.;
            <surname>Gupta</surname>
          </string-name>
          , V.; and
          <string-name>
            <surname>Bertsimas</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <year>2017</year>
          .
          <article-title>Automated dynamic resource allocation for wildfire suppression</article-title>
          .
          <source>Lincoln Laboratory Journal</source>
          <volume>22</volume>
          (
          <issue>2</issue>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <surname>Joseph</surname>
            ,
            <given-names>M. B.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Rossi</surname>
            ,
            <given-names>M. W.</given-names>
          </string-name>
          ; Mietkiewicz,
          <string-name>
            <given-names>N. P.</given-names>
            ;
            <surname>Mahood</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. L.</given-names>
            ;
            <surname>Cattau</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. E.</given-names>
            ;
            <surname>St. Denis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. A.</given-names>
            ;
            <surname>Nagy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. C.</given-names>
            ;
            <surname>Iglesias</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            ;
            <surname>Abatzoglou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. T.</given-names>
            ; and
            <surname>Balch</surname>
          </string-name>
          ,
          <string-name>
            <surname>J. K.</surname>
          </string-name>
          <year>2019</year>
          .
          <article-title>Spatiotemporal prediction of wildfire size extremes with Bayesian finite sample maxima</article-title>
          .
          <source>Ecological Applications</source>
          <volume>29</volume>
          (
          <issue>6</issue>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <surname>Julian</surname>
            , K. D.; and Kochenderfer,
            <given-names>M. J.</given-names>
          </string-name>
          <year>2019</year>
          .
          <article-title>Distributed wildfire surveillance with autonomous aircraft using deep reinforcement learning</article-title>
          .
          <source>Journal of Guidance, Control, and Dynamics</source>
          <volume>42</volume>
          (
          <issue>8</issue>
          ):
          <fpage>1768</fpage>
          -
          <lpage>1778</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <string-name>
            <surname>Kochenderfer</surname>
            ,
            <given-names>M. J.</given-names>
          </string-name>
          <year>2015</year>
          .
          <article-title>Decision Making Under Uncertainty: Theory and Application</article-title>
          . MIT Press.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <string-name>
            <surname>Liaw</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Wiener</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ; et al.
          <year>2002</year>
          .
          <article-title>Classification and regression by randomForest</article-title>
          .
          <source>R news 2</source>
          <volume>(3)</volume>
          :
          <fpage>18</fpage>
          -
          <lpage>22</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <article-title>Martin-fernA´ ndez, S.; Mart´ınez-</article-title>
          <string-name>
            <surname>Falero</surname>
            , E.; and Pe´rezGonza´lez,
            <given-names>J. M.</given-names>
          </string-name>
          <year>2002</year>
          .
          <article-title>Optimization of the resources management in fighting wildfires</article-title>
          .
          <source>Environmental Management</source>
          <volume>30</volume>
          (
          <issue>3</issue>
          ):
          <fpage>352</fpage>
          -
          <lpage>364</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          <string-name>
            <surname>Petrovic</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Alderson</surname>
            ,
            <given-names>D. L.</given-names>
          </string-name>
          ; and
          <string-name>
            <surname>Carlson</surname>
            ,
            <given-names>J. M.</given-names>
          </string-name>
          <year>2012</year>
          .
          <article-title>Dynamic resource allocation in disaster response: Tradeoffs in wildfire suppression</article-title>
          .
          <source>PloS one 7</source>
          (
          <issue>4</issue>
          ):
          <fpage>e33285</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          <string-name>
            <surname>Rothermel</surname>
            ,
            <given-names>R. C.</given-names>
          </string-name>
          <year>1972</year>
          .
          <article-title>A mathematical model for predicting fire spread in wildland fuels</article-title>
          , volume
          <volume>115</volume>
          .
          <string-name>
            <surname>Intermountain</surname>
            <given-names>Forest</given-names>
          </string-name>
          &amp; Range Experiment Station, Forest Service.
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          <string-name>
            <surname>Ryan</surname>
            ,
            <given-names>K. C.</given-names>
          </string-name>
          ; and Opperman,
          <string-name>
            <surname>T. S.</surname>
          </string-name>
          <year>2013</year>
          .
          <article-title>LANDFIRE-A national vegetation/fuels data base for use in fuels treatment, restoration, and suppression planning</article-title>
          .
          <source>Forest Ecology and Management</source>
          <volume>294</volume>
          :
          <fpage>208</fpage>
          -
          <lpage>216</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          <string-name>
            <surname>Schroeder</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ; Oliva,
          <string-name>
            <given-names>P.</given-names>
            ;
            <surname>Giglio</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            ; and
            <surname>Csiszar</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. A.</surname>
          </string-name>
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          <article-title>The New VIIRS 375 m active fire detection data product: Algorithm description and initial assessment</article-title>
          .
          <source>Remote Sensing of Environment</source>
          <volume>143</volume>
          :
          <fpage>85</fpage>
          -
          <lpage>96</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          <string-name>
            <surname>Singla</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ; and
          <string-name>
            <surname>Eldawy</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <year>2018</year>
          .
          <article-title>Distributed zonal statistics of big raster and vector data</article-title>
          .
          <source>In Proceedings of the 26th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems</source>
          ,
          <volume>536</volume>
          -
          <fpage>539</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          <string-name>
            <surname>Singla</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ; and
          <string-name>
            <surname>Eldawy</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <year>2020</year>
          . Raptor Zonal Statistics : Fully Distributed Zonal Statistics of Big Raster +
          <article-title>Vector Data</article-title>
          .
          <source>In Proceedings of 2020 IEEE International Conference on Big Data</source>
          (To Appear). IEEE.
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          <source>State of California</source>
          .
          <year>2020</year>
          . 2020
          <string-name>
            <given-names>Incident</given-names>
            <surname>Archive</surname>
          </string-name>
          . https: //www.fire.ca.gov/incidents/2020/.
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          <string-name>
            <surname>Sunberg</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ; and Kochenderfer,
          <string-name>
            <surname>M.</surname>
          </string-name>
          <year>2017</year>
          .
          <article-title>Online algorithms for POMDPs with continuous state, action, and observation spaces</article-title>
          .
          <source>arXiv preprint arXiv:1709</source>
          .
          <fpage>06196</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          <string-name>
            <surname>United</surname>
          </string-name>
          States Department of Agriculture.
          <year>2016</year>
          .
          <article-title>FIA State Stats</article-title>
          . https://www.fs.fed.us/pnw/rma/fia-topics/state-stats/ California/index.php.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>