<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>What is Ready in a DoR? Rationales, Responsibility &amp; Rules in using a Definition of Ready</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Mark van Riesen</string-name>
          <email>m.vanriesen2@students.uu.nl</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Gerard Wagenaar</string-name>
          <email>g.wagenaar@uu.nl</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Agile Software Development, Definition of Ready, DoR</institution>
          ,
          <addr-line>Scrum, User story, INVEST criteria 1</addr-line>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Utrecht University</institution>
          ,
          <addr-line>Heidelberglaan 8, Utrecht, 3584 CS</addr-line>
          ,
          <country country="NL">the Netherlands</country>
        </aff>
      </contrib-group>
      <fpage>0000</fpage>
      <lpage>0001</lpage>
      <abstract>
        <p>In agile software development, a Definition of Ready (DoR) is used to indicate conditions a Product Backlog Item (PBI) has to meet before accepting it into a Sprint Backlog. This research aims (1) to identify those conditions, (2) to investigate why Scrum teams do or do not use a DoR, and (3) to identify which (Scrum) role is responsible for drafting a DoR. Research questions are answered by a literature review and interviews with Scrum team members. Results show that conditions vary, but common elements are include INVEST criteria, clearly defining, and prioritizing a PBI. Reasons to use a DoR include a positive impact on workflow, like an efficient process or increased quality of software. Teams might not use a DoR, because of overhead of writing it or encouraging a less 'agile way of thinking'. Both Product Owner and Scrum Master can be involved in defining and maintaining a DoR, and it is considered good practice to involve all team members. Our findings also reveal that use of a DoR is not intuitive per se.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        In Scrum software development, or agile development in general, a Definition of Ready (DoR)
may be used to specify conditions a Product Backlog Item (PBI) has to meet before accepting it
into a Sprint Backlog [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. The original Scrum guide does not mention the concept [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] and few
initiatives have been undertaken to consider its role and importance. According to one of few
studies, ready means that a PBI has to be sufficiently prepared, so that a team can start working
on it [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. While a Scrum development team is responsible for meeting a Definition of Done,
the Product Owner is responsible for PBIs meeting the DoR [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. The DoR thus serves as a
checklist for a Product Owner before declaring an item is ready to be pulled in by the team. A
user story or feature does not have to be 100% defined, but it has to be ready enough for the
team to successfully deliver it.
      </p>
      <p>Little is known about DoR usage in practice. This research aims to understand a DoR’s role
in Scrum software development. We formulate our main research question as: What
constitutes a DoR in Scrum software development?</p>
      <p>To answer the main question, we ask three sub-questions: (SQ1) What are reasons for Scrum
teams (not) to use a DoR?, (SQ2) Which (Scrum) role is responsible for a DoR?, and (SQ3) What
conditions must a PBI meet to be accepted into a Sprint?</p>
    </sec>
    <sec id="sec-2">
      <title>2. Research method</title>
      <p>
        Our research involved literature review and interviews. The former part is inspired by a
systematic literature review [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], but we did not use its full systematic approach. We selected
several data sources (Google (Scholar) &amp; Scopus) as we were already aware that previous work
on the DoR would be scarce and we would need to access grey literature. We defined our search
string as: (“definition of ready”) AND (“agile“ OR “scrum“ OR “user story”). Inclusion/exclusion
criteria included language (English or Dutch) and applicability to DoR. Quality assessment
involved type of publication, authorship, citations, and publication date.
      </p>
      <p>
        In the empirical part, we conducted a small ‘case study’ with software engineering teams.
We are hesitant to use the label ‘case study’, because our context would at best be partially
reallife nor do we use multiple sources [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. Engineering teams were bachelor computer science
students working on Scrum projects as their final thesis. They might be familiar with the
concept ‘DoR’, but were certainly not trained. They are familiar with Scrum software
development, its roles, artifacts, and events. This setting provided an unique opportunity to
investigate a DoR’s ‘intuitiveness’. We interviewed Product Owners and Scrum Masters from
three teams, where semi-structured interviews explored themes with regard to (1) their
involvement with the Product Backlog, (2) familiarity with a DoR, and (3) their use of readiness
of PBIs for a Sprint.
      </p>
    </sec>
    <sec id="sec-3">
      <title>3. Findings</title>
      <p>
        Two studies stand out in literature when it comes to DoR usage. The most elaborate example is
a case study at Cisco [
        <xref ref-type="bibr" rid="ref10">1 0</xref>
        ]. This research describes using a DoR for (1) user stories, (2) sprints,
and (3) releases. The choice to use a baseline (DoR) was made because of interdependencies
across teams, and challenges and impediments to flow of the organization. At Cisco, work eitms
were considered ready when stories, acceptance criteria, and dependencies were defined, a story
was sized, user experience artifacts were done, architecture criteria (performance, security)
were identified, the person who would accept the user story was identified, the team had
reviewed the user story, and the team knew what it would mean to demo the user story.
      </p>
      <p>
        The second one describes the introduction of a DoR as part of an a gile transition [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. The
DoR demands primarily that the role related to a story must be specified and the user story
should follow the user story template The quantitative and qualitative documentation was
reported to improve by specifying documentation needs in the DoR.
      </p>
      <sec id="sec-3-1">
        <title>3.1. Literature: Reasons (not) to use a DoR</title>
        <p>
          Literature mentions reasons (not) to use a DoR, although its use is often recommended. Positive
effects include (1) acting as a filter, stabilizing team working environment, and preventing
issues, e.g. wasted time or delays [
          <xref ref-type="bibr" rid="ref10 ref13">10,13</xref>
          ], and (2) reducing defects, improving documentation,
speeding up delivery, and increasing high-quality user stories [
          <xref ref-type="bibr" rid="ref4 ref5 ref8">4,5,8</xref>
          ].
        </p>
        <p>
          Opponents of a DoR raise challenges in implementation and concerns about potential
conflicts with agile principles [
          <xref ref-type="bibr" rid="ref1 ref9">1,9</xref>
          ], suggesting that it may lead to Waterfall thinking [
          <xref ref-type="bibr" rid="ref10 ref3">3,10</xref>
          ].
Some argue that details can be best sorted out during a Sprint [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ]. Therefore, it is crucial to
strike a balance between providing sufficient information without determining implementation
details [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ].
        </p>
      </sec>
      <sec id="sec-3-2">
        <title>3.2. Literature: DoR responsibility</title>
        <p>
          Attribution of responsibility for a DoR is not uniform. Some assign it to the Product Owner
[
          <xref ref-type="bibr" rid="ref10 ref11">10,11</xref>
          ], while others suggests that the task belongs to the Scrum Master [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ]. During backlog
refinement, the team must work with the Product Owner to help them get the stories in
actionable shape [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ].
        </p>
      </sec>
      <sec id="sec-3-3">
        <title>3.3. Literature: Backlog item conditions</title>
        <p>
          Features do not have to be 100% defined, but sufficiently enough for successful delivery or to
establish a common understanding of risks [
          <xref ref-type="bibr" rid="ref10 ref3">3,10</xref>
          ]. Criteria such as the “As a role, I want
function, so that reason” template [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ], and the INVEST criteria (Independent, Negotiable,
Valuable, Estimated, Sized appropriately, and Testable) [
          <xref ref-type="bibr" rid="ref1 ref13 ref2 ref3 ref4 ref8">1,2,3,4,8,13</xref>
          ] can be used for screening
stories entering a Sprint.
        </p>
        <p>
          Ready stories must be clear, concise, and actionable, with the latter the most important [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ].
Furthermore, a user story should clearly state the resulting business value, allowing the Product
Owner to prioritize. Finally, ready stories must meet the INVEST criteria, and be absent of
external dependencies, in the sense that there is nothing beyond the teams control that must be
done first in order to complete the user story.
        </p>
        <p>
          A checklist for readiness may also be used with elements such as clarity, testability,
feasibility, defined acceptance criteria and dependencies, and being sized appropriately by the
development team [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ]. The IBPM Story Check was transformed into another DoR checklist: a
story in the ‘role, what, reason’ template is prioritized and acceptance criteria are defined [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ].
        </p>
        <p>Overall, literature suggests a DoR varies based on project needs but commonly includes
clarity, prioritization, size, and team understanding. The INVEST criteria are frequently
mentioned, and a DoR should be tailored and regularly reviewed.</p>
      </sec>
      <sec id="sec-3-4">
        <title>3.4. Definition of Ready in practice</title>
        <p>Members from three teams were interviewed. None of them was directly familiar with the
concept ‘DoR’. Only one team stated that it used a set of constraints that a PBI should adhere
to before it could be used in a Sprint, but it did this implicitly.</p>
        <p>Three interviewees shared an example of a PBI, which they thought was “ready” to be used
in a Sprint. Examples show that PBIs should have clear value for the client, be easily
understandable, could easily be picked up by another member, clearly state technical details,
not be too large, and be independent of other features.</p>
        <p>None of the teams used a DoR, at least not explicitly, so responsibility for a DoR was not
assigned. However, for all teams, both Product Owner and Scrum Master were involved with
Product Backlog management. Team A’s Scrum Master believed the advantages of a DoR
outweigh its disadvantages by, for example, increasing the team’s ability to work independently
on assigned tasks. Tasks of Product Owner and Scrum Master always included creating,
prioritizing, and assigning PBIs, which makes both roles eligible to determine whether a PBI is
ready for a Sprint.</p>
        <p>All teams used MoSCoW to assign priorities to their PBIs. Independence between PBIs was
also deemed important to avoid delays and dependencies in the workflow. Respondents
highlighted the importance of clear specifications, and stated that well-defined items prevent
misunderstandings also contributing to the final product meeting requirements. Additionally,
breaking down a PBI into smaller, more manageable tasks is also recommended, as it makes it
easier for team members to understand progress.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4. Conclusions</title>
      <p>What are reasons for Scrum teams (not) to use a DoR? Literature states that using a DoR
positively impacts project workflow, such as increasing speed, promoting efficiency, and
improving product quality. However, potential downsides exist: overhead and a ‘Waterfall’
approach. To use or not to use a DoR depends on situational factors of a team. From practice,
we learn the applying a DoR is not that intuitive. Out of three teams, only one used it more or
less, implicitly.</p>
      <p>Which (Scrum) role is responsible for a DoR? We find in practice both Product Owners and
Scrum Masters being involved in Product Backlog management. This is more or less in line with
literature, which also emphasized involvement of all team members in the process around a
DoR.</p>
      <p>What conditions must a PBI meet to be accepted into a Sprint? Literature provides us with
many answers. The criteria vary widely but commonly include INVEST criteria. Additional
criteria may be project-specific. By lack of an explicit DoR within the teams, this could not be
verified.</p>
      <p>What constitutes a DoR in Scrum software development? The answer is situational,
dependent on team, project, and organization. One thing is for sure, a DoR is not the first thing
junior software engineers think of when doing Scrum software development.</p>
    </sec>
    <sec id="sec-5">
      <title>5. Limitations &amp; future research</title>
      <p>Using interviews partly makes research difficult to replicate. All Scrum teams were part of the
same population. Therefore, generalizability of this research has to be considered relatively low.
Furthermore, mainly because of time limitations, we did not have access to more experienced
Scrum teams of, for example, software companies. We would very much like to interview more
experience Scrum team members, not only to improve the reliability of our research, but also
to dive further into the intuitiveness of a DoR. Do such teams use it earlier or better, or are they
sometimes simply obliged to? Finally, further research could focus on examining the effects of
using a DoR within teams. Do the benefits, from literature, occur in practice?</p>
      <p>We end by stating that DoR usage in agile software development is an under-researched
area. Our limited study contributes some elements, but more research is called for.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>W.-J.</given-names>
            <surname>Ageling</surname>
          </string-name>
          ,
          <article-title>The rise and fall of the Definition of Ready in Scrum. URL: medium.com/serious-scrum/the-rise-and-fall-of-the-definition-of-ready-in-scrum2407c6f1c455 (</article-title>
          <year>2021</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>R.</given-names>
            <surname>Austin</surname>
          </string-name>
          , Definition of ready. URL: www.leadingagile.com/
          <year>2015</year>
          /07/definition-of-ready.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>N.</given-names>
            <surname>Butler</surname>
          </string-name>
          ,
          <article-title>Definition of ready and definition of done: What's the difference? URL: www</article-title>
          .boost.co.nz/blog/2022/06/definition-ready
          <string-name>
            <surname>-</surname>
          </string-name>
          definition-done (
          <year>2022</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>J.</given-names>
            <surname>Dalton</surname>
          </string-name>
          , Definition of ready, in: Great Big Agile, pages
          <fpage>163</fpage>
          -
          <lpage>164</lpage>
          . Springer (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>P.</given-names>
            <surname>Diebold</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Theobald</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Wahl</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Rausch</surname>
          </string-name>
          ,
          <article-title>An agile transition starting with user stories</article-title>
          ,
          <source>DoD &amp; DoR in: Proceedings of the 2018 International Conference on Software and System Process</source>
          , pages
          <fpage>147</fpage>
          -
          <lpage>156</lpage>
          (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>A.</given-names>
            <surname>Hooles</surname>
          </string-name>
          ,
          <article-title>How to contract successfully for agile software development</article-title>
          , in: Int'l. InHouse Counsel J.,
          <volume>11</volume>
          :1 (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>B.</given-names>
            <surname>Kitchenham</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Charters</surname>
          </string-name>
          ,
          <article-title>Guidelines for performing systematic literature reviews in software engineering (</article-title>
          <year>2007</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>C.</given-names>
            <surname>Kleczewski</surname>
          </string-name>
          ,
          <article-title>Wat is de definition of ready? URL: agilescrumgroup.nl/wat-isdefinition-of-ready.</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>I.</given-names>
            <surname>Mitchell</surname>
          </string-name>
          ,
          <article-title>Walking through a definition of ready. URL: www.scrum.org/resources/blog/walking-through-definition-</article-title>
          <string-name>
            <surname>ready</surname>
          </string-name>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>K.</given-names>
            <surname>Power</surname>
          </string-name>
          ,
          <article-title>Definition of ready: An experience report from teams at cisco</article-title>
          ,
          <source>in: International Conference on Agile Software Development</source>
          , pages
          <fpage>312</fpage>
          -
          <lpage>319</lpage>
          . Springer (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>K.</given-names>
            <surname>Power</surname>
          </string-name>
          ,
          <article-title>Social contracts, simple rules and self-organization: a perspective on agile development</article-title>
          ,
          <source>in: International Conference on Agile Software Development</source>
          , pages
          <fpage>277</fpage>
          -
          <lpage>284</lpage>
          . Springer (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>K.</given-names>
            <surname>Schwaber</surname>
          </string-name>
          ,
          <string-name>
            <surname>J. Sutherland,</surname>
          </string-name>
          <article-title>The scrum guide</article-title>
          .
          <source>Scrum Alliance</source>
          ,
          <volume>21</volume>
          (
          <issue>19</issue>
          ):
          <volume>1</volume>
          (
          <year>2011</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>J.</given-names>
            <surname>Sutherland</surname>
          </string-name>
          ,
          <article-title>Definition of ready. URL: www.scruminc.com/definition-of-ready.</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>C.</given-names>
            <surname>Thiemich</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Puhlmann</surname>
          </string-name>
          ,
          <article-title>An agile bpm project methodology, in: Business process management</article-title>
          , pages
          <fpage>291</fpage>
          -
          <lpage>306</lpage>
          . Springer (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>B.</given-names>
            <surname>Will</surname>
          </string-name>
          ,
          <article-title>Definition of ready (dor) vs. definition of done (dod). URL: www.linkedin. com/pulse/definition-ready-dor-vs-done-dod-brian-</article-title>
          <string-name>
            <surname>will</surname>
          </string-name>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>C.</given-names>
            <surname>Wohlin</surname>
          </string-name>
          ,
          <article-title>Case Study Research in Software Engineering - It is a Case, and it is a Study, but is it a Case Study?</article-title>
          ,
          <source>Information and Software Technology</source>
          ,
          <volume>133</volume>
          ,
          <issue>106514</issue>
          (
          <year>2021</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>