<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>The global land-
scape of AI ethics guidelines. Nature Machine Intelligence</journal-title>
      </journal-title-group>
      <issn pub-type="ppub">2522-5839</issn>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.1038/s42256-019</article-id>
      <title-group>
        <article-title>Reframing Opportunity and Fairness in the AI Diversity Pipeline</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Armanda Lewis</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>New York University</institution>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Shoham</institution>
          ,
          <addr-line>Y.; Perrault, R.; Brynjolfsson, E.; Clark, J.; Manyika, J.; Niebles, J. C.; Lyons, T.; Etchemendy, J.; mittee</addr-line>
          ,
          <institution>Human-Centered AI Initiative, Stanford University</institution>
          ,
          <addr-line>Stanford, CA</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2019</year>
      </pub-date>
      <volume>1</volume>
      <issue>9</issue>
      <abstract>
        <p>This whitepaper reframes the AI diversity pipeline to address persistent structural imbalances and achieve sustainable practices that support social justice, scientific, and technological advancements.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Recent statistics on the representation of historically
underrepresented minority (URM) populations within the
field of Artificial Intelligence (AI) reveal extreme
disparities (Shoham et al. 2018). Though one observes
disparities across all STEM fields, scholars highlight the AI case
as particularly alarming given the rate and breadth at which
AI technologies are adopted within society and the potential
for AI technologies to replicate historical biases
        <xref ref-type="bibr" rid="ref3">(Brundage
et al. 2018; West, Whittaker, and Crawford 2019)</xref>
        . Often,
these reports focus on workforce implications, evoking the
primacy of the school-to-professional pipeline to address
disparities over time
        <xref ref-type="bibr" rid="ref1">(Allen-Ramdial and Campbell 2014)</xref>
        .
      </p>
      <p>This paper offers a critical discussion of the AI diversity
pipeline, highlighting existing approaches to fostering
inclusivity, and articulating points of tension that may hinder
sustainability and wider participation. Reframing how the
AI pipeline functions is essential to achieving substantive,
durable practices that support social justice, scientific, and
technological advancements. We look to current higher
educational research on learning, fairness, and inclusivity within
STEM fields to discuss how broadscale representation can
be balanced with the technical and bottomline priorities of
AI development and deployment. At the heart is the need
to identify the causes and intersecting effects of structural
racism on AI as a field and as a community. One aim is to
reconcile existing representational imbalances of URM
populations with some of the critical discussions on the potential
detrimental effects of AI tools and processes that may
exacerbate racial and ethnic inequalities, unleash models with
opaque processes, and create new forms of disparate impact.</p>
      <p>An overview of existing AI diversity pipeline initiatives
reveal interventions that
• are linear. Such interventions offer a small set of entry
points, typically at the undergraduate or high school
levels. They privilege a model based on professional
development, positing that earlier and broader exposure
CCooppyyrriigghhtt©©2022012f1o,r Athsissopcaipaetirobny fitosratuhtehoArsd.vUasnecepmeremnittteodf uAnrdteifircial
ICnrteealltiivgeenCcoem(mwownws.Laiacaein.soergA).ttrAiblultrioignh4ts.0rIensteerrvneadtio.nal (CC BY 4.0).
to AI will increase underrepresented populations within
the workforce. While logical, such processes tend to be
leaky, excluding participants due to the limited number
of pathways or disengaging members if they pursue
nonhierarchical or delayed trajectories. (Scott et al. 2018);
• do not recognize holistically the perspectives of the URM
member traversing AI. Existing initiatives offer technical
training and professional overviews, but often fail to
recognize the importance of inclusive cohort building and
social identity development. These interventions may also
not connect to issues of inclusion in post-educational
environments;
• may target students from Minority Serving Institutions
(MSIs), but do not account for complex challenges and
disproportionate inequities observed at these institutions.
Relatedly, recruitment efforts of URM faculty and staff
may not acknowledge the plethora of commitments that
mark their academic and professional lives; and
• may inadvertently replicate existing inequalities by
resisting explicit discussion of race, gender, and intersectional
identities.</p>
      <p>
        Recently, McGee (McGee 2020) examines structural
racial inequities within STEM higher education, positing
that most diversity programs do not make sustained impact
due to a lack of dialogue on structural racism and its effects.
McGee argues for an in depth look at how historical
exclusionary practices within STEM linger to the present time,
and what links exist to scientific knowledge and education.
The advanced pace at which AI is developing marks an
urgent need to build better pathways that recognize the
persistent and oft latent impacts of historical practices. Within
ethical AI and related research, scholars have begun to
reference the need for inclusion within AI, but focus on
general topics like justice and fairness, transparency,
professional responsibility, and promotion of human values
        <xref ref-type="bibr" rid="ref5">(Fjeld
et al. 2020; Jobin, Ienca, and Vayena 2019)</xref>
        . Racial and
identity-based equality is referenced, though in the context
of marginalized identities as a singular group.
      </p>
      <p>The AI diversity pipeline should take into account more
contextual realities of URM learners and scholars, and
incorporate existing best practices about STEM education
pipelines that value various levels of mentorship,
curricular and co-curricular supports, and professional training. The
pipeline must be specific to AI as an interdisciplinary,
emergent, and multivalent field, and therefore look to a diverse
set of participants who impact and are impacted by AI. A
new AI diversity pipeline, therefore, should
• take place within an ethical framework dedicated to social
justice within AI education, technical development, and
professional practices. There should be a concerted effort
to tie diversity initiatives to the ethical systemic change in
AI curriculum development and evaluation;
• allow for multiple entry points at varying levels of
technical preparation;
• offer more meaningful joint participatory initiatives
between MSI institutions and majority-serving institutions
and corporations;
• take into consideration structural imbalances that happen
at the institutional level, particularly for partnerships
between different institutional types;
• leverage current learning science research that is
perspectival and contextual;
• dig deeper into the educational pipeline by building strong
connections at the pre-secondary school level. Looking
beyond undergraduate and even secondary education
recognizes the value of early interventions as younger
learners are developing their sense of selves and basic
conceptual knowledge;
• include stakeholders at individual, department,
institutional, and corporate levels, adding diverse
disciplinary and role-based representation. Incorporating
current stakeholder theory (Jones, Wicks, and Freeman
2017) is important to ground ethical value creation,
though there need to be AI-specific models; and
• connect explicitly to research developments, which
should in turn address diversity implications.</p>
      <p>Current higher education scholarship calls for an
acknowledgement of the role that systemic racism plays in disparities
during and beyond the educational experience. Within the
AI space, this acknowledgement would naturally lead to
critiquing the meritocracy perspective that privileges technical
expertise. This would also reposition AI research to
introduce ethical implications more systematically in the quest to
advance system or model accuracy, speed, and capacity.</p>
      <p>Creating a successful AI diversity pipeline extends
beyond recruiting URM members to populate our professional
ranks and pulls together diverse stakeholders with a vested
interest in making AI more inclusive. A sustainable model
makes a place for social identity, and offers holistic
experiences that resist the model of participants learning to fit
within the existing mold of the AI professional or researcher
or student.</p>
      <p>McGee, E. O. 2020. Interrogating Structural Racism in
STEM Higher Education. Educational Researcher 49(9):
633–644.</p>
      <p>Scott, A.; Klein, F. K.; McAlear, F.; Martin, A.; and Koshy,
S. 2018. The Leaky Tech Pipeline: A Comprehensive
Framework for Understanding and Addressing the Lack of
Diversity across the Tech Ecosystem. Technical report,
Kapor Center for social Impact. URL https://leakytechpipeline.
com/wp-content/themes/kapor/pdf/KC18001 report v6.pdf.</p>
      <p>West, S. M.; Whittaker, M.; and Crawford, K. 2019.
Discriminating Systems: Gender, Race, and Power in AI. White
Paper, AI Now Institute.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Allen-Ramdial</surname>
            ,
            <given-names>S.-A. A.</given-names>
          </string-name>
          ; and
          <string-name>
            <surname>Campbell</surname>
            ,
            <given-names>A. G.</given-names>
          </string-name>
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <article-title>Reimagining the Pipeline: Advancing STEM Diversity, Persistence, and Success</article-title>
          .
          <source>BioScience</source>
          <volume>64</volume>
          (
          <issue>7</issue>
          ):
          <fpage>612</fpage>
          -
          <lpage>618</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Brundage</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Avin</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Clark</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ; Toner,
          <string-name>
            <surname>H.</surname>
          </string-name>
          ; Eckersley,
          <string-name>
            <given-names>P.</given-names>
            ;
            <surname>Garfinkel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            ;
            <surname>Dafoe</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ;
            <surname>Scharre</surname>
          </string-name>
          ,
          <string-name>
            <surname>P.</surname>
          </string-name>
          ; Zeitzoff,
          <string-name>
            <given-names>T.</given-names>
            ;
            <surname>Filar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            ;
            <surname>Anderson</surname>
          </string-name>
          ,
          <string-name>
            <surname>H.</surname>
          </string-name>
          ; Roff,
          <string-name>
            <surname>H.</surname>
          </string-name>
          ; Allen,
          <string-name>
            <given-names>G. C.</given-names>
            ;
            <surname>Steinhardt</surname>
          </string-name>
          ,
          <string-name>
            <surname>J.</surname>
          </string-name>
          ; Flynn,
          <string-name>
            <given-names>C.</given-names>
            ; hE´ igeartaigh, S. ;
            <surname>Beard</surname>
          </string-name>
          ,
          <string-name>
            <surname>S.</surname>
          </string-name>
          ; Belfield,
          <string-name>
            <surname>H.</surname>
          </string-name>
          ; Farquhar,
          <string-name>
            <given-names>S.</given-names>
            ;
            <surname>Lyle</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            ;
            <surname>Crootof</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            ;
            <surname>Evans</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            ;
            <surname>Page</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ;
            <surname>Bryson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            ; Yampolskiy, R.; and
            <surname>Amodei</surname>
          </string-name>
          ,
          <string-name>
            <surname>D.</surname>
          </string-name>
          <year>2018</year>
          .
          <source>The Malicious Use of Artificial Intelligence: Forecasting</source>
          , Prevention, and Mitigation. arXiv:
          <year>1802</year>
          .07228 [cs] URL http://arxiv.org/abs/
          <year>1802</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          07228. ArXiv:
          <year>1802</year>
          .07228.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Fjeld</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ; Achten,
          <string-name>
            <given-names>N.</given-names>
            ;
            <surname>Hilligoss</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            ;
            <surname>Nagy</surname>
          </string-name>
          ,
          <string-name>
            <surname>A.</surname>
          </string-name>
          ; and Srikumar,
          <string-name>
            <surname>M.</surname>
          </string-name>
          <year>2020</year>
          .
          <article-title>Principled Artificial Intelligence: Mapping Consensus in Ethical and Rights-Based Approaches to Principles for AI</article-title>
          .
          <source>SSRN Scholarly Paper ID 3518482</source>
          , Social Science Research Network, Rochester, NY. URL https: //papers.ssrn.com/abstract=3518482.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>