<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Fostering a Learning Community in MOOCs</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Cindy E. Hmelo-Silver</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Carolyn P. Rosé</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jeff Levy</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Carnegie Mellon University5000</institution>
          <addr-line>Forbes Avenue Pittsburgh, PA 15217</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Indiana University 543 Eigenmann Hall Bloomington IN 47406</institution>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>OfficeHours 817 W. Peachtree St Atlanta GA 30308</institution>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>To accomplish larger scale facilitation, there are two
important aspects to consider. One is identify markers of both
collaborative activities and disciplinary content and/or
practices. Some of these might include indicators such as making
contributions, asking responding to questions, social network
analysis, or indicators of transactivity. Learning analytics (LA)
techniques are important to be able to accomplish this [4; 5]. The
markers of disciplinary content and practices may be more
difficult to measure. The second aspect is acting on what is
learned through LA. A first step might be a dashboard that might
alert instructors as to where they might need to intervene as well
as suggesting appropriate strategies.</p>
      <p>Research on these massive networked communities should
build on research on best practices in CSCL and problem-based
learning (PBL; e.g., [3; 6-10]). This research suggests that certain
instructional goals can support productive collaboration, and that
there are particular cognitive, metacognitive, and social strategies
that can best serve particular kinds of goals. For example, in some
groups such as a PBL group, goals might include:</p>
      <p>Educational Goals for students:</p>
      <p>For TA’s or any kind of automated agents to use these
strategies, it will be important to have indicators so that whatever
the facilitation strategy needed, there is some way to first indicate
that attention is needed in a group. Some of this might be
timed-for example, having a group summarize where they are could be
done at intervals based on the ebb and flow of course assignments
and content difficulty. Some of the social prompts could be based
on shallow indicators like participation and length of
posts. Others would need more semantically oriented
indicators. For example, the first time that someone mentions or
proposes some complex idea, it would be reasonable to ask the
group if they understand. Semantic indicators could compare what
is being discussed with key course objectives and past
discussion. To the extent that these indicators can be identified,
these are other places where simple intervention might be quite
productive. An area ripe for research is identifying these
indicators, understanding what kinds of strategies might be
generally useful and the extent to which these indicators are
amenable to computational solutions.</p>
      <p>
        In our computational work, we have been developing
techniques for extracting indicators within messages that tell us
something about a student’s orientation at a time point (i.e., a
week of participation within the course) towards the course, which
will enable us to make a prediction about how likely it is that the
student will drop out of the course on the next time point. The
relevant levels of analysis are post, week, and trajectory within the
course. First, we extract indicators from individual
messages. Then we aggregate messages within a week in order to
construct an indicator for a week. We then use a survival analysis
to model the probability that the student with drop out on the next
time point given the value of the variable. In this way, we can
identify risk factors that instructors should be aware of so that
they can focus their efforts to support those students. Indicators
we have explored include social network analysis measures such
as authority and hub scores [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], indicators of social subgraph
membership [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] measures of motivation and cognitive
engagement [11], and indicators of relationship formation and
measures of loss of relationship due to attrition of other students
[12]. Overall, we find that measures of high authority and hub
scores as well as high numbers of formed relationships predict
lower attrition, as do measures of high motivation and high
cognitive engagement. Conversely, measures of relationship loss
predict higher dropout. Similarly, membership in subgroups
where there is high attrition also predicts higher attrition. To
model relationship formation over time, we are experimenting
with probabilistic graphical models that combine text, social
network, and thread structure representation in order to identify
coordinated group behavior that may indicate the formation of a
subcommunity [13]. Beyond measures at the student level that
pick out students who are at risk and may need extra attention, we
use structural equation modeling techniques to identify the factors
that affect whether a thread that is started by a student who is
reaching out for help will get a satisfactory response. In order to
reduce the load on instructors, we are developing matrix
factorization techniques to identify community members whose
effort we may be able to enlist to respond to at risk threads [14].
      </p>
      <p>Recent research in the learning sciences has begun to
address how to use LA productively [15]. At the same time,
MOOCs can provide transformative opportunities for learners if
we can identify and support learning communities within the
larger communities. Bringing the LA and learning sciences
communities together for discussion and joint efforts can provide
opportunities to better understand how to facilitate learning
communities in this frontier.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Rosé</surname>
            ,
            <given-names>C.P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Carlson</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yang</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wen</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Resnick</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goldman</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Sherer</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <year>2014</year>
          .
          <article-title>Social Factors that Contribute to Attrition in MOOCs</article-title>
          .
          <source>In Proceedings of the First ACM Conference on Learning @ Scale.</source>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>Yang</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sinha</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Adamson</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Rosé</surname>
            ,
            <given-names>C.P.</given-names>
          </string-name>
          ,
          <year>2013</year>
          . Turn on, Tune in, Drop out:
          <article-title>Anticipating student dropouts in Massive Open Online Courses</article-title>
          .
          <source>In Proceedings of the NIPS Data-Driven Education Workshop</source>
          (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Hmelo-Silver</surname>
            ,
            <given-names>C.E.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Barrows</surname>
            ,
            <given-names>H.S.</given-names>
          </string-name>
          ,
          <year>2006</year>
          .
          <article-title>Goals and strategies of a problem-based learning facilitator</article-title>
          .
          <source>Interdisciplinary Journal of Problem-based Learning 1</source>
          ,
          <fpage>21</fpage>
          -
          <lpage>39</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Mu</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stegmann</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mayfield</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rosé</surname>
            ,
            <given-names>C.P.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Fischer</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <year>2012</year>
          .
          <article-title>The ACODEA Framework: Developing Segmentation and Classification Schemes for Fully Automatic Analysis of Online Discussions</article-title>
          .
          <source>International Journal of Computer Supported Collaborative Learning</source>
          <volume>7</volume>
          ,
          <fpage>285</fpage>
          -
          <lpage>305</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>Gweon</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jain</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mc</surname>
            <given-names>Donough</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Raj</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            , and
            <surname>Rosé</surname>
          </string-name>
          ,
          <string-name>
            <surname>C.P.</surname>
          </string-name>
          ,
          <year>2013</year>
          .
          <article-title>Measuring Prevalence of OtherOriented Transactive Contributions Using an Automated Measure of Speech Style Accommodation</article-title>
          .
          <source>International Journal of Computer Supported Collaborative Learning</source>
          <volume>8</volume>
          ,
          <fpage>245</fpage>
          -
          <lpage>265</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>Bielaczyc</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kapur</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , and Collins,
          <string-name>
            <surname>A.</surname>
          </string-name>
          ,
          <year>2013</year>
          .
          <article-title>Cultivating a community of learners in a K-12 classroom</article-title>
          . In International Handbook of Collaborative Learning,
          <string-name>
            <given-names>C.E.</given-names>
            <surname>Hmelo-Silver</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.A.</given-names>
            <surname>Chinn</surname>
          </string-name>
          ,
          <string-name>
            <surname>C.K.K. Chan</surname>
          </string-name>
          and
          <string-name>
            <surname>A.M. O'Donnell Eds</surname>
          </string-name>
          . Routledge, New York,
          <fpage>233</fpage>
          -
          <lpage>249</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>Chan</surname>
            ,
            <given-names>C.K.K.</given-names>
          </string-name>
          ,
          <year>2013</year>
          .
          <article-title>Collaborative knowledge building: Towards a knowledge creation perspective</article-title>
          . In International Handbook of Collaborative Learning,
          <string-name>
            <given-names>C.E.</given-names>
            <surname>Hmelo-Silver</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.A.</given-names>
            <surname>Chinn</surname>
          </string-name>
          ,
          <string-name>
            <surname>C.K.K. Chan</surname>
          </string-name>
          and
          <string-name>
            <surname>A.M. O'Donnell Eds</surname>
          </string-name>
          . Taylor and Francis, New York,
          <fpage>437</fpage>
          -
          <lpage>461</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>Chinn</surname>
            ,
            <given-names>C.A.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Clark</surname>
            ,
            <given-names>D.B.</given-names>
          </string-name>
          ,
          <year>2013</year>
          .
          <article-title>Learning through collaborative argumentation</article-title>
          . In International Handbook of Collaborative Learning, C. HmeloSilver,
          <string-name>
            <given-names>C.A.</given-names>
            <surname>Chinn</surname>
          </string-name>
          ,
          <string-name>
            <surname>C.K.K. Chan</surname>
          </string-name>
          and
          <string-name>
            <surname>A.M. O'Donnell Eds</surname>
          </string-name>
          . Routledge, New York,
          <fpage>314</fpage>
          -
          <lpage>332</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>Fischer</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kollar</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Weinberger</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stegmann</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wecker</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Zottmann</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <year>2013</year>
          .
          <article-title>Collaboration Scripts in Computer-Supported Collaborative Learning</article-title>
          .
          <source>International Handbook of Collaborative Learning</source>
          , Routledge, New York,
          <fpage>403</fpage>
          -
          <lpage>419</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <surname>Schwarz</surname>
            ,
            <given-names>B.B.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Asterhan</surname>
            ,
            <given-names>C.S.</given-names>
          </string-name>
          ,
          <year>2011</year>
          .
          <article-title>EModeration of synchronous discussions in educational settings: A nascent practice</article-title>
          .
          <source>Journal of the Learning Sciences 20.</source>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>Martin</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Sherin</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <year>2013</year>
          .
          <article-title>Learning analytics and computational techniques for detecting and evaluating patterns in learning: An introduction to the special issue</article-title>
          .
          <source>Journal of the Learning Sciences</source>
          <volume>22</volume>
          ,
          <fpage>511</fpage>
          -
          <lpage>520</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>