i




    Intelligent Tutoring Systems Conference
                    (ITS) 2018

             Montreal, Quebec, Canada
                  Industry Track Proceedings

  Included herein are the industry track proceedings for the ITS 2018
 Conference held in Montreal, Quebec, Canada. The industry track is
composed of two workshops held on Tuesday, 12 June 2018 at the Uni-
   versity of Quebec at Montreal (UQAM). The two workshops are:
                      W7 – ITS Applications
          W8 - Standards for Adaptive Instructional Systems




                       Industry Track Chair:
                     Robert A. Sottilare, Ph.D.
                     US Army Research Laboratory




Copyright © 2018 for all papers contained in these proceedings are held
                            by its authors.
        Copying permitted for private and academic purposes.
ii
iii


                                      Preface

First, I would like to thank all of the authors, speakers, and workshop committee mem-
bers who contributed to a very successful industry track. The two workshops that made
up the ITS Conference industry track were conducted on 12 June 2018 at the University
of Quebec at Montreal (UQAM). Workshop 7 was focused on tools and methods used
to author, distribute, manage, and experimentally evaluate Intelligent Tutoring Systems
(ITSs) and their component technologies in support of adaptive instruction. Adaptive
instruction uses computers and AI to tailor training and educational experiences to the
goals, learning needs, and preferences of each individual learner and team of learners.
The ITS Applications Workshop (Workshop 7) was proposed to engage ITS users, de-
velopers, and collaborators in a discussion of their applications, tools, methods, and
general experiences with ITSs.

Workshop 8 was focused on exploring opportunities for standards for a class of tech-
nologies known as Adaptive Instructional Systems (AISs). Adaptive instruction uses
computers and AI to tailor training and educational experiences to the goals, learning
needs, and preferences of each individual learner and team of learners. In December
2017, the IEEE Learning Technologies Standards Committee (LTSC) approved the for-
mation of a study group to examine the feasibility and efficacy of standards for AISs.
This workshop (along with workshops at other conferences) were proposed to expose
the broader ITS community to recent activities and plans, and solicit input on low hang-
ing fruit (near-term opportunities) to develop AIS standards. In June 2018, the IEEE
approved the formation of a working group to begin the task of forming AIS standards.
If you have interest in participating in IEEE Project 2247, please sign up through the
Center for Adaptive Instructional Sciences (CAIS) at instructionalsciences.org.



                                                                            June 2018
                                                                       Robert Sottilare
                                                                                iv


                             Table of Contents

Workshop 7 – Intelligent Tutoring System Applications                      1

Adaptive Learning Capability: User-Centered Learning at the Next Level     3
Barbara Buck, Matt Genova, Brandt Dargue & Elizabeth Biddle

Developing a Large-scale Feedback System to Train Dialogue-based Tutors    11
using Student Annotations
Cassius D'Helon, Vinay Kasireddy, Nirmal Mukhi & Jae-Wook Ahn

Technology for Revolutionary authoring of Adaptive Intelligent Tutors      19
(TRAIT)
Perakath Benjamin, Kumar Akella, & Andrew Stephenson

An Individualized Approach for Realtime Sensor-based Affective Modeling    29
with Intelligent Tutoring Systems
Keith Brawner & Jon Rowe

The Development of a Web Application for Assessment by Tests Generated     37
using genetic-based algorithms
Doru Anastasiu Popescu, Victor Tița & Nicolae Bold

Workshop 8 – Standards for Adaptive Instructional Systems (AISs)           47

Exploring the Opportunities and Benefits of Standards for Adaptive         49
Instructional Systems
Robert Sottilare, Avron Barr, Robby Robson, Xiangen Hu & Arthur Graesser

Component Interaction within the Generalized Intelligent Framework for     55
Tutoring (GIFT) as a Model for Adaptive Instructional System Standards
Robert Sottilare & Keith Brawner

Domain Models, Student Models, and Assessment Methods: Three Areas in      63
Need of Standards for Adaptive Instruction
Daniel McCoy

Proposed Standard for Metadata Tagging with Pedagogical Identifiers        73
Jeanine A. DeFalco