=Paper= {{Paper |id=Vol-3136/paper3 |storemode=property |title=Integrating human-centered artificial intelligence in programming practices to reduce teachers' workload |pdfUrl=https://ceur-ws.org/Vol-3136/paper-3.pdf |volume=Vol-3136 |authors=Renate Andersen,Eli Gjølstad,Anders Mørch |dblpUrl=https://dblp.org/rec/conf/avi/AndersenGM22 }} ==Integrating human-centered artificial intelligence in programming practices to reduce teachers' workload== https://ceur-ws.org/Vol-3136/paper-3.pdf
Integrating Human-Centered Artificial Intelligence                                                                              in
Programming Practices to Reduce Teachers’ Workload
Renate Andersen1, Eli Gjølstad1 and Anders I. Mørch2
1
    Oslo Metropolitan University, Pilestredet 52 Oslo, 0167, Norway
2
    University of Oslo, Gaustadalléen 21, Oslo, 0349, Norway

                                  Abstract 1
                                  Artificial intelligence (AI) has impacted every industry, including the education sector. In this
                                  position paper, we explore how human-centered AI (HCAI) can be integrated in programming
                                  activities in school rather than discussing the design of user interfaces of HCAI systems. Our
                                  main proposal is to integrate HCAI in educational practices to reduce teachers’ workload by
                                  providing meaningful scaffolds to the learners, connecting technology and domain knowledge.

                                  Keywords
                                  Human-centered AI, education, programming, school, scaffolding


1. Introduction

    Human-centered artificial intelligence (HCAI) has received increasing attention in recent years,
including the national educational systems worldwide. The United Nations Educational, Scientific and
Cultural Organization (UNESCO)’s (2022) mandate is to focus on human-centered approaches to AI–
“AI for all,” where everyone can take advantage of the technological revolution underway and access
it. UNESCO states that the connection between AI and education involves three main areas: 1) learning
with AI (e.g., the use of AI-empowered tools in classrooms), learning about AI (AI technologies and
techniques), and preparing for AI (e.g., enabling citizens to better understand the potential impact of AI
on human lives [14]. Here, we focus on the first approach, “learning with AI.”
     Although HCAI in education is an emerging field, there remains limited research. Nonetheless,
Yang et al. [17] state that the research trends have brought new applications of AI in education, e.g.,
adoption of machine learning and new deep learning algorithms. Furthermore, AI research can
potentially improve intelligent tutoring with more precise adaptation and personalization. When
focusing on HCAI, the emphasis is on “learning with AI,” e.g., Replika [7], a virtual friend or a chatbot
companion powered by AI; Thinkster [12], a virtual math tutor built with AI to create personalized
learning programs; and Cognii [2], a virtual learning assistant that engages students using
conversational AI. This position paper adds to the debate along this line of research. The research
questions addressed in this paper are as follows: 1) How is programming integrated in learning school
subjects? and 2) How can programming take advantage of HCAI to improve learning? This paper
focuses on exploring how HCAI can be integrated into programming activities in schools, not on the
design of user interfaces for AI systems. We ground our position and discussion of HCAI in research
as activities that stem from educational research on programming in schools.




Proceedings of CoPDA2022 - Sixth International Workshop on Cultures of Participation in the Digital Age: AI for Humans or Humans for
AI? June 7, 2022, Frascati (RM), Italy
EMAIL: renatea@oslomet.no (R. Andersen); Eli.Gjolstad@oslomet.no (E. Gjølstad); anders.morch@iped.uio.no (A. I. Mørch)
ORCID: 0000-0002-1206-2140 (R. Andersen); 0000-0002-1470-5234 (A. I. Mørch)
                               © 2022 Copyright for this paper by its authors.
                               Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).
    CEUR
    Wor
    Pr
       ks
        hop
     oceedi
          ngs
                ht
                I
                 tp:
                   //
                    ceur
                       -
                SSN1613-
                        ws
                         .or
                       0073
                           g
                               CEUR Workshop Proceedings (CEUR-WS.org)




                                                                                                     30
2. Related work
2.1. Human-centered artificial intelligence

    HCAI empowers developers to build and design AI systems that support human self-efficacy,
promote creativity, clarify, and distribute responsibility, and facilitate social participation [11], thus
putting humans at the center of design thinking. Shneiderman [11] underscores that the goal in HCAI
is to put human users at the center, emphasizing user experience design, measuring human performance,
and celebrating the new powers that people have. However, this contradicts the traditional AI view
where developers and researchers focus on building AI algorithms and systems for machine autonomy,
measuring algorithmic performance, and celebrating what AI can do on its own. Therefore,
Shneiderman [10] argues that HCAI presents three ideas that go beyond automatization: 1) the
possibility of high levels of human control and high levels of automation, 2) shift from emulating
humans to empowering people, and 3) governance structures for HCAI (reliable, safe, and trustworthy
systems).
    It is important to highlight that at the heart of HCAI is to recognize that the way intelligent systems
solve problems, especially machine learning, is fundamentally alien to humans without computer
science knowledge [8]. This underscores the need for future generations of pupils to learn about
programming, computational thinking, and computer science to enable them to understand the
algorithms underlying advanced AI systems such as deep learning and be able to interpret them
effectively. Riedl [8] emphasizes that HCAI can be divided into two main aspects: 1) AI systems that
understand humans from a sociocultural perspective and 2) AI systems that help humans understand
themselves. In this paper, we focus on the first aspect, which is useful when discussing HCAI in the
context of an educational institution. Shneiderman [10]. presents an HCAI framework using three main
ideas: 1) design for high levels of human control and high levels of automation, 2) understand the
situations in which full human control or full computer control are necessary, and 3) avoid the dangers
of excessive human control or excessive computer control.

2.2.    A sociocultural perspective on learning

    In a sociocultural perspective on learning, learning is seen as context-bound, situated in
socialpractices, and mediated by symbolic and cultural artifacts. Hence, this approach emphasizes
participation in different social practices [9]. This paper takes on the view that learning can best be
understood as social interactions mediated by artifacts; more precisely, in our case, the learning
processes during programming are mediated by technological tools, resulting in social interactions
between the teachers, learners, and AI chatbot. A central concept within the sociocultural perspective
on learning is pedagogical scaffolding [16]. Hammond and Gibbons [3] define scaffolding as how
teachers and other seniors help and support peers by providing feedback in the learning process. Maybin
and colleagues [4] define scaffolding as different kinds of support the learners receive in their
interaction with parents, teachers, and other mentors as they move towards new skills or concepts. A
current direction in this area is automated text analysis, such as EssayCritic [6]. Another central concept
in a sociocultural perspective on learning is the zone of proximal development, which is a key concept
derived by Vygotsky [15] as ways in which individuals move between different stages of development
and their potential learning levels.

3. Methods
   The empirical data presented in this article is derived from a design-based research project [5], in
which we were participant observers in a classroom that used block-based programming (MakeCode in
micro:bit) as an exploratory design space for solving physics tasks assigned by the teacher. The project
consists of four interventions over a 2-year period including a total of 130 pupils aged 12–16 years. The
pupils met 3 hours/week for 16 weeks over 2 semesters. Data were collected using video recordings of
classroom interventions. The data presented below is derived from the last intervention, fourth, where



                                                     31
we were in a physics lab and recorded a video of a group of pupils using programming for solving
physics tasks.
   Thematic analysis was used to analyze the entire dataset and screen for emerging common topics.
Thematic analysis is a qualitative method for identifying and organizing patterns of meanings across a
dataset to enable the researcher to make sense of collective or shared meaning and experiences [1].
Examples of thematic codes that emerge when screening data are knowledge sharing, programming,
computational concepts, and collaboration.

4. Findings and design scenario to include human-centered AI

    In this section, we will address the research questions: 1) How is programming integrated into
learning school subjects? and 2) How can programming take advantage of HCAI to improve learning?
We address the research questions by presenting two different data excerpts that show how pupils work
when using programming for solving physics tasks assigned by the teacher. Presenting the empirical
data extract address the first part of the research question exemplifying how programming is integrated
into school subjects. This is useful to provide a realistic context of how these data can be extended to
integrate HCAI as a scaffold to help the learner. However, in the table where the data is presented, we
have added a column named “AI chatbot,” which is our design scenario, being an example of how
HCAI can be integrated and connected to programming practices when using micro:bit in an educational
context.
    When sketching out a design scenario for how a micro:bit can be extended to include HCAI, we
uncovered that there are at least two different yet relevant directions: 1) focusing on scaffolding the
domain-specific knowledge learning process (in our example, physics) or 2) scaffolding learning
programming and how to use the micro:bit (a third approach emphasizing collaboration is presented as
direction for further work). We will present one design scenario from each to cover both directions,
reflecting data extract 1 and data extract 2. Data extract 1 and 2 below derive from one physics class
where the students use micro:bit for solving physics related tasks. The AI chatbot presented in the fourth
column in the tables is not included per se in the study, as it is created as an add-on for suggesting a
future design scenario for reflecting on how an AI chatbot can be integrated in an already existing
technology used in school, the micro:bit. These data extracts derive from a research project where we
developed and implemented technology rich interventions in several K-12 classrooms, consisting of
pupils ranging 12-16 years old. We followed three classes (20 students in each class) over two years
and videorecorded our observations in the classroom of the students when they were working in groups
on using micro:bit for solving subject-specific tasks. The scenarios are based on the lessons we learned.
    Table 1 below presents data extract 1 derived from a lesson in physics where four pupils are working
together on a task given by the teacher on how to program and use a micro:bit to measure conductivity.
The pupils are experiencing problems with the micro:bit and the code as the assembly is not working
properly in connection with measuring conductivity. Two of the four pupils are discussing the problem
that starts by one of them asking a question.

Table 1. Data extract 1. Pupils using micro:bit to measure conductivity.
 Line     Participant     Verbal utterance (comments in parenthesis)          AI chatbot
    1     Student 1       “Shall we see on the micro:bit. It looks like       What are you working on now?
                          that.” (Looks at the code on the screen)
    2     Student 2       “Yes. Because the number is there.” (pointing
                          to the micro:bit)
                          “I think that’s correct.”
    3     Student 1       “Okay.”
    4     Student 2       “We can try it here again.” (Connects the wires     Are you having trouble with how to connect
                          and measures conductivity)                          pin1 and pin2 to the micro:bit? Type yes, if
                                                                              you need help.
    5     Student 1       “Ok. Fine now! (Does it work?)”
    6     Student 2       “But it shows that the air conducts electricity?”   Are you still having a problem with
                                                                              connecting pin1 and pin2 to the micro:bit?




                                                        32
                                                                               I can see you have also connected a
                                                                               resistor, is the resistance correct?
    7     Student 1      “Okay, then we’ll see if we have connected
                         something wrong (with the micro:bit).”
    8     Student 2      (Checks the wires) “Okay, the wires are               Have you checked that the wires are
                         connected properly to the micro:bit, but what’s       connected?
                         weird is to be seen here!” (Holds the pins up in
                         the air and micro:bit shows that it conducts
                         electricity)
    9     Student 1      “Maybe the air does conduct electricity then.”
    10    Student 2      “No!” (Frustrated)
                         “If the current had moved through then you
                         would have seen it. Then it would have jumped
                         lightning and you would have heard it.”
    11    Student 1      (Looking at the code for the micro:bit) “Press        I will help you solve the problem. I will give
                         B for conductivity and A for resistance ..., but      you a list of possible solutions – type yes to
                         there is something wrong here … . Look here.          the solution that you have tested.
                         I did not hold them close to each other and the
                         micro:bit shows 0.001! And it is physically
                         impossible.”

   Table 2 presents data extract 2, where the pupils are discussing how to use micro:bit to test
conductivity on different objects.

Table 2: Data extract 2: Using micro:bit to test conductivity on different objects
 Line    Participant     Verbal utterance (comments in parenthesis)             AI chatbot
    1    Student 3       “All the measures get the result of 0,001.” (Using     Greetings, what are you using the micro:bit
                         the micro:bit to measure the conductivity on his       for today?
                         own finger)
    2    Student 4       “I’m not holding them (the pins on the micro:bit       Right now, you are not measuring
                         that measures conductivity) to anything, and the       Conductivity in the air, I can feel that I am
                         micro:bit shows 0.001, and it’s physically             not connected to anything with pin 1 and
                         impossible. Okay, then we have to find out what        pin2. Please plug the pins to the object you
                         happened.” (Using the micro:bit to measure the         are going to measure conductivity through,
                         conductivity in the air)                               and I will give you the answer.
    3    Student 3       “It probably has something to do with the fact that    What are you measuring the conductivity of
                         there are salts (sodium compounds) and minerals        now?
                         that conducts electricity relatively good.”
                         (Measures the conductivity of Farris (mineral
                         water)
    4    Student 4       “We can look at the nutritional content and
                         ingredient list of Cola and Pepsi afterward to see
                         if there are any differences.” (Measures the
                         conductivity of Pepsi and Cola)
    7    Student 3       “What do we think? Do we think the orange juice
                         or lemon has the highest conductivity?”
                         (Measures conductivity of a lemon)
    8    Student 4       “Acids have pretty good conductivity I have
                         heard.”



5. Discussion and conclusions: Implications for future design

   The main argument in this position paper is that integrating HCAI in education has a significant
potential to reduce teachers’ workload. As shown above, we present two data extracts regarding how
programming is practiced in schools in our country, and we extended our view of learning by adding a
column describing a design scenario concerning how an AI chatbot can scaffold these learning
processes. The AI chatbot integrated into the micro:bit can be interacted with in two ways: 1) requesting


                                                       33
the chatbot directly in the chat window (top-down invocation) or 2) it infers the need for scaffolding
based on the learner’s actions and what the learner says (bottom-up invocation). When the computer is
connected to the micro:bit, the chatbot uses the microphone on the computer, listens to the
conversations, and tries to suggest scaffolds connected to what the learners are talking about.
    However, as we can read out from extract 1 (Table 1) and extract 2 (Table 2) the AI chatbot interacts
in a multi-user context, which impacts how the AI chatbot reacts. In extract 1 and 2 we have group
collaboration as a premise, meaning several students are working together to create the code, however,
there is only one student that interacts with the computer and creates the program. This implies that
there is only one student that directly interacts with the AI chatbot during this time. However, it is
important to reflect upon how one can design a chatbot that also takes the interaction among several
interacting pupils into consideration. Can a future design scenario be that the AI chatbot can take
questions from different pupils at the same time into consideration? It would be useful with an
interactive AI chatbot that also can handle social interaction in groups. Recent research on chatbots
shows that a role for a chatbot could be to encourage non-active pupils to be more active, engaging
them in the discussions with peers and with the chatbot, helping students to become better collaborators,
identified as an important 21st century skill [13].
    Another interesting reflection around a future design issue with the AI chatbot is to examine how it
can take advantage of context-awareness. A context aware chatbot must seek to understand and support
the aims of the user. In our case, in extract 1 and 2, which is a programming context, it quite essential
that the AI chatbot can be aware of this context to be able to support the pupils in their specific learning
activity. This means that the AI chatbot should have some built in mechanism for adaptive learning that
enable to learn over time through interaction pupils of different need and background knowledge. The
IA chatbot we have profiled is a programming expert with the aim of scaffolding pupils in K-12/lower
and upper secondary school when learning programming.
    Summing up, the research contribution with this position paper is discussing a scaffolding scenario
for using an integrated chatbot in the online micro:bit programming environment for pupils to learn
together how to use a new technology in an educational context from the challenging position of relating
the technology to domain knowledge (e.g., middle school physics as we have profiled here).
    It is interesting to reflect on the impacts of HCAI on both learners and teachers. For instance, learners
get faster and instant feedback, with a greater chance of receiving more accurate answers. There are
several benefits of integrating HCAI into programming processes in schools, such as reducing teachers’
workload and enabling a more flexible and accessible teaching experience to students. However, one
of the most important challenges with creating an AI chatbot is providing it with accurate context to
enable effective interaction with the learners. As seen in previous research, scaffolding pupils is not
easy due to many complex factors that may impact the learning process. In conclusion, the main findings
in this paper are as follows:

   •    An AI chatbot can provide meaningful scaffolds to pupils when learning to program
   •    Exploring HCAI from a sociocultural perspective on learning leads to interesting aspects
        of how HCAI can be designed as scaffolds in an educational context, e.g., classrooms.
   •    Integrating HCAI in the educational context can reduce teachers’ workload.

   Future research regarding how an AI chatbot could be designed and implemented into the micro:bit
environment is warranted. Integrating HCAI in education, especially as an approach to “learning with
AI,” has great potential to reduce teachers’ workload in classroom settings.

6. References

[1] Braun, V., & Clarke, V. (2012). Thematic analysis. In H. Cooper, P. M. Camic, D. L. Long, A. T.
    Panter, D. Rindskopf, & K. J. Sher (Eds.), APA handbook of research methods in psychology, Vol.
    2. Research designs: Quantitative, qualitative, neuropsychological, and biological (pp. 57–71).
    American Psychological Association. https://doi.org/10.1037/13620-004
[2] Cognii. (2022). Artificial intelligence for education. https://www.cognii.com/



                                                      34
[3] Hammond, J., & Gibbons, P. (2005). Putting scaffolding to work: The contribution of scaffolding
     in articulating ESL education. Prospect, 20(1), 6–30.
[4] Maybin, J., Mercer, N., & Stierer, B. (1992). ‘Scaffolding’: Learning in the classroom. In K.
     Norman (Ed.), Thinking voices: The work of the National Oracy Project (pp. 186–195). Hodder &
     Stoughton.
[5] McKenney, S., & Reeves, T. C. (2018). Conducting educational design research. Routledge.
[6] Mørch, A. I., Engeness, I., Cheng, V. C., Cheung, W. K., & Wong, K. C. (2017). EssayCritic:
     Writing to learn with a knowledge-based design critiquing system. Educational Technology &
     Society, 20(2), 216–226.
[7] Replika. (2022). The AI companion who cares. https://replika.ai/
[8] Riedl, M. O. (2019). Human‐centered artificial intelligence and machine learning. Human
     Behavior and Emerging Technologies, 1(1), e117. http://dx.doi.org/10.1002/hbe2.117
[9] Säljö, R. (2001). Learning in practice: A sociocultural perspective. Cappelen Damm Akademisk.
[10] Shneiderman, B. (2020a). Human-centered artificial intelligence: Three fresh ideas. AIS
     Transactions          on        Human-Computer             Interaction,       12(3),      109–124.
     https://doi.org/10.17705/1thci.00131
[11] Shneiderman, B. (2020b). Human-centered artificial intelligence: Reliable, safe & trustworthy.
     International      Journal      of     Human–Computer           Interaction,     36(6),   495–504.
     https://doi.org/10.1080/10447318.2020.1741118
[12] Thinkster. (2022). Get hyper-personalized attention from an online math tutor. Daily.
     https://hellothinkster.com/online-math-tutor.html
[13] Trent, S. & Campa, A. (August 2021). Schools Look for Help from AI Teacher’s Assistants.
     Researchers are developing artificial intelligence aimed at keeping students engaged and saving
     educators’ time. The Wall Street Journal. https://www.wsj.com/articles/schools-look-for-help-
     from-ai-teachers-assistants-11628262062?mod=article_inline
[14] United Nations Educational, Scientific and Cultural Organization (UNESCO). (2022). Artificial
     intelligence in education. https://en.unesco.org/artificial-intelligence/education
[15] Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes.
     Harvard University Press.
[16] Wood, D., Bruner, J. S., & Ross, G. (1976). The role of tutoring in problem solving. Journal of
     Child Psychology and Psychiatry, 17(2), 89–100. https://doi.org/10.1111/j.1469-
     7610.1976.tb00381.x
[17] Yang, S. J., Ogata, H., Matsui, T., & Chen, N. S. (2021). Human-centered artificial intelligence in
     education: Seeing the invisible through the visible. Computers and Education: Artificial
     Intelligence, 2, 100008. https://doi.org/10.1016/j.caeai.2021.100008




                                                    35