<?xml version="1.0" encoding="UTF-8"?>
<TEI xml:space="preserve" xmlns="http://www.tei-c.org/ns/1.0" 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" 
xsi:schemaLocation="http://www.tei-c.org/ns/1.0 https://raw.githubusercontent.com/kermitt2/grobid/master/grobid-home/schemas/xsd/Grobid.xsd"
 xmlns:xlink="http://www.w3.org/1999/xlink">
	<teiHeader xml:lang="en">
		<fileDesc>
			<titleStmt>
				<title level="a" type="main">E m b e d d i n g R e s p o n s i b l e Al in T e c h n i c a l E d u c a t i o n C u r r i c u l u m : A Case S t u d y in an A s y n c h r o n o u s O n l i n e A d v a n c e d Data A n a l y t i c s C o u r s e</title>
			</titleStmt>
			<publicationStmt>
				<publisher/>
				<availability status="unknown"><licence/></availability>
			</publicationStmt>
			<sourceDesc>
				<biblStruct>
					<analytic>
						<author>
							<persName><forename type="first">Rhodora</forename><surname>Abadia</surname></persName>
							<affiliation key="aff0">
								<orgName type="institution">University of South Australia</orgName>
								<address>
									<settlement>Adelaide</settlement>
									<region>South Australia</region>
									<country key="AU">Australia</country>
								</address>
							</affiliation>
						</author>
						<title level="a" type="main">E m b e d d i n g R e s p o n s i b l e Al in T e c h n i c a l E d u c a t i o n C u r r i c u l u m : A Case S t u d y in an A s y n c h r o n o u s O n l i n e A d v a n c e d Data A n a l y t i c s C o u r s e</title>
					</analytic>
					<monogr>
						<idno type="ISSN">1613-0073</idno>
					</monogr>
					<idno type="MD5">517AA1B9420AF2CC7852DC59B30AEF58</idno>
				</biblStruct>
			</sourceDesc>
		</fileDesc>
		<encodingDesc>
			<appInfo>
				<application version="0.7.2" ident="GROBID" when="2025-04-23T20:08+0000">
					<desc>GROBID - A machine learning software for extracting information from scholarly documents</desc>
					<ref target="https://github.com/kermitt2/grobid"/>
				</application>
			</appInfo>
		</encodingDesc>
		<profileDesc>
			<textClass>
				<keywords>
					<term>Responsible Al in Education</term>
					<term>Ethics in Computing Education</term>
					<term>Principles of Responsible Al</term>
				</keywords>
			</textClass>
			<abstract>
<div xmlns="http://www.tei-c.org/ns/1.0"><p>The rapid growth and widespread adoption of Artificial Intelligence (Al) highlighted the urgent need for higher education institutions to reform how ethics in computing, data science, and related fields are taught. While computing and professional ethics are typically included in the curriculum, they are often presented from a social science, legal, or philosophical perspective. This paper presents a case study on integrating responsible Al principles into an asynchronous online advanced data analytics course from a technical perspective. The study found that embedding ethics throughout the curriculum using experiential learning and applied ethics was effective in fostering students' comprehension and application of responsible Al concepts. However, challenges included finding relevant case scenarios, lack of expertise among teachers, and developing suitable activities and assessments. Best practices identified include utilizing real-world case studies, implementing hands-on ethical coding exercises, and adopting interdisciplinary approaches. Lessons learned emphasize the importance of timing, practical application, and flexible curriculum design. This approach enabled students to assess and plan for the human consequences of Al applications, and design and implement risk mitigation strategies. The study represents a step forward in preparing students for ethical challenges in Al, while highlighting areas for future work, including teacher training and curriculumwide integration of responsible Al principles.</p></div>
			</abstract>
		</profileDesc>
	</teiHeader>
	<text xml:lang="en">
		<body>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="1.">I n t r o d u c t i o n</head><p>Teaching ethics in computing-related degrees are often required by accrediting bodies or board with oversight of the profession. International standards such as ABET's accreditation standard <ref type="bibr" target="#b0">[1]</ref> and ACM's Code of Ethics <ref type="bibr" target="#b1">[2]</ref>, and Australia's ACS Code of Ethics <ref type="bibr" target="#b2">[3]</ref> lay the foundation of ethics education here in Australia. The increasing permeation of Artificial Intelligence <ref type="bibr">(Al)</ref> systems lead to the concerns in the use of data, lack of trust and challenges with the use of Al. Governments and major players in the field have all started specifically looking at their practices and evaluate how they can scale up their use of Al systems and at the same time minimize Al risks. Every Al, data or related professionals has a responsibility to understand the social, political, and ethical consequences of their work. The higher education sector who produces these specialists who are more likely to use Al algorithms are compelled to rethink how they can teach the responsible use of Al. A survey made by <ref type="bibr" target="#b23">[25]</ref> looked at machine learning courses and found that students were not taught ethics and if they were, students enroll in a stand-alone ethics elective course. Most approaches to ethics education are case-based teaching where students are presented with cases, and they respond by discussing their approach and decisions using existing ethical frameworks <ref type="bibr" target="#b5">[6]</ref> [7] <ref type="bibr" target="#b28">[30]</ref>. Although this approach seems to be successful for some professions, education in Artificial Intelligence-related courses struggle to provide sound training in ethics that are essential for them to be successful in their career. Frauenberger, Rauhala, &amp; Fitzpatrick <ref type="bibr" target="#b14">[16]</ref> argued that ethical concerns are still managed in the mindset of past paradigms that largely remain static and have determined outcomes. It is only in recent years that ethical topics are integrated and infused in computing related curricula <ref type="bibr" target="#b13">[15]</ref>  <ref type="bibr" target="#b16">[18]</ref>,</p><p>7th Conference on Technology Ethics (TETHICS2024), November 6-7, 2024, Tampere, Finland Q rhoda.abadia@unisa.cdu.au O 0000-0002-8265-0503</p><p>This paper presents the experiences in integrating the responsible use of Al into an upper-level undergraduate data analytics course. Specifically, the following are the objectives of this study: 1. Describe how the course was designed to embed the principles of responsible Al in an asynchronous online course. 2. Discuss challenges faced in the course design. 3. Present best practices and lessons learned that can be used to replicate the success of the case.</p><p>The technical practical (applied) ethics approach was employed to address ethical issues in Al education. An investigation of key ethical concerns and their application within the technical practical activities proved conducive to ethical reasoning, as these activities were specifically designed to align with the subject matter of the ethical inquiry. The curriculum emphasized topics highlighted by the ACM Conference on Fairness, Accountability and Transparency (ACM FAccT). Moreover, the Principles of Responsible Al, as established by industry leaders such as Microsoft <ref type="bibr" target="#b24">[26]</ref>, Google <ref type="bibr" target="#b3">[4]</ref>, IBM <ref type="bibr" target="#b25">[27]</ref>, and Meta <ref type="bibr" target="#b11">[13]</ref> were adapted in for the course. The UNESCO recommendation on Ethics of Artificial Intelligence <ref type="bibr" target="#b43">[45]</ref> and European Commission ethics guideline for trustworthy Al <ref type="bibr" target="#b44">[46]</ref>, who were also used as a guide in this course, emphasize similar core principles such as fairness, transparency, privacy, safety, and human oversight. They also stress the importance of accountability and the need for Al to benefit society.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2.">T h e o r e t i c a l B a c k g r o u n d</head><p>This section presents the relevant literatures, theories and frameworks that were used in the development of the course.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2.1.">Principles of Responsible Al</head><p>The term responsible Al encompasses a variety of technical, legal, and ethical considerations that apply not only to Al but also to data analytics and data science. The applications of Al have grown exponentially throughout the years, and current laws, policies, and standards have not caught up with the unique challenges and risks that Al poses and the changing ways society is adopting these technologies. This is why there is a need for comprehensive guidelines. While there is increasing pressure on organizations to scale up their use of Al, there is also a growing demand for the responsible use of AL Several big organizations and international bodies have identified principles that guide the development and use of Al applications. UNESCO's Recommendation on the Ethics of Artificial Intelligence <ref type="bibr" target="#b43">[45]</ref>  Major tech companies have also developed their own frameworks. Microsoft defines responsible Al as an "advancement of Al driven by ethical principles that put people first; and making sure Al systems are developed responsibly and in ways that warrant people's trust" <ref type="bibr" target="#b24">[26]</ref>, Accenture defines responsible Al as "the practice of designing, developing, and deploying Al with good intention to empower employees and businesses, and fairly impact customers and society" <ref type="bibr" target="#b26">[28]</ref>. <ref type="bibr">Google Al [4]</ref>, IBM <ref type="bibr" target="#b25">[27]</ref>, Microsoft <ref type="bibr" target="#b24">[26]</ref>, and Meta <ref type="bibr" target="#b11">[13]</ref> have common principles that can be classified into five categories: fairness and inclusion, transparency and explainability, reliability and safety, privacy and security, and accountability.</p><p>Fairness refers to the lack of bias. Including and involving diverse people creates data diversity which helps p r e v e n t bias. T r a n s p a r e n c y and explainability refer to the need for Al systems and their related c o m p o n e n t s to be understandable, explainable, and interpretable. Reliability and safety refer to Al systems being built and tested for safety, performing what they were originally designed to do, r e s p o n d i n g safely to new situations, and resisting u n i n t e n d e d manipulation. Privacy and security principles include the incorporation of privacy and security in the design of Al systems. The goal is to ensure that all data, whether personal and/or sensitive, should be used ethically in all Al systems. Lastly, the accountability principle refers to making people who design, develop, and deploy Al systems accountable for the impact of actions and decisions of the technology. This includes making users of the system accountable for how they use the systems.</p><p>A recent big player in the development of artificial general intelligence (AGI) applications is OpenAI. OpenAI's principles, however, do not seem to address most of the concerns raised in the responsible use of Al <ref type="bibr" target="#b27">[29]</ref>. OpenAI's principles focus on broadly distributed benefits, l o n g -t e r m safety, technical leadership, and cooperative orientation.</p><p>While there are some variations in emphasis and terminology, these various frameworks and guidelines share common themes: algorithmic fairness and diversity, reliability and safety, privacy and security, and transparency and accountability. Thes principles form the foundation for the ethical development and deployment of Al systems across various domains and applications.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2.2.">Teaching Ethics</head><p>Teaching ethics can be classified as theoretical and applied ethics to distinguish where is the focus of the ethical investigations <ref type="bibr" target="#b14">[16]</ref>. Theoretical ethics often concerns itself with the understanding of the nature, language, and reasoning in ethics. Applied ethics is the practical application of the ethical theory to a problem specific to the field in question.</p><p>There are several best practices in teaching ethics in law, health, engineering, Information Technology, and business. Azim &amp; S h a m i m <ref type="bibr" target="#b4">[5]</ref> looked at educational theories that inform the education strategies for teaching ethics in u n d e r g r a d u a t e medical education and found that reflection, constructivist, and experiential learning theories are best suited in guiding strategies in teaching ethics. A E u r o p e a n survey that examined how computer ethics are taught in c o m p u t e r science, or related degrees found that 66 % of the universities teach ethics as part of their computing degree <ref type="bibr" target="#b31">[33]</ref>,</p><p>The case method seems to be the c o m m o n a p p r o a c h particularly in the field of computing, science, and engineering <ref type="bibr" target="#b5">[6]</ref> [17] <ref type="bibr" target="#b30">[32]</ref>. There are a variety of cases used in the case method, some are used i n d e p e n d e n t of the others while some can be a combination of the others. Cases can be classified as narrative vs dialogue, single perspective vs multi perspective, hypothetical vs actual, stories vs problems, view as reader a participant vs an outside judge; success vs positive, single issue vs multiissue, single stave vs multi-stage, ordinary vs technical language, personal vs policy, living case vs published cases <ref type="bibr" target="#b9">[11]</ref>. All of these can be used in creating case studies for teaching ethics, it is highly suggested that technical courses use technical language where s t u d e n t s have the same technical training or background as the instructor. S t r a t t o n <ref type="bibr" target="#b32">[34]</ref> emphasized that moral judgement, as a skill, must be practiced and simulations provide the students-controlled e n v i r o n m e n t .</p><p>Stavrakakis etal <ref type="bibr" target="#b30">[32]</ref> and Lewis &amp; Stoyanovich <ref type="bibr" target="#b38">[40]</ref> argued that traditional ethics education for computing and/or data related curriculum are often taught separately as an ethics course and may not include practical and timely training on how to weigh the consequences that can be applied in their profession. Skirpan et al. <ref type="bibr" target="#b30">[32]</ref> use of ethical thinking throughout the process of learning the fundamentals of human-centered design while Lewis &amp; Stoyanovich <ref type="bibr" target="#b38">[40]</ref> used algorithmic development to teach ethical data science. Both studies have s h o w n increased interests among students. In their study of incorporating social issues of c o m p u t i n g in a liberal art setting, Davis &amp; Walker <ref type="bibr" target="#b10">[12]</ref> identified ways social issues can be addressed in the technical topics and summative assessments. The challenges they identified is that framing an exam question related to social issues can seem a w k w a r d and s t u d e n t s raise issues that have been raised in other courses. Lack of staff availability and expertise was cited as a reason for not teaching computing ethics <ref type="bibr" target="#b31">[33]</ref> while W u e s t e <ref type="bibr" target="#b35">[37]</ref> argued that curricular time d e m a n d s in science and engineering disciplines are major obstacles in successfully integrating ethics and calls a need for professional development for teachers.</p><p>In traditional ethics education for computing, the case method approach, as demonstrated in related studies, is often presented as a distinct course or topic within a curriculum, lacking practical training on reflective application in a professional context. This study aims to bridge this gap by integrating case studies, practical applications, and ethical considerations into the technical content of the course. By intertwining technical skills and knowledge acquisition with a heightened awareness of ethical implications, students are provided with a comprehensive learning experience. The objective is to enhance ethics education by offering a pedagogical approach that effectively delivers the learning outcomes encompassing both technical proficiency and responsible Al applications.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2.3.">A s y n c h r o n o u s O n l i n e C o u r s e D e s i g n</head><p>Asynchronous online is a kind of online learning where students are allowed to study at their own time. The communication of teaching and learning does not happen at the same <ref type="bibr" target="#b36">[38]</ref>. Although studies have shown that a well-designed course can increase student satisfaction and their learning experiences, there is no consensus on what the guidelines of a good online course design are <ref type="bibr" target="#b40">[42]</ref>, A common approach is to use an online course design template or a checklist to provide consistency to students in both accessing and navigating the course site, and assists teachers in saving time, reducing cognitive load, and meet compliance requirements <ref type="bibr">[21] [43]</ref>. All course content design require a systematic approach whether taught online or face-to-face. Several studies report that a systematic approach in course content design and they focus on alginment of course learning outcomes, activities and assessments <ref type="bibr" target="#b37">[39]</ref> [41] <ref type="bibr" target="#b40">[42]</ref>. Having a a strong online course objectives and the selection of teaching methods to achieve them is important in an online course design. Wankel <ref type="bibr" target="#b34">[36]</ref> suggested that the course objectives is the key to a successfully online course design and that the design process can be structured to four essential activities: sharing of information, illustrate skills, guide practice of skills and ensure that learning occurred. When sharing information (deliver contents), teachers have variety of choices and are not only limited to text-based approach. They can curate existing digital resources, use audio/video recordings, conferencing systems, web-based and learning management system tools or even immersive technologies (e.g., virtual reality). One strategy employed to increase accessibility <ref type="bibr" target="#b21">[23]</ref> and teacher presence is the use of videos. There are several factors that were considered in the design of videos including how information should be presented and how it can be supported by providing additional learning activities <ref type="bibr" target="#b42">[44]</ref>, These activities may involved additional tasks that a student may peform to reinforce what has been learned in the videos. Of all the different learning tasks, authentic activities in online learning has shown many opportunities to increase learning. Authentic activites involve presenting students with complex and extended cae scenarios that allow them to fully engage in problem-solving within realistic situations that closely resemble the context where the knowledge they are acquiring can be practically applied <ref type="bibr" target="#b17">[19]</ref>,</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.">Embedding Principles of Responsible Al in Asynchronous Online Course</head><p>Working on this theoretical background, a course was developed that integrates case studies, practical applications, and ethical considerations into the technical content of the course. The common principles of responsible Al were identified. Among the different principles, Microsoft's grouping of the Principles of Responsible Al <ref type="bibr" target="#b24">[26]</ref> were adapted as it covers all the principles identified by different Al organizations. The principles were classified as algorithmic fairness and diversity, reliability and safety, privacy and security, and transparency and accountability. The technical practical (applied) ethics approach in teaching ethical issues in Al was used. The course was designed such that the principles of responsible Al are embedded into experiential learning. Experiential learning theory as synthesized by <ref type="bibr">Kolb [22]</ref> defines learning as "a process where knowledge is created through the transformation of experience". The experience cycles of discussion, feedback, and practice and application in real-life context helps students apply and connect theoretical knowledge with real-life applications. This experience cycle is repeated throughout the course and was used as the basis of the design of this course. Figure <ref type="figure" target="#fig_6">1</ref> shows the framework that was used in designing the online course activities.  The course information contains an overview of the course structure, requirements, learning outcomes, and resources. A separate section is dedicated the assessments in the course. One of the learning outcomes specifically states the knowledge, competencies and skills that are expected of the s t u d e n t to acquire related to Responsible Al. The assessment m e t h o d s are mapped to these learning outcomes. The course is divided into unit topics. In the case study, the topics are divided into weekly topics. The cycle is s t u d e n t s learn about the topic followed by practical activities that are related to the topic. The practical activity often includes coding activities where s t u d e n t s apply the principles of responsible Al in the case scenarios using coding. This activity is often followed by discussions where s t u d e n t s share their reflection on the case scenarios.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.1">. Case Study: Teaching Responsible Al in an Advanced Data Analytics Course</head><p>The course is an undergraduate-level advanced courses where data analytics students are introduced to Al topics such as reinforcement learning, computer vision and natural language processing. Students who are enrolled in this course have the basic skills and knowledge in machine learning, specifically, artificial neural networks and intermediate programming skills in Python. While students learn the technical theories and applications of Al, the use of responsible Al is emphasized throughout the course. The course was designed not only to help students assess and plan the human consequences of deploying the Al applications, but they also get to design and implement changes to mitigate or lower the risks associated in using these applications.</p><p>It was purposely decided that the principles of responsible Al will be the focus of the advanced data analytics courses where the technical practical ethics approach in teaching ethical issues in Al will be used. When students enroll in the course, they have a certain "maturity" in coding, they are no longer taught how to code. The expectation is that even with new code libraries introduced in the coding activities, students can learn and understand on their own. This is the reason why it was decided to embed the principles of responsible Al at the later part of the degree, so that students focus their attention on applying the principles of responsible Al in the topics that they are learning instead of learning how to code. Attention to the learned material is considered an important factor that influence learning <ref type="bibr" target="#b7">[9]</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.1.1.">Practical Ethics Applications</head><p>The course integrates responsible Al principles into data analytics education through a set of learning goals, formative activities, and assessments. Students are tasked with understanding and applying responsible Al principles, critically evaluating ethical issues in data and algorithms, designing mitigation strategies for AI-related risks, and effectively communicating ethical considerations. The curriculum employs a variety of formative activities, including code-along exercises, which include case study analyses and iterative problem-solving. All designed to reinforce responsible Al principles using a spaced repetition approach <ref type="bibr" target="#b8">[10]</ref>. For instance, students analyze real-world scenarios like bias in credit scoring models <ref type="bibr" target="#b18">[20]</ref>, healthcare bias and data privacy issues <ref type="bibr" target="#b12">[14]</ref>, linkage attacks privacy issues <ref type="bibr" target="#b22">[24]</ref>, and data misrepresentation in public records [8], They engage in critical code analysis, examining transparency, fairness, and privacy aspects of Al systems. Assessments are multi-faceted, comprising ethical impact analyses of real-world Al systems, practical implementation projects incorporating responsible Al principles, peer reviews of ethical reasoning, and reflective journaling. This approach, grounded in experiential learning theory <ref type="bibr" target="#b20">[22]</ref>, ensures students can bridge the gap between abstract ethical concepts and real-world applications in data analytics and Al development. By continually reflecting on the ethical implications of their work and iterating on solutions, students develop a robust understanding of how to apply responsible Al principles in practice, preparing them for the ethical challenges they'll face in their professional careers.</p><p>An example formative activity is the code-along activities (Figure <ref type="figure">2</ref>). Students participate in guided coding exercises that incorporate responsible Al principles. • The data set that we will be using can be accessed via the AIF36O toolkit The Wk2_6_CodeAlongActivity_PartlRemovingBias.html in the activity contains the details of the walk-through of the code. In this example, students write a code and perform a critical observation during a code-along activity. Students learn how to use the toolkit to help enforce fairness and remove bias. Fairness metrics was used to check for bias in machine learning workflows, and bias mitigators was used to overcome bias in the workflow to produce a fairer outcome. Students are expected to apply their knowledge of responsible Al to assess these aspects critically.</p><p>As shown in Figure <ref type="figure" target="#fig_3">3</ref>, students are introduced the tutorial (a), followed by sample code that they can code-along (b), and then some parts where students have to code (c).    Step 2: Import all necessary packages</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>C o d e A l o n g A c t i v i t y : D e t e c t i n g and M i t i g a t i n g Age Bias on C r e d i t D e c i s i o n s The goal of this t u t o r i a l is to i n t r o d u c e the basic f u n c t i o n a l i t y of Al Fairness 360, an open s o u r c e t o o l k i t d e v e l o p e d by IBM for bias m i t i g a t i o n .</head><p>We will also import the GernnanDataset that is part of aif360.datasets. A description separate description of the data set is provided in the practical activity. </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head># STUDENT CELL # w r i t e code t o check t h e mean c r e d i t s c o r e by age c a t e g o r y</head><p>After completing this activity, students reflect on and share this in the discussion forums:</p><p>• Ethical implications of bias in credit scoring • Trade-offs between fairness and model performance • Potential societal impacts of such models</p><p>The above example is the typical format of practical activities. Students are expected to repeatedly apply reflections on their comprehension of the data and the algorithmic fairness and diversity in data processing. Afterward, they reflect, plan, and utilize other principles of responsible Al that relate to the current topic. At the conclusion of each activity, students are requested to reflect on and discuss their feedback regarding some or all the principles, depending on their applicability. For instance, the reinforcement learning topic placed particular emphasis on transparency in addition to privacy and fairness. In contrast, discussion and reflections in the computer vision topic encompassed a broader range of principles, including reliability and safety. The experiential learning concept was also adapted in the design of the assessment instruments. The criteria used for assessing students align with the course learning outcomes. Students are assessed in the different data analytics and Al concepts introduced in the courses. In each of these concepts, the assessments have the following format: a real-life case scenario is provided where students will be asked to write and submit a code and report. In the report, students are asked to explain the problem, discuss their approach to the problem, and discuss strategies in implementing the principles of responsible AL The assessment was intentionally designed to require students to draw upon their understanding of abstract concepts in principles of responsible Al and apply that knowledge to their concrete experiences working with data, designing solutions, and engaging in actual coding. Additionally, students were tasked with resolving any conflicts they encountered between what they observed in the learning activities (e.g., code-along activities) and what they were doing (i.e., designing and coding solutions to problems). While fairness, diversity and privacy principles were integral components in all assessments) different principles were applied in various assessments. Figure <ref type="figure" target="#fig_8">4</ref> illustrates example instructions for assessing students' understanding and application of transparency and accountability in machine learning. In this assessment, students were presented with a case study scenario and tasked with designing and developing an optimized reinforcement learning model. Following this, they were required to discuss how their chosen reinforcement learning approach addresses principles of Responsible Al, specifically focusing on transparency and accountability. This exercise aimed to evaluate students' ability to not only implement advanced machine learning techniques but also to critically consider the ethical implications of their work within the framework of Responsible Al.  </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.">Is it clear who will be accountable if bias is introduced?</head><p>2. If the model is not addressing these issues, suggest steps that should be taken to address them in future developments of the recommender system.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4.">C h a l l e n g e s</head><p>Integrating responsible Al principles into Al courses presents a multifaceted set of challenges that educators must navigate carefully. A primary concern is finding the right balance between technical content and ethical considerations. While it is crucial to prepare students with Al skills, there's an equally pressing need to instill a deep understanding of the ethical implications of these technologies. For instance, when teaching reinforcement learning, teachers must not only cover complex algorithms but also discuss potential biases in reward functions and their societal impacts. To address these issues, we integrated ethical discussions directly into technical topics using real-world examples, developed case studies combining technical implementation with ethical analysis, and implemented project-based learning in assessments.</p><p>Another significant challenge lies in maintaining the relevance of case studies and ethical scenarios in a rapidly evolving field. An example that was pertinent last year, such as facial recognition in public spaces, might be superseded by more pressing concerns like AI-generated deepfakes in political campaigns. We continue to search for current news articles to maintain relevance, though a more scalable approach is needed.</p><p>Assessing ethical reasoning poses its own set of difficulties. Unlike technical skills that can often be evaluated through quantitative metrics, judging the quality of ethical decision-making requires multifaceted criteria. Educators might struggle to develop rubrics that objectively measure a student's ability to identify and reason through ethical dilemmas in Al development. Assessing ethical reasoning posed unique difficulties, which we tackled by developing rubrics focused on the process of ethical decision-making.</p><p>Student resistance can also be a hurdle, as some may perceive ethical training as less valuable than technical prowess in the job market. This attitude might be reinforced by the tech industry's historical focus on innovation over ethical considerations, though this is gradually changing. To combat student resistance and demonstrate the importance of ethical skills, we highlighted job postings specifically mentioning ethical Al requirements.</p><p>Instructor expertise presents another challenge. Many Al professors come from technical backgrounds and may not feel equipped to lead discussions on complex ethical issues. Conversely, ethics professors might struggle with the technical intricacies of advanced Al systems. This gap necessitates either extensive cross-training or collaborative teaching models. The expertise gap among instructors was currently addressed by associating IT instructors with professional bodies offering ethics-related development opportunities. Finally, time constraints in already packed curricula can make it difficult to give both technical and ethical aspects their due attention. A course on natural language processing, for example, must cover a vast array of algorithms and techniques, leaving little room for in-depth discussions on the ethical implications of language models in areas like content moderation or automated customer service. While we've made significant progress, we recognize that this is an evolving process requiring ongoing adaptation. Addressing these challenges requires a thoughtful, multidisciplinary approach to curriculum design and a commitment to ongoing adaptation as the field of Al continues to advance and evolve.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5.">Best Practices</head><p>Implementing best practices for integrating responsible Al principles into Al education also requires a thoughtful approach. Rather than treating ethics as a standalone topic, it's crucial to embed these principles throughout the entire curriculum. For instance, when teaching machine learning algorithms, teachers can consistently highlight potential biases in data sets and discuss the ethical implications of model choices. This integrated approach ensures that students view ethical considerations as an inherent part of Al development rather than an afterthought.</p><p>Utilizing real-world case studies is another vital strategy. For example, teachers might analyze the ethical concerns surrounding OpenAI's GPT models, discussing issues like potential misuse for disinformation, copyright infringement, and the amplification of biases. Such current and relevant examples make ethical dilemmas tangible and demonstrate their immediate relevance to the field. Hands-on ethical coding exercises further reinforce these principles. Students might be tasked with implementing fairness constraints in a credit scoring algorithm or designing transparency measures for a recommendation system, thereby gaining practical experience in translating ethical principles into code.</p><p>Collaborative learning plays a crucial role in developing a well-rounded understanding of Al ethics. Group projects could involve designing an Al system for a sensitive application, such as healthcare diagnostics, requiring students to collectively navigate technical challenges while addressing ethical concerns like patient privacy and algorithmic transparency. An interdisciplinary approach, possibly involving collaboration with ethics or philosophy areas can provide deeper insights into ethical frameworks and their application to Al. For instance, a joint seminar between computer science and philosophy students could explore the ethical implications of autonomous vehicles, bringing together technical knowledge and ethical reasoning. Continuous assessment of ethical reasoning is also essential to ensure that students are internalizing these principles. This could involve regular reflection papers on the ethical implications of topics covered in class, or project milestones that require ethical impact assessments.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="6.">Lessons L e a r n e d</head><p>The experience in embedding responsible Al principles into the Al technical course has resulted to valuable lessons that can significantly enhance the learning experience and outcomes for students. One crucial insight is the importance of timing in introducing these concepts. By incorporating ethical considerations into courses were students have the coding experience, students can focus on applying these principles to complex Al systems rather than grappling with basic coding challenges. For instance, in an intermediate level machine learning course, students might explore the ethical implications of using Al in criminal justice predictive systems, analyzing potential biases and fairness issues in real-world applications.</p><p>Practical application plays an important role in ethical Al education. When students can immediately apply ethical principles to their coding projects, engagement and understanding deepen significantly. For example, a project on developing a recommendation algorithm for a streaming service could include requirements for transparency in the algorithm's decision-making process and considerations for diverse representation in content suggestions. This hands-on approach allows students to see firsthand how ethical considerations shape technical decisions.</p><p>The development of ethical reasoning skills has been observed to require consistent practice and reflection. Regular opportunities for ethical decision-making, such as weekly case study discussions or ethical impact assessments for each major project, help students hone their ability to identify and navigate complex ethical dilemmas in Al. For instance, students might be asked to regularly update an "ethical journal or discussion forum" throughout the course, reflecting on how each new Al technique they learn could be used or misused from an ethical standpoint. In addition, relevance to current Al developments and potential career scenarios has proven to significantly enhance student engagement. Discussing recent controversies, such as the ethical implications of AI-generated art or the role of large language models in spreading misinformation, helps students see the immediate relevance of ethical considerations in their field. Another activity that has shown to be important in teaching responsible Al is peer learning. Group discussions on ethical dilemmas often lead to rich insights and perspectives that individual reflection might not yield.</p><p>Flexibility in curriculum design has emerged as a crucial factor, given the rapidly evolving nature of Al and its ethical challenges. Teachers must be prepared to adapt their teaching materials to address emerging issues, such as the ethical considerations surrounding new Al technologies. Assessment strategies have evolved to combine evaluation of technical skills with assessment of ethical reasoning. This might involve projects where the technical implementation is judged alongside an ethical impact report, providing a holistic view of a student's capabilities as a responsible Al practitioner.</p><p>Emphasizing the relevance of responsible Al principles to future careers has significantly increased student appreciation for these courses. When students understand how ethical considerations will impact their work in industry or research, they engage more deeply with the material. This could involve assignments that mimic real-world scenarios.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="7.">Conclusion and R e c o m m e n d a t i o n</head><p>The rapid emergence and adoption of Artificial Intelligence technologies has led to increased opportunities, risks, and challenges, highlighting the need to teach the principles of responsible Al. In this paper, a case study was presented, showcasing the effective embedding of responsible Al principles in an advanced technical online course using the theory of experiential learning and applied ethics as a foundation. The course design incorporated practical and code-along activities that moved ethical discussions to specific topics, emphasizing the importance of understanding and checking data prior to modeling and evaluating models and algorithms, with the Al principles consistently integrated. The consistent presentation and reinforcement of the principles of responsible Al through the design of practical activities have proven beneficial in fostering students' comprehension and application of these concepts. It not only enhances awareness of the ethical challenges but also facilitates the practical applications of ethical concepts. Moreover, this approach fosters a conducive environment that stimulates critical thinking among students regarding ethical considerations and the far-reaching implications of their professional actions.</p><p>Despite the success of the course design, challenges were identified, such as finding relevant upto-date case scenarios and lack of technical and responsible Al expertise among teachers. Developing practical activities and assessments for the course presented a significant challenge for the course designers. One of the main hurdles was finding case studies that were relevant and up to date with the latest technology-related events, followed by the task of modifying them to include the concepts being taught while also highlighting the principles of responsible Al. Additionally, finding suitable data to illustrate both the concepts and principles of responsible Al was also a challenge. In many cases, the data had to be modified to suit the purpose of the topic. Another challenge faced in the courses design was the lack of teachers who possessed both the necessary technical expertise and an understanding (or interest) in embedding responsible Al principles into their courses. This issue required extensive training and support to equip the educators with the necessary skills and knowledge to effectively integrate these principles into their teaching.</p><p>Best practices for addressing these challenges involve embedding ethics throughout the curriculum, utilizing real-world case studies, implementing hands-on ethical coding exercises, fostering collaborative learning, and adopting interdisciplinary approaches. Lessons learned highlight the importance of timing in introducing ethical concepts, the value of practical application, the need for consistent practice in ethical reasoning, the benefits of peer learning, and the necessity of flexible curriculum design. Additionally, emphasizing the relevance of responsible Al to future careers has been shown to increase student engagement and appreciation for these principles.</p><p>This research, while providing valuable insights into integrating responsible Al principles into technical courses, has several limitations and areas for future work. A key limitation is the lack of formal student feedback, which would provide crucial data on the effectiveness of the approach from the learners' perspective. Future research should prioritize collecting and analyzing student feedback to refine the curriculum design. Additionally, the study's scope was limited to a single course, potentially limiting its generalizability. Future work should focus on scaling up the integration of responsible Al principles across entire curricula, including non-AI related courses. This expansion would require developing comprehensive teacher training programs and establishing partnerships with industry to ensure ongoing relevance of case studies. Creating a dynamic, regularly updated database of ethical case studies and fostering multidisciplinary collaborations between computer science and philosophy departments could further enhance the approach.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Declaration on G e n e r a t i v e Al</head><p>The author has not employed any generative Al tools.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>R e f e r e n c e s</head></div><figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_0"><head></head><label></label><figDesc>outlines ten key principles: Proportionality and Do No Harm, Safety and Security, Fairness and Non-Discrimination, Sustainability, Right to Privacy and Data Protection, Human Oversight and Determination, Transparency and Explainability, Responsibility and Accountability, Awareness and Literacy, and Multi-stakeholder and Adaptive Governance. Similarly, the European Commission's Ethics Guidelines for Trustworthy Artificial Intelligence [246 propose seven key requirements: Human Agency and Oversight, Technical Robustness and Safety, Privacy and Data Governance, Transparency, Diversity, Non-discrimination and Fairness, Societal and Environmental Well-being, and Accountability. These frameworks demonstrate a growing consensus on the fundamental principles of responsible Al development and deployment.</figDesc></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_1"><head>Figure</head><label></label><figDesc>Figure 1: Integrating Technical (Applied) Responsible Al in the Online Course Design</figDesc></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_2"><head>Figure 2 .How 1 . 2 . 3 .</head><label>2123</label><figDesc>Figure 2. Example Code-Along Activity.</figDesc><graphic coords="6,72.00,335.34,451.00,172.80" type="bitmap" /></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_3"><head>Figure 3 (</head><label>3</label><figDesc>Figure 3(a). Extract of code-along introduction.</figDesc></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_4"><head></head><label></label><figDesc>This e x a m p l e is a d a p t e d f r o m : h t t p s t / / n b v i e w e r . o r g / g i t h u b / I B M / A I F 3 6 0 / b l o b / m a s t e r / e x a m p l e s / t u t o r i a l _ c r e d i t _ s c o r i n g . i p y n b Biases and Machine Learning In your p r e d i c t i v e and m a c h i n e l e a r n i n g c o u r s e s , you l e a r n e d how to c r e a t e m o d e l s to p r e d i c t an o u t c o m e given a p a r t i c u l a r i n s t a n c e . For e x a m p l e , given an i n s t a n c e of a d e m o g r a p h i c s , we may use a m o d e l to p r e d i c t w h e t h e r the a p p l i c a n t will buy or not; or w h e t h e r the p e r s o n will d e f a u l t in a h o m e loan or not. The model makes p r e d i c t i o n s b a s e d on a t r a i n i n g d a t a s e t , and o b s e r v e d ( t a r g e t ) o u t c o m e s . A m a c h i n e l e a r n i n g a l g o r i t h m or p r e d i c t i v e m o d e l s will a t t e m p t to f i n d p a t t e r n s , or g e n e r a l i z a t i o n s , in the t r a i n i n g d a t a s e t t o use when a p r e d i c t i o n f o r a new i n s t a n c e is n e e d e d .</figDesc></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_5"><head>Figure 3 (</head><label>3</label><figDesc>Figure 3(b). Extract of code-along instructions provided.</figDesc><graphic coords="7,116.40,294.00,362.64,199.68" type="bitmap" /></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_6"><head>Step 1 :</head><label>1</label><figDesc>Install the libraries I n l 1 : "&gt;pip i n s t a l l numpy m a t p l o t l i b s e a b o r n ! p i p i n s t a l l numba==0.48 ! p i p i n s t a l l a i f 3 6 0 = = 0 . 2 . 2 ! p y t h o n -m p i p i n s t a l l B l a c k B o x A u d i t i n g I p i p i n s t a l l t e n s o r f l o w = l . 13 . 1</figDesc></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_7"><head></head><label></label><figDesc>Figure 3(c).Extract of code-along activity where students were asked to reflect and code.</figDesc><graphic coords="7,108.84,532.08,380.28,109.92" type="bitmap" /></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_8"><head>Figure 4 .</head><label>4</label><figDesc>Figure 4. Example assessment instruction that focusses on the transparency and accountability principles.</figDesc><graphic coords="8,73.00,448.66,450.88,149.35" type="bitmap" /></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_9"><head>5. Transparency and Accountability 1 .</head><label>1</label><figDesc>Discuss how the model addresses the transparency and accountability principles of responsible Al. For example, you may want to consider the following questions: 1. Assuming that bias has been removed from the environment where the model learns, is the model designed to prevent bias to be introduced? 2. Is the model transparent?</figDesc></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" type="table" xml:id="tab_1"><head>1 :</head><label>1</label><figDesc>Integrating Technical (Applied) Responsible Al in the Online Course Design</figDesc><table><row><cell>Learning</cell><cell>Assessment</cell><cell></cell></row><row><cell>Outcomes</cell><cell>timelines</cell><cell>Topic and subtopics</cell></row><row><cell>Structure</cell><cell>Assessment</cell><cell>Content presentations using different T</cell></row><row><cell>Learning</cell><cell>descriptions</cell><cell>instructional strategies (e.g. content</cell></row><row><cell>Resources</cell><cell>Assessment</cell><cell>videos, reading materials, online video</cell></row><row><cell>Teaching Team</cell><cell>instructions</cell><cell>conferencing, code along activities)</cell></row><row><cell>Communications (email, forums,</cell><cell>Assessment criteria</cell><cell>Practical/Coding Applications of Responsible Al</cell></row><row><cell>video</cell><cell>Marking rubrics</cell><cell>Relevant case scenarios with</cell></row><row><cell>conferencing)</cell><cell></cell><cell>practical/coding applications</cell></row><row><cell></cell><cell></cell><cell>Reflections through discussion forums A</cell></row><row><cell></cell><cell></cell><cell>Student-led discussions reflecting on t h e \ i</cell></row><row><cell></cell><cell></cell><cell>results of their practical/coding activities</cell></row></table></figure>
		</body>
		<back>
			<div type="references">

				<listBibl>

<biblStruct xml:id="b0">
	<monogr>
		<title level="m" type="main">Criteria for accrediting computing programs 2023-2024</title>
		<ptr target="https://www.abet.org/accreditation/accreditation-criteria/criteria-for-accrediting-computing-programs-2023-2024/" />
		<imprint>
			<date type="published" when="2023">2023</date>
		</imprint>
		<respStmt>
			<orgName>ABET</orgName>
		</respStmt>
	</monogr>
</biblStruct>

<biblStruct xml:id="b1">
	<monogr>
		<ptr target="https://www.acm.org/code-of-ethics" />
		<title level="m">ACM Code of Ethics and Professional Conduct</title>
				<imprint>
			<date type="published" when="2023">2023</date>
			<biblScope unit="volume">1</biblScope>
		</imprint>
		<respStmt>
			<orgName>Association of Computing Machinery</orgName>
		</respStmt>
	</monogr>
</biblStruct>

<biblStruct xml:id="b2">
	<monogr>
		<ptr target="https://www.acs.org.au/content/dam/acs/rules-and-regulations/Code-of-Ethics.pdf" />
		<title level="m">ACS Code of Ethics</title>
				<imprint>
			<date type="published" when="2014">2014</date>
		</imprint>
		<respStmt>
			<orgName>Australian Computer Society</orgName>
		</respStmt>
	</monogr>
</biblStruct>

<biblStruct xml:id="b3">
	<analytic>
		<title level="a" type="main">Artificial Intelligence at Google: Our Principles</title>
		<author>
			<persName><surname>Google</surname></persName>
		</author>
		<ptr target="https://ai.google/principles/" />
	</analytic>
	<monogr>
		<title level="m">version 11</title>
				<imprint>
			<date type="published" when="2022">2022</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b4">
	<analytic>
		<title level="a" type="main">Educational theories that inform the educational strategies for teaching ethics in undergraduate medical education</title>
		<author>
			<persName><forename type="first">D</forename><surname>Azim</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">S</forename><surname>Shamim</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Journal of the Pakistan Medical Association</title>
		<imprint>
			<biblScope unit="volume">70</biblScope>
			<biblScope unit="issue">1</biblScope>
			<biblScope unit="page" from="123" to="128" />
			<date type="published" when="2020">2020</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b5">
	<monogr>
		<author>
			<persName><forename type="first">B</forename><surname>Blundell</surname></persName>
		</author>
		<title level="m">Ethics in Computing, Science, and Engineering: A Student&apos;s Guide to Doing Things Right</title>
				<meeting><address><addrLine>Switzerland</addrLine></address></meeting>
		<imprint>
			<publisher>Springer Nature</publisher>
			<date type="published" when="2020">2020</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b6">
	<monogr>
		<title level="m" type="main">Professional Issues in Information Technology</title>
		<author>
			<persName><forename type="first">F</forename><surname>Bott</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2014">2014</date>
			<publisher>British Computing Society</publisher>
		</imprint>
	</monogr>
	<note>2nd ed.</note>
</biblStruct>

<biblStruct xml:id="b7">
	<analytic>
		<title level="a" type="main">Interactions b e t w e e n attention and memory</title>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">M</forename><surname>Chun</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><forename type="middle">B</forename><surname>Turk-Browne</surname></persName>
		</author>
		<idno type="DOI">10.1016/j.conb.2007.03.005</idno>
	</analytic>
	<monogr>
		<title level="j">o n in Neurobiology</title>
		<imprint>
			<biblScope unit="volume">17</biblScope>
			<biblScope unit="page" from="177" to="184" />
			<date type="published" when="2007">2007</date>
		</imprint>
	</monogr>
	<note>Current</note>
</biblStruct>

<biblStruct xml:id="b8">
	<analytic>
		<title level="a" type="main">The Effect of Spaced Repetition on Meaningful Retention</title>
		<author>
			<persName><forename type="first">D</forename><surname>Ausubel</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Youssef</surname></persName>
		</author>
		<idno type="DOI">10.1080/00221309.1965.9711263</idno>
		<ptr target="https://doi.org/10.1080/00221309.1965.9711263" />
	</analytic>
	<monogr>
		<title level="j">The Journal of General Psychology</title>
		<imprint>
			<biblScope unit="volume">73</biblScope>
			<biblScope unit="issue">1</biblScope>
			<biblScope unit="page" from="147" to="150" />
			<date type="published" when="1965">1965</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b9">
	<analytic>
		<title level="a" type="main">Incorporating Social Issues of C o m p u t i n g in a Small, Liberal Arts College: A Case Study</title>
		<author>
			<persName><forename type="first">J</forename><surname>Davis</surname></persName>
		</author>
		<author>
			<persName><forename type="first">H</forename><forename type="middle">M</forename><surname>Walker</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proc. 42nd ACM Technical Symposium on C o m p u t e r Science Education</title>
				<meeting>42nd ACM Technical Symposium on C o m p u t e r Science Education</meeting>
		<imprint>
			<date type="published" when="2011">2011</date>
			<biblScope unit="page" from="69" to="74" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b10">
	<monogr>
		<author>
			<persName><forename type="first">M</forename><surname>Davis</surname></persName>
		</author>
		<title level="m">Ethics and the University</title>
				<imprint>
			<publisher>Taylor and Francis</publisher>
			<date type="published" when="2022">2022</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b11">
	<analytic>
		<title level="a" type="main">Facebook&apos;s five pillars of responsible Al</title>
		<author>
			<persName><forename type="first">Meta</forename><surname>Al</surname></persName>
		</author>
		<ptr target="https://ai.facebook.com/blog/facebooks-five-pillars-of-responsible-ai" />
	</analytic>
	<monogr>
		<title level="j">version</title>
		<imprint>
			<biblScope unit="volume">11</biblScope>
			<date type="published" when="2022">2022</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b12">
	<analytic>
		<title level="a" type="main">Fairlearn: A Python package to assess and improve fairness in Al</title>
		<author>
			<persName><surname>Fairlearn</surname></persName>
		</author>
		<ptr target="https://fairlearn.org.Ferrarello,L." />
	</analytic>
	<monogr>
		<title level="j">version</title>
		<imprint>
			<biblScope unit="volume">11</biblScope>
			<date type="published" when="2019">2022. 2019</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b13">
	<analytic>
		<title level="a" type="main">Social a w a r e n e s s in design &amp; engineering education and practice: the value of ethics in p o s t g r a d u a t e education</title>
		<author>
			<persName><forename type="first">L</forename><surname>Ferrarello</surname></persName>
		</author>
		<idno type="DOI">10.35199/epde2019.83</idno>
	</analytic>
	<monogr>
		<title level="m">Proc. 21st International Conference on Engineering &amp; P r o d u c t Design Education</title>
				<meeting>21st International Conference on Engineering &amp; P r o d u c t Design Education<address><addrLine>Glasgow</addrLine></address></meeting>
		<imprint>
			<date type="published" when="2019">2019</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b14">
	<analytic>
		<title level="a" type="main">In-Action Ethics</title>
		<author>
			<persName><forename type="first">C</forename><surname>Frauenberger</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Rauhala</surname></persName>
		</author>
		<author>
			<persName><forename type="first">G</forename><surname>Fitzpatrick</surname></persName>
		</author>
		<idno type="DOI">10.1093/iwc/iww024</idno>
	</analytic>
	<monogr>
		<title level="j">Interacting with Computers</title>
		<imprint>
			<biblScope unit="volume">29</biblScope>
			<biblScope unit="issue">2</biblScope>
			<biblScope unit="page" from="220" to="236" />
			<date type="published" when="2016">2016</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b15">
	<analytic>
		<title level="a" type="main">Literature for Specific Purposes: A Literary A p p r o a c h to Teaching Ethics in Science and Technology</title>
		<author>
			<persName><forename type="first">K</forename><forename type="middle">S</forename><surname>H A N S E N</surname></persName>
		</author>
		<idno type="DOI">10.1353/con.2018.0030</idno>
	</analytic>
	<monogr>
		<title level="j">Configurations</title>
		<imprint>
			<biblScope unit="volume">26</biblScope>
			<biblScope unit="issue">3</biblScope>
			<biblScope unit="page" from="337" to="343" />
			<date type="published" when="2018">2018</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b16">
	<analytic>
		<title level="a" type="main">Incorporating Ethics and Social Responsibility in IS education</title>
		<author>
			<persName><forename type="first">A</forename><surname>Harris</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><surname>Lang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Yates</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><forename type="middle">E</forename><surname>Kruck</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Journal of Information Systems Education</title>
		<imprint>
			<biblScope unit="volume">2</biblScope>
			<biblScope unit="issue">3</biblScope>
			<biblScope unit="page" from="183" to="190" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b17">
	<analytic>
		<title level="a" type="main">Patterns of e n g a g e m e n t in authentic online learning environments</title>
		<author>
			<persName><forename type="first">J</forename><surname>H E R R I N G T O N</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Oliver</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Reeves</surname></persName>
		</author>
		<idno type="DOI">10.14742/ajet.l701</idno>
	</analytic>
	<monogr>
		<title level="j">Australian Journal of Educational Technology</title>
		<imprint>
			<biblScope unit="volume">19</biblScope>
			<biblScope unit="issue">1</biblScope>
			<biblScope unit="page" from="59" to="71" />
			<date type="published" when="2003">2003</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b18">
	<monogr>
		<title level="m" type="main">German Credit Risk</title>
		<author>
			<persName><forename type="first">H</forename><surname>Hofmann</surname></persName>
		</author>
		<ptr target="https://www.kaggle.com/datasets/uciml/german-credit" />
		<imprint>
			<date type="published" when="2016">2016. 2022</date>
			<biblScope unit="volume">2</biblScope>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b19">
	<analytic>
		<title level="a" type="main">Leveraging Course Quality Checklist to Improve Online Courses</title>
		<author>
			<persName><forename type="first">H</forename><surname>Kathuria</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><forename type="middle">W</forename><surname>Becker</surname></persName>
		</author>
		<idno type="DOI">10.14434/jotlt.vlOil.31253</idno>
	</analytic>
	<monogr>
		<title level="j">Journal of Teaching and Learning with Technology</title>
		<imprint>
			<biblScope unit="volume">10</biblScope>
			<biblScope unit="issue">1</biblScope>
			<date type="published" when="2021">2021</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b20">
	<analytic>
		<title level="a" type="main">Part 1: Experience and Learning</title>
		<author>
			<persName><forename type="first">D</forename><forename type="middle">A</forename><surname>Kolb</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Experiential Learning: Experience as the Source of Learning and Development</title>
				<imprint>
			<date type="published" when="2014">2014</date>
		</imprint>
	</monogr>
	<note>P e a r s o n Education</note>
</biblStruct>

<biblStruct xml:id="b21">
	<analytic>
		<title level="a" type="main">Enhancing accessibility with instructional video</title>
		<author>
			<persName><forename type="first">S</forename><surname>Kolber</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Teaching Online Master Class</title>
		<imprint>
			<date type="published" when="2020">2020</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b22">
	<monogr>
		<title level="m" type="main">Your secrets live online in databases of ruin</title>
		<author>
			<persName><forename type="first">P</forename><surname>Ohm</surname></persName>
		</author>
		<ptr target="https://arstechnica.com/tech-policy/2009/09/your-secrets-live-online-in-databases-of-ruin/" />
		<imprint>
			<date type="published" when="2009">2009</date>
			<publisher>Ars Technica</publisher>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b23">
	<analytic>
		<title level="a" type="main">Integrating Ethics within Machine Learning Courses, ACM T r a n s a c t</title>
		<author>
			<persName><forename type="first">J</forename><surname>Saltz</surname></persName>
		</author>
		<author>
			<persName><surname>Skirpan</surname></persName>
		</author>
		<author>
			<persName><surname>Fiesler</surname></persName>
		</author>
		<author>
			<persName><surname>Gorelick</surname></persName>
		</author>
		<author>
			<persName><forename type="first">R</forename><surname>Yeh</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>H E C K M A N</surname></persName>
		</author>
		<author>
			<persName><surname>Dewar</surname></persName>
		</author>
		<idno type="DOI">10.1145/1188913.1188915</idno>
	</analytic>
	<monogr>
		<title level="j">i o n on Computing Education</title>
		<imprint>
			<biblScope unit="volume">19</biblScope>
			<biblScope unit="issue">4</biblScope>
			<biblScope unit="page" from="1" to="26" />
			<date type="published" when="2019">2019</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b24">
	<monogr>
		<ptr target="https://www.microsoft.com/en-us/ai/responsible-ai" />
		<title level="m">Microsoft Responsible Al Standard, v2, version 11</title>
				<imprint>
			<date type="published" when="2022">2022</date>
		</imprint>
		<respStmt>
			<orgName>Microsoft</orgName>
		</respStmt>
	</monogr>
</biblStruct>

<biblStruct xml:id="b25">
	<analytic>
		<title/>
		<ptr target="https://www.ibm.com/impact/ai-ethics" />
	</analytic>
	<monogr>
		<title level="j">Al Ethics</title>
		<imprint>
			<biblScope unit="volume">11</biblScope>
			<date type="published" when="2022">2022</date>
		</imprint>
		<respStmt>
			<orgName>IBM</orgName>
		</respStmt>
	</monogr>
</biblStruct>

<biblStruct xml:id="b26">
	<monogr>
		<author>
			<persName><forename type="first">Accenture</forename></persName>
		</author>
		<ptr target="https://www.accenture.com/au-en/services/applied-intelligence/ai-ethics-governance" />
		<title level="m">Responsible Al : Al Ethics &amp; Governance, version 11</title>
				<imprint>
			<date type="published" when="2022">2022</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b27">
	<monogr>
		<ptr target="https://openai.com/charter/" />
		<title level="m">Open Al, OpenAI Charter, version 10</title>
				<imprint>
			<date type="published" when="2022">2022</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b28">
	<analytic>
		<title level="a" type="main">Teaching Ethics in Decision Making: Embedding Moral Reasoning in the M a n a g e m e n t of Information Systems</title>
		<author>
			<persName><forename type="first">D-W</forename><surname>Olayinka</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Teaching Ethics Across the M a n a g e m e n t Curriculum</title>
				<editor>
			<persName><forename type="first">K</forename><surname>Ogunyemi</surname></persName>
		</editor>
		<meeting><address><addrLine>New York</addrLine></address></meeting>
		<imprint>
			<publisher>Business Expert Press</publisher>
			<date type="published" when="2014">2014</date>
			<biblScope unit="page" from="179" to="197" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b29">
	<analytic>
		<title level="a" type="main">How software works: Computational thinking and ethics before CS1</title>
		<author>
			<persName><forename type="first">A</forename><surname>Scott</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Barlowe</surname></persName>
		</author>
		<idno type="DOI">10.1109/FIE.2016.7757436</idno>
	</analytic>
	<monogr>
		<title level="m">Proc. IEEE Frontiers in Education Conference (FIE)</title>
				<meeting>IEEE Frontiers in Education Conference (FIE)</meeting>
		<imprint>
			<date type="published" when="2016">2016</date>
			<biblScope unit="page" from="1" to="9" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b30">
	<analytic>
		<title level="a" type="main">Ethics Education in Context: A Case Study of Novel Ethics Activities for the CS Classroom</title>
		<author>
			<persName><forename type="first">M</forename><surname>Skirpan</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proc, of the 49th ACM Technical Symposium on C o m p u t e r Science Education</title>
				<meeting>of the 49th ACM Technical Symposium on C o m p u t e r Science Education</meeting>
		<imprint>
			<date type="published" when="2018">2018</date>
			<biblScope unit="page" from="940" to="945" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b31">
	<analytic>
		<title level="a" type="main">The teaching of c o m p u t e r ethics on c o m p u t e r science and related degree programmes: A E u o p e a n Survey</title>
		<author>
			<persName><forename type="first">I</forename><surname>Stavrakakis</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Gordon</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><surname>Tierney</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Becevel</surname></persName>
		</author>
		<author>
			<persName><forename type="first">E</forename><surname>Murphy</surname></persName>
		</author>
		<author>
			<persName><forename type="first">G</forename><surname>Didg-Crnkociv</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>O'sullivan</surname></persName>
		</author>
		<idno type="DOI">10.1007/s40889-021-00135-l</idno>
	</analytic>
	<monogr>
		<title level="j">Int. J. Ethics Educ</title>
		<imprint>
			<biblScope unit="volume">7</biblScope>
			<biblScope unit="issue">1</biblScope>
			<biblScope unit="page" from="101" to="129" />
			<date type="published" when="2022">2022</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b32">
	<analytic>
		<title level="a" type="main">Incorporating ethics c o n t e n t throughout an integrated pharmacy curriculum</title>
		<author>
			<persName><forename type="first">T</forename><surname>Stratton</surname></persName>
		</author>
		<idno type="DOI">10.5688/ajpe7865</idno>
	</analytic>
	<monogr>
		<title level="j">Am. J. Pharm. Educ</title>
		<imprint>
			<biblScope unit="volume">84</biblScope>
			<date type="published" when="2020">2020</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b33">
	<analytic>
		<title level="a" type="main">The SUNY Online Course Quality Review Rubric (OSCQR)</title>
		<ptr target="https://oscqr.suny.edu/" />
	</analytic>
	<monogr>
		<title level="j">version</title>
		<imprint>
			<biblScope unit="volume">09</biblScope>
			<date type="published" when="2022">2022</date>
		</imprint>
		<respStmt>
			<orgName>SUNY Online</orgName>
		</respStmt>
	</monogr>
</biblStruct>

<biblStruct xml:id="b34">
	<analytic>
		<title level="a" type="main">Design considerations</title>
		<author>
			<persName><forename type="first">C</forename><surname>Wankel</surname></persName>
		</author>
		<idno type="DOI">10.1108/S2044-9968(2013)0000008003</idno>
	</analytic>
	<monogr>
		<title level="m">Redesigning Courses for Online Delivery Design, Interaction, Media, and Evaluation</title>
				<editor>
			<persName><forename type="first">R</forename><surname>Parker</surname></persName>
		</editor>
		<imprint>
			<publisher>Emerald Group Publishing Limited</publisher>
			<date type="published" when="2013">2013</date>
			<biblScope unit="volume">8</biblScope>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b35">
	<analytic>
		<title level="a" type="main">Cognition and Conation: A Potent Alliance in Teaching Ethics</title>
		<author>
			<persName><forename type="first">D</forename><forename type="middle">E</forename><surname>Wueste</surname></persName>
		</author>
		<author>
			<persName><forename type="first">D</forename><surname>Scibilia</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Instructional Models, Methods, and Modalities for University Studies</title>
				<imprint>
			<publisher>R o w m a n &amp; Littlefield Publishers</publisher>
			<date type="published" when="2021">2021</date>
			<biblScope unit="page" from="5" to="20" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b36">
	<analytic>
		<title level="a" type="main">Do zoom meetings really help? A comparative analysis of s y n c h r o n o u s and a s y n c h r o n o u s online learning during Covid-19 pandemic</title>
		<author>
			<persName><forename type="first">R</forename><surname>Zhang</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><forename type="middle">C</forename><surname>Bi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">T</forename><surname>Mercado</surname></persName>
		</author>
		<idno type="DOI">10.1111/jcal.l2740</idno>
	</analytic>
	<monogr>
		<title level="j">Journal of C o m p u t e r Assisted Learning</title>
		<imprint>
			<biblScope unit="volume">9</biblScope>
			<biblScope unit="issue">1</biblScope>
			<biblScope unit="page" from="210" to="217" />
			<date type="published" when="2023">2023. 2023</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b37">
	<analytic>
		<title level="a" type="main">A Systematic Course Design A p p r o a c h to Guide the Development of a Construction Engineering and M a n a g e m e n t Capstone Course</title>
		<author>
			<persName><forename type="first">N</forename><surname>Lee</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><forename type="middle">J</forename><surname>Kim</surname></persName>
		</author>
		<idno type="DOI">10.1109/ASEENE51624.2020.9292652</idno>
	</analytic>
	<monogr>
		<title level="m">ASEE-NE A n n u a l Conference</title>
				<imprint>
			<date type="published" when="2020">2020</date>
			<biblScope unit="page" from="1" to="5" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b38">
	<analytic>
		<title level="a" type="main">Teaching Responsible Data Science: Charting New Pedagogical Territory</title>
		<author>
			<persName><forename type="first">A</forename><surname>Lewis</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Stoyanovich</surname></persName>
		</author>
		<idno type="DOI">10.1007/s40593-021-00241-7</idno>
	</analytic>
	<monogr>
		<title level="m">Int. J. Artificial Intelligence in Education</title>
				<imprint>
			<date type="published" when="2022">2022</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b39">
	<analytic>
		<title level="a" type="main">Demonstrating online teaching in the disciplines: A systematic a p p r o a c h to activity design for online s y n c h r o n o u s tuition</title>
		<author>
			<persName><forename type="first">J</forename><surname>Macdonald</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Campbell</surname></persName>
		</author>
		<idno type="DOI">10.1111/j.1467-8535.2011.01238</idno>
	</analytic>
	<monogr>
		<title level="j">Br. J. Educ. Technol</title>
		<imprint>
			<biblScope unit="volume">43</biblScope>
			<biblScope unit="issue">6</biblScope>
			<biblScope unit="page" from="83" to="891" />
			<date type="published" when="2012">2012</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b40">
	<analytic>
		<title level="a" type="main">Award-winning faculty online teaching practices: Course design, assessment and evaluation, and facilitation</title>
		<author>
			<persName><forename type="first">F</forename><surname>Martin</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Ritzhaupt</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Kumar</surname></persName>
		</author>
		<author>
			<persName><forename type="first">K</forename><surname>Budhrani</surname></persName>
		</author>
		<idno type="DOI">10.1016/j.iheduc.2019.04.003</idno>
	</analytic>
	<monogr>
		<title level="j">I n t e r n e t High. Educ</title>
		<imprint>
			<biblScope unit="volume">42</biblScope>
			<biblScope unit="page" from="34" to="43" />
			<date type="published" when="2019">2019</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b41">
	<analytic>
		<title level="a" type="main">Online course quality assurance: Development of a quality checklist</title>
		<author>
			<persName><forename type="first">S</forename><forename type="middle">J</forename><surname>Mcghan</surname></persName>
		</author>
		<author>
			<persName><forename type="first">C</forename><forename type="middle">M</forename><surname>Jackson</surname></persName>
		</author>
		<author>
			<persName><forename type="first">K</forename><surname>Premer</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">InSight: A J. Sch. Teach</title>
		<imprint>
			<biblScope unit="volume">10</biblScope>
			<biblScope unit="issue">1</biblScope>
			<biblScope unit="page" from="126" to="140" />
			<date type="published" when="2015">2015</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b42">
	<analytic>
		<title level="a" type="main">Video and learning: A systematic review (2007-2017)</title>
		<author>
			<persName><forename type="first">O</forename><surname>Poquet</surname></persName>
		</author>
		<author>
			<persName><forename type="first">L</forename><surname>Lim</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Mirriahi</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Dawson</surname></persName>
		</author>
		<idno type="DOI">10.1145/3170358.3170376</idno>
	</analytic>
	<monogr>
		<title level="m">Proc, of the 8th Int. Conf, on Learning Analytics and Knowledge-LAK</title>
				<meeting>of the 8th Int. Conf, on Learning Analytics and Knowledge-LAK</meeting>
		<imprint>
			<date type="published" when="2018">2018</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b43">
	<monogr>
		<ptr target="https://www.unesco.org/en/artificial-intelligence/recommendation-ethics" />
		<title level="m">Ethics of Artificial Intelligence</title>
				<imprint>
			<publisher>UNESCO</publisher>
			<date type="published" when="2023">2023</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b44">
	<monogr>
		<ptr target="https://digital-strategy.ec.europa.eu/en/library/ethics-guidelines-trustworthy-ai" />
		<title level="m">Ethics guidelines for Trustworthy Al</title>
				<imprint>
			<date type="published" when="2019">2019</date>
		</imprint>
	</monogr>
	<note>S h a p i n g Europe&apos;s digital future</note>
</biblStruct>

				</listBibl>
			</div>
		</back>
	</text>
</TEI>
