Model of the Curriculum Revision System in Computer Science Hennadiy Kravtsov1 and Vitaliy Kobets1 1 Kherson State University, 27 Universitetska st., Kherson, 73000 Ukraine kgm@ksu.ks.ua, vkobets@kse.org.ua Abstract. The onrush of information technology raises the task of revising cur- ricula of specialties in computer science. The objectives of the study are to de- fine the requirements and develop a model of the curriculum revision system in computer science. Subject of research: curriculum revision system in computer science. Research methods: review and analysis of scientific publications, modeling of complex systems, questionnaires, expert method of evaluation. The model of the revision system of the curriculum is built taking into account the modern requirements of employers to the competence of university gradu- ates in computer sciences. The architecture of this system is built on the basis of research on the functionality of such elements as the Top Competences (re- quired in the labor market), Employers' Requirements, Learning outcomes (ex- pected results of teachers) and the formation of the ICT curriculum. The expert method is used to assess the quality of the revision model of the curriculum on the example of a specialty in the field of computer science. Results of the research: the requirements of the labor market to the competence of university graduates were investigated, systematized and formulated in the field of computer science. These requirements are the basis for the formation of a new or improvement of the existing curriculum at the university. Keywords: Curriculum in Computer Science, Curriculum Revision Model, Re- quirements for the Competences, Learning Outcomes. 1 Introduction Universities play an important part in modeling, creating and developing innovative systems in the economy. To successfully promote innovative systems, universities must effectively manage the dissemination of knowledge [1]. Entrepreneurial skills and innovative efforts in the field of information technology increase the scale, com- plexity and connect an increasing number of key stakeholders who can offer key in- novative changes in the curriculum of ICT. In an era of growing global competition, it is asserted that innovative and entrepreneurial competencies are key sources of the competitive advantage of the curriculum in the field of computer science [2]. An in- novative curriculum in informatics should take into account the importance of cross- ing and revising the global, national, industrial and local needs of stakeholders that form the ultimate demand for university graduates. This approach offers a way to develop and improve the curriculum in the field of computer science as a link be- tween education, technological innovation, production and development [3]. It is especially important to reach a high level of education in the field of computer science in Ukrainian universities, because by 2020 the IT industry of Ukraine has every chance to take the second place in the country's export structure, reaching 7.7 billion dollars. Within five years, the number of IT professionals in Ukraine should reach 200,000 people. The need for highly qualified specialists also occurs in all de- veloped and developing countries. Broad and intensive development of IT technolo- gies, their use in the economy determines the need for specialists in new specialties in the field of computer science, and also requires more frequent updating of university curricula. The purpose of this study is to develop a model for creating a new system and re- vising the existing curriculum in informatics for a master's program using the re- quirements of stakeholders at the international and local levels. 2 System Analysis 2.1 Modern Requirements for the Curriculum The model of the curriculum is designed to eliminate the difference between the tradi- tional approach to the development of curricula with normative disciplines and the modern approach to the development of curricula with normative competences. Ac- cording to modern approach a curriculum is specified using graduate competencies as its foundational element, instead of courses or knowledge areas, units, and topics (Fig. 1). Traditionally, most ICT curriculums have been structured around a typically hier- archical Knowledge Area – Knowledge Unit – Topic structure that together forms a Body of Knowledge. Knowledge areas include several knowledge units. Each knowledge unit, in turn, is divided into topics [4]. A potential problem with the traditional structure is that it focuses mostly on cogni- tive aspects of learning and leaves requirements of labor market out. A curriculum based on a knowledge area structure conveys relatively few skills and attitudes on what the graduates are able to do at the time of graduation. Instead of defining a knowledge area or a set of courses, a modern approach to the specification of the curriculum defines a set of graduate competencies, through which they can use their knowledge, skills and attitudes to successfully perform assigned tasks. The curriculum specifies high-level competency areas. The competency areas are divided into competency categories which consist of actual competencies. Competen- cy areas and competency categories are much more stable and less technology- dependent than the competencies themselves which have relatively high likelihood of changes and local variations than at the higher levels. Each competency area has a name, a brief description and a few high-level dimensions. Each category and compe- tency within a category is specified with a name and a brief description too. Compe- tence area covers high-level competencies which enable the graduates to achieve their goals. Competence categories consist of low-level competences which are the tactical tasks to achieve strategic goal. Fig. 1. Curriculum model for traditional and modern approach. 2.2 Requirements of Stakeholders In a competitive environment, universities take into account changes in the world labor market and the sphere of world education. They respond to the needs of em- ployers; make changes in the educational process in order to improve quality, to pro- vide graduates with better employment opportunities. The needs of Stakeholders can be studied by the survey method as a result of the questionnaire. For example, employers' requirements for the qualification of graduates of the Kherson State University (KSU) were investigated [5] within the framework of the MASTIS project [6]. The largest employers of our graduates are such leading companies as DataArt, Logicify, Wezom, Autoplaneta, PrivatBank, Raiffeisen Bank Aval and others. The reason for creation of new curriculum is new insights and the strategic view of our university on future IT education [7] where simulation business model for differ- ent information systems will be used [8]. We conclude that at each company all va- cancies are different so requirements of employers are different too. Good analytical skills and open mind are great results of completed master degree education. Actually, companies don't need ALL these competences of employees; it depends on their posi- tion in the company. Stakeholders requirements to MASTER in Information Systems include: 1. Pre-research – analysis of official reports, research and strategies in order to create an overview of Kherson IT sector. We have used data and references available from official data of Ukrainian statistics, Ministry of Science and Education, Re- ports of IT Industry 2015. KSU has been engaged in collecting and maintaining lists of IT companies and IT departments, with CEO & Heads’ names, phone num- bers, e-mail and web addresses, etc. 2. Online questionnaire of IT companies (https://goo.gl/N7QbFp) 3. Interviews and meetings with stakeholders. CISEEC of KSU organized separate in- terviews with different stakeholders. 4. Collection and analysis of information obtained from pre-research, online ques- tionnaire and meetings with stakeholders to assess the courses according to the re- quirements to specialists training in the field of information systems. CISEEC of KSU is engaged in the analysis of the results. Among our stakeholders were representatives of small, medium and large compa- nies [5]. After processing the online questionnaire of employers, a list of required compe- tences for the Master of Science in Information Systems (MSIS) was generated (Table 1). Table 1. Stakeholders grades of MSIS 2016 competences [5]. Competency Areas Relevance of area, % Business Continuity and Information Assurance 8,78 Systems Development and Deployment 10,61 Data, Information and Content Management 11,33 Ethics, Impacts and Sustainability 12,19 Enterprise Architecture 12,55 IS Strategy and Governance 12,84 Innovation, Organizational Change and Entrepreneur- 13,27 ship IS Management and Operations 9,47 IT Infrastructure 8,96 After interview with employers at Kherson (Ukraine) we obtained following results (Fig. 2). Fig. 2. Relevance for competency areas of Kherson employers, %. After comparing of requirements of global (Table 1) and local Kherson labor mar- ket (Fig. 2) we got significant overestimation for IS Management and Operations (+3.1%) and significant underestimation for Business Continuity and Information Assurance (-6.92%) and IT Infrastructure (-5.4%). A comparative analysis of preliminary and subsequent requirements demonstrates a significantly revised opinion of employers on some competencies (Table 2). Table 2. Comparative analysis of stakeholders’ requirements to competences of graduates for MSIS. Online questionnaire (1 - Average result of stakehold- (1 - Inter- competence specifica- min; ers’ grades for AIS MSIS min; dependence («-» tion grades 5- 2016 competences 5- means revised max) max) opinion) 6. IS Strategy and Governance 3,58 + Systematic competences 3,86 8. IS Management and Opera- 2,64 - tions Methodological compe- 3. Data, Information and Con- 4,17 3,16 ? tences tent Management 4. Ethics, Impacts and Sustain- Social/personal compe- 3,40 + 3,37 ability tences 9. IT Infrastructure 2,50 - Professional competenc- 2. Systems Development and es: analysis, design, and 4,17 2,96 - Deployment project management Professional competenc- 1. Business Continuity and 4,10 2,45 - es: implementation and Information Assurance systems administration 5. Enterprise Architecture 3,50 + Research and academ- 7. Innovation, Organizational 4,13 3,70 + ic/analytical competences Change and Entrepreneurship 3 Model When building a model of the curriculum revision system in computer science, we will use the E-Competence Framework 3.0 specification as an educational standard [9, 10]. The employers' requirements for the master program in Information Systems (MPIS) are the combination of the following realms (Fig. 3): 1. Computing/ICT subject area (IT industry); 2. IS Management (IT departments of small and medium enterprises and large com- panies); 3. Domain of practice (or Internship of master students); 4. Generic individual skills (soft skills). Fig. 3. Elements of MPIS. After processing of several hundred stakeholders’ requirements (according to com- petences area of international Master of Science in Information Systems (MSIS) standards) prepared by 6 Ukraine universities (Simon Kuznets Kharkiv National Uni- versity of Economics, Ukraine National Technical University of Ukraine “KPI”, Lviv Polytechnic National University, Vinnytsia National Technical University, Kherson State University, National Technical University “Kharkiv Polytechnic Institute”) and 2 Montenegro universities (University of Donja Gorica, University "Mediterranean" Podgorica) all project members reveal top competences. Stakeholders range compe- tences from different competency area of MSIS 2016 standard according to their ex- perience on labor market. To cover key competences required by employers in labor market teachers prepare necessary learning outcomes (as indicators of forming com- petences) which later will form the disciplines of ICT curriculum. Competence- oriented approach means that employers can form main requirements to graduates and curriculum because they are final consumers of labor force (Fig. 4). Learning Top competences outcomes Requirements (expected ICT Curricu- (demanded in labor of employers teachers’ lum market) results) Fig. 4. Architecture of ICT curriculum as competence-oriented approach. Fig. 5. AoL process modelling. When revising curricula, universities should take into account international accred- itation standards for providing training, such as the Association for Promoting Colle- giate Schools of Business (AACSB). Learning provision (AoL) refers to a systematic process of collecting data on learning outcomes, reviewing and using it for the con- tinuous development and improvement of degree programs (Fig. 5). AoL ensures that university graduates achieve goals and outcomes if universities manage the quality of curricula. AoL supports the continuous improvement of curric- ula. Accreditation agencies suggest critical revision of module compendium from courses of ICT curriculum after 3-4 years, e.g. in the process of re-accreditation. The expert method should be used to assess the quality of the curriculum revision model in the field of computer science. Thus, the curriculum is built using competencies as the main element, rather than courses or knowledge areas, units and topics. 4 Approbation of the Model in the Educational Process The presented model was used to create a new master program in Information Sys- tems and Technologies at the Department of Informatics, Software Engineering and Economic Cybernetics of KSU. The competences of the graduates were determined in accordance with the requirements of the stakeholders described above. We developed correspondence between competences and learning outcomes for general (Table 3) and specific subject competences (Table 4) for MPIS using re- quirements of global and local labor market. Table 3. Generic competences for MPIS. Competences 1 2 3 4 5 6 Understanding enterprise archi- Engaging entrepreneurial think- tecture principles and the value Project Management tools and Maintaining an ethical culture Know and apply widely used Analyzing and documenting Developing a business plan it provides to business Learning Outcomes business activities techniques ing 1 to coordinate different needs and expec- tations of various project stakeholders, including team members, resource manag- X ers, senior management customers, and sponsors 2 to plan, execute, and control tasks, X phases, and deliverables of the project based on the identified project goals and objectives using Project Management 3 be able to reasonably choose modelling method to construct an adequate model of the system or process using modem com- X puter tools to interpret and analyze the simulation results 4 to use own methods and techniques work in CASE-tools, methods and tech- niques of work in the simulation system X design and development of computer pro- grams 5 to use tools for detecting plagiarism and checking the originality of submitted re- ports, seminar works and theses; ability to X comply with ethical requirements and to comply with copyright. in professional activities 6 counteraction to attempt to get honour X of work that somebody else has done 7 to apply different concepts and skills in various business contexts using case stud- X ies and hands-on exercises with leading software applications 8 to have an understanding of business in- telligence and analytics and how businesses X use them 9 to extract, manipulate and transform da- X ta from different sources Table 4. Specific subject competences for MPIS. Competences 7 8 9 10 11 12 Selecting and using appropriate Selecting between systems de- Integrating and preparing data captured from various sources Implementing and managing Specifying and documenting velopment approaches quality audit processes systems requirements Learning Outcomes Designing systems analytics methods for analytical use 10 to apply different concepts and skills in various business contexts using case X studies and hands-on exercises with lead- ing software applications 11 to be able for metadata and data quali- ty management to integrate data and con- X vert data in any format for storage and delivery to any system 12 to use the requirements, specifications and application of international quality X standards to apply methods for determin- ing of indicators and quality criteria 13 to be able to simulate and manage the X process of quality monitoring in the firm 14 to be able to reasonably choose the modelling method to construct an ade- quate model of the system or process X using modern computer tools to interpret and analyze the simulation results 15 to use own methods and techniques work in CASE-tools, methods and tech- niques of work in the simulation system X design and development of computer programs 16 be able to understand basic features of the systems and their connection with X their environment using tools and tech- niques of Analysis and Planning systems 17 be able to cooperate in a team in order X to deal with a system case study 18 to use methods of structural and ob- ject-oriented analysis and design of mod- ern software complexes to reveal the X business processes requirements of enter- prises Considering competencies proposed by our employers we created the following courses for Curriculum Master of Information System (Table 5), which take into ac- count global and regional requirements to alumni of MPIS. These requirements are presented in the European e-Competence Framework (e-CF 3.0), which contains a reference to 40 competencies as applied at the Information and Communication Tech- nology (ICT) workplace, using a common language for competencies, skills, knowledge and proficiency levels that can be understood throughout Europe [9]. Table 5. Developed Curriculum Master of Information System. Number Mandatory courses Elective courses 1 IS Development and Deployment Scientific research and intellectual property 2 MIS and Data Warehousing Standardization and certification of information technologies 3 Enterprise Architecture Management Business process modeling 4 Management of IS Projects Advances in Programming and IS 5 IT Infrastructure E-commerce and e-business systems 6 Innovations and Entrepreneurship Formal methods of analysis and veri- fication of IS 7 IS Strategy Data Mining 8 IS Security Elective courses from university pool Each course of Computer Science Curriculum is aimed to cover demanded compe- tencies of labor market. Each year at a meeting of employers and faculty members of the department, the list of generic and specific subject competencies should be re- vised. It creates the need to revise the relevant learning outcomes (LO) that are deter- mined by university professors and are formed in students during their study of the course. To revise the adequacy of competencies, learning outcomes, topics and disciplines to the needs of the labor market, a group of experts put points from 0 to 10. Experts are selected among the main employers for graduates of the department, the main faculty members, and representative students to review the adequacy of competencies, learning outcomes, topics and disciplines to meet the needs of the labor market. An example of an expert evaluation is presented in table 6. Table 6. Assessment form for expert 1 about topics of discipline. Expert 1 Competence 1 … Competence 16 List of topics LO1 … LO19 … LO1 … LO19 (1) (1) (16) (16) Topic 1 e11_1 … e11_19 … e11_1 … e11_19 (1) (1) (16) Topic 2 e1 2 _1 … e1 2 _19 … e1 2 _1 … e1(16) 2 _19 … … … … … … … … (1) (1) (16) (16) Topic 10 e110 _1 … e1 10 _19 … e1 10 _1 … e110 _19 where ex (yt_) z - expert’s grade, x - expert’s number, y - topic’s number, z - num- ber of LO, t - number of competence. After questionnaire of all experts, we will determine the average grade and the de- gree of variation obtained after each round. When the grades of the experts will no longer go out of the first and third quartiles then the poll will be stopped. Then the coefficient of variation Vx(_t )y is calculated as the ratio of the root of variation to the 1 average grade. If Vx(_t )y  then the opinions of the experts are considered as compat- 3 1 ible. Whereas if Vx(_t )y  then the opinions of experts have low degree of consensus 3 and then they need further revisions of the disciplines of curriculum. If expert assess- ments are also low, then the corresponding LO and the topics (or their sections) are recommended for removal from the discipline for the next academic year. If expert assessments are high, then the appropriate LO and topics are recommended to be left in the academic discipline for the next academic year. So, the curriculum is specified using the competencies as its foundational element, rather than courses or knowledge areas, units, and topics. Global labor market forms requirements to list of mandatory courses using proposals of EU universities (mem- bers of MASTIS project), among them are University Lumiere Lyon 2 (France), Gui- do Carli Free International University for Social Studies (Italy), University of Mün- ster (Germany), Kaunas University of Technology (Lithuania), University of Maribor (Slovenia), University of Agder (Norway), Lulea University of Technology (Sweden), University of Liechtenstein (Liechtenstein), Italian Association for Informatics and Automatic Calculation (Italy), whereas local labor markets – list of elective courses revealed by project members of Kherson State University. 5 Conclusions and Outlook The model of the curriculum revision system in computer science was designed and developed, the curriculum of ICT was improved, which includes the following provi- sions: 1. Analysis of the results of the stakeholder survey in the local and global labor mar- ket determines the key ICT competencies of graduates in accordance with the re- quirements of employers. 2. Requirements for the competence of graduates determine the expected learning outcomes in accordance with the specifications of e-CF v.3.0. 3. To obtain the expected learning outcomes, a list of curriculum courses is formed, the compliance of which is determined by the European e-Competence Framework (e-CF 3.0). Evolving of the curriculum revision system in computer science is related to the optimization of the developed model by introducing quality management elements in accordance with ISO standards. The experimental approbation of the presented model of revision of the curriculum was held at the Kherson State University in the development and introduction of the new specialty "Information Systems and Technologies" into the educational process. References 1. Eggink, M.E. The Need for a Change in Roles of Universities as Participants in Innovation Systems. In: K.S. Soliman (eds.). 28-th International Business-Information-Management- Association Conference 2016, Seville, VOLS., pp. 68--77. 2. Tomar, T.S. Entrepreneurship Development and Innovation Management: Key Connec- tions. In: K.A. Grant, S. Wise (eds.) 4th International Conference on Innovation and En- trepreneurship, Toronto, Ryerson Univ., 2016, pp. 263--271. 3. Kruss, G. et al. Higher education and economic development: The importance of building technological capabilities. International journal of educational development, 43. 22--31 (2015). 4. Revising the MSIS Curriculum: Specifying Graduate Competencies. Mode of access: http://cis.bentley.edu/htopi/MSIS2016_Draft_03-21-2016_Part1.pdf. 5. Kravtsov, H., Kobets, V. Implementation of Stakeholders’ Requirements and Innovations for ICT Curriculum through Relevant Competences. In: Ermolayev, V. et al. (eds.) Proc. 13-th Int. Conf. ICTERI 2017, Kyiv, Ukraine, May 15-18, 2017, CEUR-WS.org/Vol- 1844, ISSN 1613-0073, P. 414-427, online http://ceur-ws.org/Vol-1844/10000414.pdf. 6. Establishing Modern Master-level Studies in Information Systems. Mode of access: https://mastis.pro. 7. Moergestel, L., Keijzer, A., Stappen, E. Tips and pitfalls for blended learning: Redesigning a CS curriculum using IT. In: Ermolayev, V. et al. (eds.) Proc. 12-th Int. Conf. ICTERI 2016, Kyiv June 21-24, 2016, CEUR-WS.org/Vol-1614, ISSN 1613-0073, P.273--283, online CEUR-WS.org/Vol-1614/ICTERI-2016-CEUR-WS-Volume.pdf. 8. Kobets, V., Weissblut, A.: Nonlinear Dynamic model of a microeconomic system with dif- ferent reciprocity and expectations types of firms: Stability and bifurcations (2016), CEUR Workshop Proceedings, vol. 1614, P. 502-517 (Indexed by: Sci Verse Scopus, DBLP, Google Scholar). Available: CEUR-WS.org/Vol-1614/ICTERI-2016-CEUR- WSVolume.pdf. 9. e-Competence Framework 3.0, E.: A common European Framework for ICT Professionals in all industry sectors (2014). Mode of access: http://www.ecompetences.eu. 10. MSIS 2016 Global Competency Model for Graduate Degree Programs in Information Systems. – December 5, 2016. Mode of access: https://www.acm.org/binaries/content/assets/education/msis2016.pdf.LNCS Homepage, http://www.springer.com/lncs, last accessed 2016/11/21.