Methods of assessing the quality of websites of higher education institutions are considered. It is proposed to choose a model of quality assessment, which is based on the following attributes: quality of content, quality of design, ease of use of the site for applicants and students, reputation. Based on the analysis of existing models, the basic model was selected, which was model-based Assessment Methodology) was used. Within the modified model, changes were made to two attributes. Quantitative values of metrics, characteristics and quality attributes were obtained and the value of the overall quality assessment of the websites of Taras Shevchenko National University of Kyiv and Kyiv National University of Trade and Economics was calculated. Web page, internet, metrics, website accessibility, website usability, webquality ORCID: 0000-0002-0281-4396 (Y. Kravchenko); 0000-0002-3997-2785 (O. Leshchenko); 0000-0003-3892-4543 (N. Dakhno);
1. Introduction
obtaining information;
in all aspects of life [
The rapid development and spread of new information and software technologies has an impact on
politics, economics, management, finance, science, culture and other spheres of society [
Software technologies have an increasing impact on all aspects of our lives:
development and improvement of global networks [
The efficiency of higher education (HEI), in modern conditions, also requires the use of new information technologies and effective marketing communications in higher professional education and the market of educational services. An effective
comprehensive educational and scientific activities of the university on the Internet. Proper evaluation of the effectiveness of the WEB-site will allow you to make the necessary changes in the work of existing resources, and understanding the evaluation parameters and their correct presentation - to avoid mistakes when creating a new Internet resource.
A
modern website [
2022 Copyright for this paper by its authors. or technical content and the content or information content, the availability of adaptability and the reputation of the website.
This work describes an algorithm for selecting attributes and characteristics and calculating metrics that help determine the quality of a web application. The algorithm helps to analyze the factors of site quality assessment through structural properties. This article aims to explore tools for assessing the quality of web applications for empirically derived metrics. The rating approach is considered, which allows to carry out a comparative analysis of university sites, and the final quantitative measure of the rating shows how much better or worse the performance of the site compared to the leader of the rating.
Analysis of recent research and publications on this topic. Existing general methods of assessing the
effectiveness of sites, as well as common approaches to calculating ROI (return on investment in
WEBresources) can not be used to assess university sites due to the characteristics of the product of higher
education institutions (HEIs) - educational services. For example, in [
A separate area in the analysis of WEB-resources is SEO-audit (search engine optimization
analysis of site promotion in search engines and directories) and analysis based on WEB-analytics
(according to traffic statistics systems and log analyzers). You can get acquainted in more detail with
the step-by-step analysis of sites and practical recommendations for improving the efficiency of the site
in [
With the beginning of serious competition between universities, related to the reduction of the number of entrants, as well as the submission of documents for admission of applicants online, the quality of the university website becomes one of the most important components of successful recruitment. The problem of assessing the quality of websites is relevant around the world, because every day a large number of websites are created and launched, which in today's society can be used for various purposes: from business card sites to automated large portal sites in the direction of web commerce. The quality of a website can be assessed from two points of view: developers and end users. Developers focus on features such as support, security, functionality, and end users pay more attention to ease of use, efficiency, reliability, and more. Obviously, evaluating the quality of the website from the point of view of the user, who is primarily an applicant, is a priority for universities. From this point of view, determining the quality of a website shows how well it is designed and how well it meets the needs of the end user.
In general, the quality of a website tends to make it possible to compare the results of evaluating the quality of different websites. The evaluation process should be based on criteria that can be quantified and measured. This is possible only if the appropriate quality model and quality assessment methodology are formalized, within which the quality of the website is quantified.
The website is actually a specific software that is defined within a system of attributes of different
levels, which together form a quality model [
The first model for determining the quality of software was created in the mid-1970s. The
International Organization for Standardization (ISO) together with the International Electrotechnical
Commission (IEC) has completed the development of a new standard ISO 9126 "Information
Technologies. Evaluation of software products. Qualitative characteristics and guidelines" [
The model described above is fairly general and most researchers focus on developing quality
models for a specific field. In particular, the authors have recently proposed narrower models that apply
to websites in a particular direction. Subsequently, many website quality models have been developed
[
Fitzpatrick R. with a team of authors [
Principles of development of the Human Computer Interaction method. According to the assessment of the current user interface or when developing a new interface, the basic principles of development should be identified, which focus on users and tasks.Early techniques interpreted the cognitive processes of users. These processes are predictable and quantifiable. The methodologies suggested that the developers consider the results of cognitive research in such areas as memory and attention when designing user interfaces. Modern models tend to focus on constant feedback and dialogue between users, developers and engineers. Currently, modern and widely applicable is user-oriented design. Users should be central to the development of any computer system.
Users, developers, and technicians work together to articulate desires, needs, and boundaries, and to create a system that meets those requirements. User-oriented projects often use research on the ethnographic tools in which users will work with the system. The principles of user interface development can be considered at any time during the entire development period.
In [
The WebQEM process includes four main technical steps: Definition and specification of requirements. Elementary assessment (stages of design and implementation). Global assessment (planning and implementation stages). Conclusion (recommendations).
Figure 1 shows the basic process of evaluating the use of the methodology. It includes phases, stages, basic steps, inputs and outputs.
There are three methods for selecting metrics for software properties: model of the responsible person; standardized metrics; Goal-question-metric.
The method of the responsible person involves the selection of the necessary metrics directly by the responsible person. The selection of metrics in this case is associated with the tasks to be solved and the decisions to be made when solving these problems. Decisions on metric measurement are made based on the experience of the responsible person or on the recommendations of experts.
The method of using standardized metrics involves the use of recommendations or standards of some
organizations engaged in research in the field of software development. This method is based on
empirical research. Its use is limited to the scope of research, recommendations for the selection of
metrics are general. The most common method of selecting metrics for software properties is
"goalquestion-metric" [
The method consists of three key steps: formulate goals that should be achieved by evaluating the properties of the software; questions are formulated for each goal that needs to be answered, to determine whether the goals have been achieved; identifies metrics that can be used to answer the questions that were asked in the second stage. The application of the method "goal-question-metric" includes the processes of planning, defining goals, questions and metrics, data collection and data analysis (Fig. 2). An important aspect in using this method is the experience and competence of the expert. At the same time, this method is not formalized, which gives a certain share of the probability of inadequate selection of metrics. In addition, this method does not allow you to select the metric software that is best suited to characterize the property. Therefore, to solve this problem, it is proposed to formalize the problem by using a subjectoriented method of constructing relationships between software metrics.
The user-oriented software quality assessment model [
In [
Liburne and others [
Most of these models focus mainly on the technical and functional aspects of web design, but do not
take into account aesthetic and reputational aspects. Therefore, Zhou Z. in [
An effective quality control mechanism for web applications is the use of web metrics. Due to the rapid growth of web resources, there is a need for up-to-date metrics that can have a big impact on the resource as a whole and on individual sites from different courses. The quality of the site (or quality web applications) can be assessed from two points of view: programmers and end users. Aspects of website quality are focused by programmers on the degree of maintainability, security, functionality, etc. Although end users are interested in usability, efficiency, security issues.
Extending these concepts, the assessment of website quality may depend on: 1. Task-related factors that affect the end result for quality and content assessment. 2. Factors related to performance, namely: efficiency and technology of web applications. For example: response time, transaction output and reliability. 3. Development factors that are crucial for web application developers and maintainers.
Therefore, the parameters of the website that can be implemented as a tool to ensure comprehensive results are identified.
To assess the quality of the university in the structure of this work is based on the quality model of the website, using the methodology of quality assessment recommended by Libern B. A hierarchical three-tier tree model consisting of five attributes of the model represents this model: design, usability, multimedia, content, reputation.
Each attribute has its own weights. The attributes of design, usability and multimedia have the greatest impact on the quality of user perception, while content and reputation are mostly seen from the point of view of administrators.
The quality assessment system provides a simple scale of compliance. This scale starts at 0% and ends at 100%. On this scale, 0% shows a low quality score, and on a scale of 100% shows excellent quality scores. This is the QCF (Quality Compliance Framework) for web applications.
Quality Evaluation:
Quality Evaluation= characteristics ' s QCF
Quality compliance framework score for characteristics and sub characteristics: Attribute Quality compliance framework score:
Quality characteristics QCF score= metrics ' s QCF
Quality Indicator=
After selecting the attributes, each of them is broken down into key characteristics. The "goalquestion-metric" method selects metrics that are assigned to each characteristic. Then for each characteristic, with the method of "goal-question-metric", a set of metrics is selected for each characteristic. At the next stage in the quality assessment model determine the weights for each characteristic. The structure of the model of quality assessment of universities, presented in this work, is presented in table 1.
As it was mentioned, the above model is aimed at generalizing the assessment of website quality for all industries, which in practice cannot be achieved due to certain specifics of a particular industry. In particular, to assess the quality of the university's website, it is proposed to change the values of the weights of individual attributes.
In particular, given that the university website is used by applicants, usually as an online guide to the information required for admission, so the weights of the attributes "Content" and "Reputation" should be greater than other weights (Table 2). (1) (2) (3)
When assessing the quality of the university website, the sites of two universities were evaluated and the metrics of the first pages of the sites were determined (Fig. 3, Fig. 4). Detailed results of the site quality assessment of the Taras Shevchenko National University of Kyiv and the Kyiv National University of Trade and Economics are presented in Table 3.
The general results of quality assessment of Taras Shevchenko National University and KNUTE sites are given in Table 4. You can see that the KNUTE website has lower performance values than the Taras Shevchenko National University website, in terms of all quality characteristics except the third. The final assessment of the quality of the websites of the selected universities differs by 0.32, according to Table 4. The KNUTE website has the worst indicators in terms of usability and content attributes, which led to such a big difference in the overall assessment.
To improve the quality of the site of the second university it is necessary to: develop a mobile version of the site (to increase adaptability); to carry out search engine optimization (SEO-optimization); significantly expand the content of international relations of universities, as their presence demonstrates the position and competitiveness of the institution in the international arena, as well as affects the level of quality of educational services.
After analyzing each of the algorithms and comparing the results, we can say that in this study, among all the proposed methods of machine learning to solve problems of binary classification, the algorithm of decision-making trees best coped. Evaluating it according to the selected metrics and comparing the results with other algorithms, we can talk about its most significant effectiveness in DSS.
The developed classifier and its application in DSS can help hospitals and health facilities decide who needs attention in the first place when the system is overcrowded, as well as eliminate delays in providing the necessary care. This study could be scaled up to other diseases to help the health care system respond more effectively to an outbreak or pandemic. 7. References [1] Ullah, A., Wang, B., Sheng, J., Long, J., Khan, N., & Sun, Z. (2021). Identifying vital nodes from local and global perspectives in complex networks. Expert Systems with Applications, 186, 115778.