=Paper= {{Paper |id=Vol-2485/paper43 |storemode=property |title=Implementation of Algorithms of Image Analysis in the Software Package ColourUnique PRO with the Aim of Increasing the Accuracy of Classification Types Individuals |pdfUrl=https://ceur-ws.org/Vol-2485/paper43.pdf |volume=Vol-2485 |authors=Iuliia Tarasova,Andrey Chechin,Vyacheslav Andreev }} ==Implementation of Algorithms of Image Analysis in the Software Package ColourUnique PRO with the Aim of Increasing the Accuracy of Classification Types Individuals== https://ceur-ws.org/Vol-2485/paper43.pdf
Implementation of Algorithms of Image Analysis in the Software Package
     ColourUnique PRO with the Aim of Increasing the Accuracy of
                    Classification Types Individuals
                                    I.S. Tarasova1, A.V. Chechin1, V.V. Andreev2
                             tar06@list.ru|chechin-a@yandex.ru|vyach.andreev@mail.ru
           1Nizhny Novgorod State University of Architecture and Civil Engineering, Nizhny Novgorod, Russia;
              2Nizhny Novgorod State Technical University n. a. R. E. Alekseev, Nizhniy Novgorod, Russia



    This paper consider the possibilities and prospects of the ColorUnique Pro software complex as a tool for automating the
"Associative color space"© method of professional orientation testing and improving the accuracy of classification of test forms
representing color images. The authors provided the data of verification and testing of the methodology, reflect the relevance of the
study and justify the need to translate the testing into the format of the software package. In the process of implementation of the program
complex, has been identified a problems, proposed solutions and prospects for the development of the program. Now, the authors have
successfully optimized the test form, significantly reduced the time of testing, created a color palette that facilitates evaluation and
classification of the final color images.
    Keywords: career guidance, software package, optimization, analysis, classification, matrix, colour.



                                                                         color preferences allows us to make the theory of Johannes Itten,
1. Introduction                                                          set out in the work «the Art of color» [3].
                                                                             The developed technique distinguished by the possibility of
     The development of career guidance involves the
                                                                         providing a more flexible and widespread recommendation to the
actualization of classical methods (for example, the Holland's
                                                                         recipient, as the derived types are found among both «techies»
Career Test) and the development new, in accordance with the
                                                                         and «humanitarians».
needs of employers and young recipients.
                                                                             But manual making of the test, both in class and at home,
    The Department of Industrial design of the Russian Nizhny
                                                                         takes too much time (up to 3 hours), the basic form quasi-space
Novgorod State University of Architecture and Civil
                                                                         (Fig. 1, a) contains a lot of lines, which makes it difficult for
Engineering, has been developed the career testing method «The
                                                                         visually impaired recipients and people with no artistic
associative color space» ©. This method, developed by
                                                                         experience. In addition, classical techniques (for example, the
    I. S. Tarasova, allows to classify recipients according to
                                                                         Holland's Career Test and Lucher test) are translated into
individual style of activity [2].
                                                                         computer program format and available on specialized sites,
    The method involved making the developed test form quasi-
                                                                         which makes them accessible and convenient for a wide range of
space with color manually, by means of water-soluble paint or
                                                                         recipients, not only designers and artists [6].
markers (Fig. 1, a). The obtained images are correlated by the
expert (educational psychologist) with the standard models,
derived by observing the group of experts of the development of
recipients as students and in the future – as specialists. The
standards are the most typical samples for 5 years. The group of
experts consists of teachers, psychologists and heads of practice
of recipients [5].




    Fig. 1. The test form quasi-space: a. – basic, b. – optimized        Fig. 2. The types of individuals by the style of pond activity: a.
                                                                         – «creator», b. – «rational», c. – «skeptic», d. – «avant-gardist»,
                                                                                                 e. – «mixed type»
     By observation and experiment, derived five types of
individuals by the style of pond activity. They are «creator»,
                                                                              So, for more verification and refinement of the classification
«rational», «skeptic», «avant-gardist» and «mixed type» (Fig. 2).
                                                                         criteria, the method of testing «Associative color space» ©
There are subtypes: «cold rational», «warm rational», «non-
                                                                         needed to optimize the basic test form quasi-space and transfer
contrast creator», «contrast creator», «skeptical the сreator»,
                                                                         the test to the format of the software package ColourUnique Pro
«non-radical avant-gardist», «radical avant-gardist», «non-
                                                                         with the development of image evaluation algorithms and their
saturated sceptic» and «saturated sceptic» [4].
                                                                         classification in accordance with the derived standards (types of
    Characteristic of a particular type of methods of arrangement
                                                                         individuals).
of dark and light areas were derived by a group of experts by
observation, the conclusions about the nature of the recipient's



Copyright © 2019 for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).
    The software package is developed by I. S. Tarasova, A. V.           The social scale of «creators» and «skeptics», equal to 7.7
Chechin and A. V. Shapoval, and includes the following software      and 7.8 respectively, exceeds the same indicator of «rationals»,
modules:                                                             which is 5.8 points.
    ColourUnique M, – where M is monitoring. The first part of           «Rationals» also show a higher rate on the scale of
the program, which collects and systematizes data about the user     «realistic», which is 6.8, while the rate of «creators» is 6.2, and
(age, gender, occupation, level of education), as well as the        «skeptics» - 5.5 points.
automation of the process of filling out the test form. Ready-           In the future, development team plans to conduct a similar
made forms are still being evaluated by a teacher or psychologist.   study for the groups of «social», «enterprising», «investigative»
    ColourUnique A, – where A is the analysis. This program          and other areas, with the exception of the corresponding
already includes a number of algorithms for correlating test         dominant indicator, if such is found as a result of the experiment.
forms with the derived types of individuals, the process is still
controlled by a person, evaluates the correctness of the program,    3. Optimization and algorithms of the software
debugs and formulates information about errors, if there are         package ColourUnique Pro
errors.
    ColourUnique R, – where R is the result. At this stage, the          Experimentally, a group of developers found the optimal
program automatically generates detailed recommendations and         number of lines for the formation of quasi-space, equal to 6 (Fig.
displays the test result in a PDF file available for download on a   1, b.) Such quantity allows to reproduce any characteristic
PC or smartphone. The task of a person is to assess the              structure of the accepted standards.
correctness of the recommendations, their volume and ease of             So, «creators» prefer to use a large number of shades and
download, as well as reading the file from the screen of a PC or     gradients, «rationals» distribute dark and light spots on the
smartphone.                                                          «chess» principle, «skeptics» - on the «linear» principle, «radical
    ColourUnique Pro – final software system, and carrying out       avant-gardist» - the only type that complements the original
data collection, and analysis and evaluation. This version should    quasi-space figures and lines (Fig. 2).
ideally exclude the participation of a psychologist.                     First, let's consider the translation of the developed test form
                                                                     of quasi-space into digital form. In the software module name
2. Verification                                                      ColourUnique M, this is implemented by matrices:
                                                                         1. Base points of the outer and inner rectangle:
    All recipients tested by the method of «Associative color                                             𝑃𝑜𝑏11       𝑃𝑜𝑏12
space» © since 2016, have been tested in parallel by the method                          𝑂𝑢𝑡𝐵𝑜𝑥 = |                             |,
                                                                                                          𝑃𝑜𝑏21       𝑃𝑜𝑏22
of Holland. The Holland's method is a test that contains a pair of
professions between which the recipient is asked to choose the
most preferred. As a result, points are recruited that relate to a                                           𝑃𝑖𝑏11    𝑃𝑖𝑏12
particular type of focus and preferences of the recipient. There                        𝐼𝑛𝑛𝑒𝑟𝐵𝑜𝑥 = |                            |.
                                                                                                             𝑃𝑖𝑏21    𝑃𝑖𝑏22
are 6 of them. They are «realistic», «investigative», «artistic»,
«social», «enterprising» and «conventional».
                                                                         2. Matrix of diagonals, after splitting:
    It is important, that when calculating the results in this
control group from the histogram excluded scale «artistic»,                          𝑃𝑑11      𝑃𝑑12     𝑃𝑑13    𝑃𝑑14         𝑃𝑑15      𝑃𝑑16   𝑃𝑑17
because designers and artists in the group has this scale like the
dominant in 90% of cases.                                                           | 𝑃𝑑21     𝑃𝑑22     𝑃𝑑23    𝑃𝑑24         𝑃𝑑25      𝑃𝑑26   𝑃𝑑27 |
                                                                           𝐷𝑖𝑎𝑔 =                                                                   ,
    The results of data comparison and correlation search are                       | 𝑃𝑑31     𝑃𝑑32     𝑃𝑑33    𝑃𝑑34         𝑃𝑑35      𝑃𝑑36   𝑃𝑑37 |
presented on the histogram (Fig. 3).                                                 𝑃𝑑41      𝑃𝑑42     𝑃𝑑43    𝑃𝑑44         𝑃𝑑45      𝑃𝑑46   𝑃𝑑47

                                                                         where: Pd11=Pob11, Pd21=Pob12,…
                                                                         …Pd17=Pib11, Pd27=Pib12, …

                                                                         3. Matrix of parties in one of four directions, after
                                                                     breakdown:

                                                                                               𝑃𝑠11     𝑃𝑠12    𝑃𝑠13         𝑃𝑠14
                                                                                              | 𝑃𝑠21    𝑃𝑠22    𝑃𝑠23         𝑃𝑠24 |
                                                                                       𝑆=                                          ,
                                                                                              | …        …        …           … |
                                                                                               𝑃𝑠71     𝑃𝑠72    𝑃𝑠73         𝑃𝑠74

                                                                         where: Ps11=Pd11, Ps14 = Pd21 and so on.

                                                                         4. Matrix of cells in one of four directions:

                                                                                                        𝐶11    𝐶12     𝐶13

    Fig. 3. The histogram of distribution of points according to                                       | 𝐶21   𝐶22     𝐶23 |
                                                                                             𝐶𝑒𝑙𝑙𝑠 =                        ,
              the scales of Holland's Career Test                                                      | …      …       … |
                                                                                                        𝐶61    𝐶62     𝐶63
    As can be seen from the histogram, recipients of the
«skeptic» type gain significantly more points on the scale of            where each cell consists of side points:
preferences of the «entrepreneurial» type, namely 8.5 points
against the same indicator of «rationals» count to 5.2 and                                              𝑃𝑠11     𝑃𝑠12
«creators» count to 5.                                                                          𝐶11 = |                 |.
                                                                                                       𝑃𝑠21      𝑃𝑠22
    Cell location coordinates (C) have the following relationship:     gardist» are identified. This is due to the fact that only this
                                                                       subtype in the process of passing the test uses the tools «Pencil»
                    𝐶 = 𝑓 (𝑃; 𝑘; 𝐵; 𝐷; 𝑆),                             and «Eraser».
    where P – the coordinates of the base points of the outer              This is followed by Phase 2 - analysis of the color profile of
rectangle, k – the cells compression ratio, B– the block of the        the recipient.
quasi-spatial model, D – the diagonal, S – the sides.                      Consider in more detail on the review of the graphical editor
                                                                       of the ColourUnique Pro software package.
    The stages of generation of cells:                                     The fact that the graphic editors of programs such as, for
    1. The initial specifying parameters, generation of base           example, Adobe Photoshop, built on the display of chromatic
points and calculation of proportions;                                 colors in RGB, CMYK, Indexed colors and Lab modes.
    2. The creation of quadrangular cells, including the                   For the designer, this gives excellent opportunities to obtain
proportional breakdown of the diagonals and sides;                     the most complex and diverse shades, however, in the case of
    3. The entry of cells into the database.                           assessing the color profile of the recipient software complex
    The development of the ColourUnique Pro software package           color unique, there is a problem of correlation shades close to
includes the use of Internet technologies. This is necessary in        gray, or composite shades with belonging to a particular tone. For
order to organize multi-user testing and collection of results into    example, «red», «orange», «yellow» and so on.
a single database. On the server side, Python is used to calculate
point coordinates [1].
    The first thing the user sees when opening the program is an
input questionnaire. It is needed to collect statistics and send the
result to the recipient:




       Fig. 4. The form of user data collection in the software
                   package ColourUnique Pro

    After filling out the form, the recipient enters the program
interface, where the test form is located. Sounds audio
instruction, at the end of which the menu becomes active:




                                                                            Fig. 6. The initial algorithm of analysis and classification of
                                                                       test forms

                                                                           Based on the RAL color system, the group of developers
                                                                       selected the colors indicated in the system as shades of «red»,
                                                                       «orange» and so on [7].
                                                                           Thus, the recipients are offered ready-made pallets, the
                                                                       coordinates of the shades of which are already recorded in the
                                                                       program code as colors related to a specific tone. The "creators",
                                                                       prone to creating gradients, will be able to use ready-made stretch
                                                                       marks, other types will find in the pallets as the main colors and
Fig. 5. The interface of the software module ColourUnique M –          shades of gray.
  the first module of the software package ColourUnique Pro                This step allowed not only to reduce the time of filling the
                                                                       test (from 3 hours manually to 15-40 minutes), but also to
    The task of the recipient is to fill in the form with the colors   significantly improve the original type recognition algorithm.
offered in the graphical editor in accordance with the Association         The Fig. 7 shows the distribution of «creators», «rationals»
specified by the voice instructor. At the end of the work with the     and «skeptics» by the total number of colors used. The subtype
form, the recipient presses the «Finish» button. Next, the             "non-radical avant-gardist" is not added to this sample, as at the
program analyzes the resulting image in accordance with the            moment only 4% of the total sample for 5 years of testing are
specified algorithms.                                                  representatives of such type.
    Before the implementation of the software, the algorithm had           The diagram shows that representatives of the «creator» type
the appearance as shown on Fig. 6.                                     use a much greater number of colors and shades, «rationals» and
    In the process of realization, the first stage (Phase 1) of the    «skeptics». Thus, the average total number of
algorithm was implemented – after its passage with 100 percent
probability, the recipients related to the subtype «radical avant-
shades of «creators» has 37 points, «rationals» - 12 points,          4. Conclusion
«skeptics» - 9 points.
                                                                          At the moment, the test form quasi-space has been
                                                                      successfully converted into an electronic format, reduced from
                                                                      12 to 6 lines, oriented in such a way that it is convenient for the
                                                                      user to fill each sector, despite the perspective distortion.
                                                                          The testing procedure is significantly simplified and reduced,
                                                                      on average, from 3 hours to 15-40 minutes (the Creator fills out




    Fig. 7. The distribution diagram of the types «creator»,
  «rational» and «skeptic» by the total number of colors used

    It is important to note that the program considers cells filled
with colors that have the same RGB coordinates in one used
shade. This distribution result is explained by the feature of
«creators» to create gradients, which involves the use of a large
number of shades.




                                                                      the form longer).
                                                                          The simplified graphic editor allowed to analyze the
                                                                      simplified test forms and highlight the quantitative
                                                                      characteristics characteristic of the creators (from 5 shades of one
                                                                      tone, the total number of colors used on average 37 points).
                                                                          The original algorithm is refined (Fig 9).


                                                                           Fig. 9. The refined algorithm of analysis and classification of
                                                                      test forms

    Fig. 8. The histogram of the average number of shades of              To distinguish the types of «rational», «skeptic» and subtype
each tone of the types «creator», «rational» and «skeptic»            «non-radical avant-gardist» (Phase 3), an algorithm for
                                                                      recognizing the «chess» and «linear» color distribution is
    Consider the histogram shown in fig. 8. This histogram most       developed, since «non-radical avant-gardists» are also
clearly characterizes how much more different shades are used         characterized by the formation of lines, but vertical (in the case
on average the «creators» in comparison with other types. In this     of a «skeptic» - horizontal lines).
group of creators there are both their subtypes – contrast and non-       The study shows that it is possible to derive a specific "filter"
contrast. The most preferred tone of «creators» – red, the least –    for each type.
shades of gray. «Rationals» tend to be about the same across the          The program module ColourUnique M is implemented and
spectrum, «skeptics» – to reds-oranges and greens.                    the program module ColourUnique A is started.
    The stage of color analysis (Phase 2) allows you to select the        The development team plans to introduce associative
type of «creator» with high accuracy. The «rational» and              networks into the analysis and classification process (for
«skeptic» types also show some color preferences, however, they       example, Hopfield networks).
are not enough to accurately separate these two types at the
second stage of the original algorithm.                               5. Gratitudes
    At the moment, the developers are considered to be the                The work was partially supported by RFBR, Grant № 19-07-
recipient of the «creator», if its color profile at least one tone,   00455.
there are 5 or more shades.                                               Speaker I. S. Tarasova expresses gratitude for the help in
                                                                      carrying out this research to the head of the Department of
                                                                      Industrial design of Nizhny Novgorod State University of
                                                                      Architecture and Civil Engineering – A.V. Shapoval, the head of
                                                                      the Department «Nuclear reactors and power plants» of Nizhny
Novgorod state technical university n. a. R. E. Alekseev, V. V.
Andreev, docent of the Department of Geoinformatics, geodesy
and cadastre of Nizhny Novgorod State University of
Architecture and Civil Engineering A. V. Chechin, and academic
groups D 29.16, D 30.17, and D 31.18 the Department of
Industrial design of Nizhny Novgorod State University of
Architecture and Civil Engineering for participation in scientific-
research work.

6. References
[1] Chechin, A. V. Processing of GEODATA using the Python
language [Text] / V. A. Chechin // proceedings of the scientific
Congress of the 20th International scientific-industrial forum
"Great Rivers 2018" – N. Novgorod: NNGASU. – P. 379-380.
[2] Grigorieva, M. V. Psychology of work. Lecture notes [Text]
/ M. V. Grigorieva. – Moscow: Higher education, 2006. – 192 p.
[3] Itten, J. The art of color, I. Itten; TRANS. with it. and
Foreword. L. Monakhova. – 2nd ed. – M. : D. Aronov, 2001. –
95 p.: Il. – ISBN 5-94056-003-2.
[4] Tarasova, I. S. Prediction of the distribution of the visual mass
of the dominant color combinations based on the analysis of the
quasi-space model [Text] / I. S. Tarasova, V. V. Andreev, E. A.
Martemyanova // Journal of Scientific and technical Bulletin of
the Volga region, №5, 2018. – Pp. 256-260.
[5] Torshilova, E. M. Can you believe harmony with algebra? :
Critic. the essay is expert. aesthetics / E. M. Torshilova. -
Moscow : Art, 1989. - 207,[1] p.; 20 cm. Experimental aesthetics
FB 2 89-19/310, FB 2 89-19/311
[6] СareerGuidance.ru [Electronic resource]: Website:
https://proforientator.ru/
[7] Ral.ru [Electronic resource]: Website: https://ral.ru