<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Optimal Control of Human Capital Allocation for Piecewise Smooth Dynamic Model</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Irina Bolodurina</string-name>
          <email>ipbolodurina@yandex.ru</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Elena Golovatskaia</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Natalya Khanzhina</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Larisa An</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Applied Mathematics, Orenburg State University</institution>
          ,
          <addr-line>Orenburg, Russian Federation</addr-line>
        </aff>
      </contrib-group>
      <fpage>24</fpage>
      <lpage>34</lpage>
      <abstract>
        <p>The article presents optimal control of human capital allocation under the condition of smoothness abnormality in the right-hand member of the dynamic system. It describes an individual's behavior who strives to leave to his/her heirs the maximum of cash and tries to get the maximum utility through controlling expenditures and time consumption for work and studies. The objective function of the model maximizes the human life utility. The latter is formed by the human capital development and financial savings for heirs. The authors developed special methods how to find optimal control and take into account smoothness abnormality in the right-hand member of the dynamic system. They defined the optimality conditions and designed algorithmic support and software to find optimal control and interpret its content.</p>
      </abstract>
      <kwd-group>
        <kwd />
        <kwd>Optimal control</kwd>
        <kwd>human capital</kwd>
        <kwd>maximum principle</kwd>
        <kwd>piecewise smooth dynamic system</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Nowadays the design and development of new technologies, computing and
informatics are becoming of particular importance to all spheres of social life. Because of that
workforce requires excellent qualifications and specific knowledge. In this regard we
can state that human capital is the key factor for society development. Besides the
modeling in human capital allocation as well as its management to achieve the
maximum results are the topical modern issues to study.</p>
      <p>
        Human capital is the combination of physical and mental capacities of a person,
his/her knowledge, abilities and skills, life and professional experience used in public
reproduction [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. The acquisition of human capital is made up from the investments
into health, safety, life quality, science, education and culture. One of the major
factors leading to human capital growth is the investment in education and development
of employees’ professional qualifications. And the investment to maintain healthy
lifestyle provides the increase in the use duration of human capital and the
improvement of its quality.
      </p>
      <p>As time goes on, investments into human capital are to provide incomes to its
holder. Though spending part of his/her employment time on education, a person
cannot count on the full volume of potential salary. Thus there is a challenge to
allocate a reasonable portion of time for education.</p>
      <p>
        To respond to this challenge let’s apply K. Pohmer model designed for the optimal
management of personal income allocation [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
2
      </p>
      <p>Mathematical Model of Human Capital Allocation and Its
Numerical Solution
Let’s assume that at the life beginning any individual has an original human capital
H0 , i.e. innate abilities, health, etc., and an original financial capital K 0 , i.e.
financial funds of parents, a state, etc.</p>
      <p>Human capital changes as the result of education attainment, life and professional
experience acquisition. Let’s consider the function of human capital raising:
H (0)  H 0 , K (0)  K 0 .</p>
      <p>FH (t), s(t), l(t) ,
where
H (t) is human capital;
l(t) is the fraction of total time spent for working;
s(t) is the amount of employment time spent for education and professional
expertise development.</p>
      <p>Note that as the time goes, knowledge becomes less relevant and thus loses its
value . The changing of human capital will look like</p>
      <p>H (t)  FH (t), s(t), l(t)H (t) ,
where  is the loss index of acquired skills, it equals to amortization norm for fixed
capital.</p>
      <p>Human capital affects financial capital and we can write the rate of financial
capital change as</p>
      <p>K (t)  iK (t)  rH (t)g(s(t))l(t)  c(t) ,
where
K (t) is the financial capital;
i is the capital cost factor;
r is the price per human capital unit;
c(t) is the consumption;
time spent.</p>
      <p>g(s) is the potential salary in relation to education level which is subject to the
(1)
(2)
(3)
(4)</p>
      <p>g(s) is the production capability curve that defines the correlation between
education and earnings: the lower (higher) is s , the more (less) is potential salary though
the level of human capital acquisitions is lower (higher). Thus g(s) satisfies the
conwith initial conditions</p>
      <p>Derived criteria (5) satisfy to the function
Applying to conditions (6) we will define the required function
So the model for human capital distribution has two processes
g(0)  1, g(1)  0 , gs  0 , gss  0 .</p>
      <p>g(s)  as2  bs  c , a  0 .</p>
      <p>g(s)  1 (1 a)s  as2 , a  0 .</p>
      <p>H (t)  FH (t), s(t), l(t)H (t) ,
K (t)  iK (t)  rH (t)g(s(t))l(t)  c(t) ,</p>
      <p>H (0)  H0 , K (0)  K0 ,
and restrictions imposed on controllable variables</p>
      <p>c(t)  0 , 0  l(t)  1 , 0  s(t)  1 .</p>
      <p>Under restrictions we mean a constant consumption of goods and the poverty of
employment time, for example, retirement period. The employment time is to be less
than 1, as an individual needs to have a rest. The fraction of total time spent for a rest,
sleeping included is ( 1  l(t) ).</p>
      <p>One of the priorities for any individual is to give birth to healthy off-springs and
sustain their growth. To achieve these goals a person is to increase his/her human
capital and raise financial capital for his/her heirs. So the objective function of the
model maximizes human life utility made up of human capital development and
financial savings for heirs.</p>
      <p>0</p>
      <p>T</p>
      <p>I (c, s, l)  U (t, c, l, H )et dt  Z K (T )  max,
where
T is the duration of an individual’s life;
 is the time preference rate of an individual;
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)</p>
      <p>U (t, c, l, H ) is the utility function dependent on consumption, employment time
and human capital.</p>
      <p>ZK (T ) is the utility function for heirs.</p>
      <p>The functions U (t, c, l, H ) and ZK (T ) have a typical for economics definitions
U </p>
      <p>
c1
1
(1 l)1
1 
t</p>
      <p>H 1
1</p>
      <p>,
Z  </p>
      <p>K (T )1k
1  k
,
(13)
(14)
(15)
(16)
(17)
(18)
(19)
(20)
(21)</p>
      <p>F  H sl ,
where  is the parameter in the Cobb-Douglas function ,  is the partial elasticity of
human capital.</p>
      <p>So the optimal management problem looks like</p>
      <p>T  c(t)1
I (c, s, l)   
0  1

(1 l(t))1
1 
t H (t)1 et dt   K (T )1k
1  1 k
K (t)  iK (t)  rH (t)l(t)1 (1 a)s(t)  as(t)2  c(t) ,</p>
      <p>H (0)  H0 , K (0)  K0 ,
c(t)  0 , 0  s(t)  1 , 0  l(t)  1 .</p>
      <p>
        The problem to solve (16) – (20) is an optimal control problem with a free right
end and control restrictions. Let’s use the Pontryagin maximum principle [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
where ratios  ,  ,  and k point to utility elasticity and  ,  and  are the
measures for rest, human capital and heirs capital and t shows that with aging
education plays a greater role.
      </p>
      <p>Production function for human capital looks like
  1  H  sl  H  2  iK  rHg(s)l  c </p>
      <p> c1
 
 1 

 
where conjugate variables  1 and  2 satisfy to</p>
      <p>Optimal control is defined when the Pontryagin function is at maximum
 1(T )  0,

 2  i 2 ,

 2 (T )  K (T )k .
1  1   H  1sl  2rg (s)l tH  et ,
 2с 
с1
1


et  max 2с 
c0 
с1
1
et ,


 1H  ls  (a 1) 2rHls  a 2rHls 2 
 max 1H  ls  (a 1) 2rHls  a 2rHls2,
0s1
 1H  sl  2rHg (s)l 
1 l 1
1 </p>
      <p>et 


 max  1H  sl  2rHg (s)l 
0l 1
1 l 1
1 </p>
      <p>
et .</p>
      <p>
        

Maximum of expressions (23) – (25) is possible when
1
c   2et  ,
0, s*  0,
s  s*, s* [
        <xref ref-type="bibr" rid="ref1">0, 1</xref>
        ], where s*  a 1
 2a
1, s*  1,


 1H  1
2a 2r
,
0, l*  0,
l  
l*, l*  0,
      </p>
      <p>  1
where l*  1   1H s  2rHg (s) et   .</p>
      <p>Considering the types of formulae received, let’s use numerical solution to find the
optimal control.</p>
      <p>
        To search an optimal path and optimal control we use software algorithm based on
iterative method [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. The value parameters of the problem are equal to the values in
the table 1.
(22)
(23)
(24)
(25)
(26)
(27)
(28)
      </p>
      <p>The resulting graph of the control parameter “employment time” variation shows
its maximum at the age of 14. It certifies the possibility of time saving as a young
body needs less rest. And the graph for s(t) parameter dynamics shows that all
employment time is spent for education, both at school or university, and self-education
as well. As the time goes, the amount of time for education is decreasing as an
individual has accumulated some knowledge and tries to use it in his/her activities. The
employment time decreases because of changes in personal life like marriages, birth
of children. According to the statistical data an average person finishes his/her labor
activity at the age of 70.</p>
      <p>Under control parameters an individual’s human capital grows by the age of 40. By
that age an individual gets a certain professional expertise. Besides investments in
education characterizing the period of negative capital at the age period between 18
and 37, and acquired experience provide stable income. The financial capital
curve K(t) starts to grow. The growth of consumption c(t) follows the growth of an
individual’s income.
3</p>
      <p>Optimal Control Problem for Discontinuous Dynamic System
Let’s consider the right-hand smoothness abnormality in dynamic restrictions when i
parameter characterizes capital cost factor and has two values depending on negative
or positive sign of K (t) :</p>
      <p>i1, K (t)  0,
i  </p>
      <p>i2  i1, K (t)  0,
i.e. the problem is:</p>
      <p>T  c1
I (c, s, l)   
0 1 

i1K  rHlg(s)  c, K (t)  0,
K (t)  
i2K  rHlg(s)  c, K (t)  0, i2  i1,</p>
      <p>H (0)  H0 , K(0)  K0 ,
c(t)  0 , 0  s(t)  1 , 0  l(t)  1 ,
g(s)  1 (1 a)s  as2 .
(29)
(30)
(31)
(32)
(33)
(34)</p>
      <p>In the optimization problem to solve (30) – (34) the system of differential
equations is the system with the discontinuous right-hand part
where x  (H , K ) is the absolutely-continuous on the interval [0, T ] vector-function
of phase, u  (c, s, l) is the piecewise-continuous on the interval [0, T ]
vectorfunction of phase. On the strength of all evidences the switching surface S (t, x) is a
continuously differentiable function that looks like S(t, x)  K(t) .</p>
      <p>Let’s consider the case of a single penetration of the switching surface by the path
function at  , where  is the switching point, i.e. the point where K( )  0 .</p>
      <p>To formulate the theorem on the necessary optimal conditions for optimal control
we use the Pontryagin function:</p>
      <p>1(t, x, u, 1(t)), S (x)  0,
(t, x, u, (t))  </p>
      <p>2 (t, x, u, 2 (t)), S (x)  0,
where</p>
      <p> 1(t), S (x)  0,
 (t)  </p>
      <p> 2 (t), S (x)  0,
 1(t) : [0, )  R2 ,  2 (t) : [ , T ]  R2 ,</p>
      <p> c1
 j (t, x, u, (t))  
1 
 
0  0 multiplier. Then the following conditions are fulfilled
1. optimal control u (t)  (c (t), s (t), l (t)) , t 0, T  in all continuity points affords a
maximum of the Pontryagin function  j (t, x(t), u, j (t)) , j  1, 2 , in all
allowable u(t) :
 j (t, x(t), u (t), j (t))  max  j (t, x(t), u, j (t)) , j  1, 2 ;</p>
      <p>u(t)
2. the conjugate vector-function  j (t)  ( 1j , 2j ) , j  1, 2 , satisfies to the system of
differential equation:</p>
      <p> 1j (t)  tH  et  1j H  1sl   2jrlg(s) , j  1, 2 ,
3. transversability conditions:
 2j (t)  i j 2j , j  1, 2 ;</p>
      <p> 12 (T )  0 ,
 22 (T )  K (T )k ;
4. at  which is the point of the switching surface penetration by the path function
the conjugate vector-function and the Pontryagin function meet the jump condition
 1(  0)  2 (  0)  
S( , x( ))
x</p>
      <p>, S( , x( ))  0 ,
 (  0)  2(  0) ,</p>
      <p>1
  ( f2 ( , x( ), u(  0))  f1( , x( ), u(  0)), 2 ( ))
 S ( , x( )) 
 , f1( , x( ), u(  0))
 x 
,
where  is the magnitude of jump in the point  .</p>
      <p>Thus we have a boundary value problem of the maximum principle of Pontryagin.
To solve it we use the Lagrange method of multipliers based on the simplifying the
original continuous problem of optimal control (30) – (34) to the discrete one.</p>
      <p>To find optimal control and trajectories we used a numerical software algorithm
based on the gradient projection. Figure 3 and Figure 4 present the results of solving
the discontinuous problem of optimal control. On the diagrams the curves H1(t) ,
K1(t) , l1(t), c1(t), s1(t) demonstrate the solutions of the discontinuous problem
with the parameters i1  0,04 and i2  0,06 , and the curves H0(t) , K0(t) , l0(t),
c0(t) , s0(t) are the solutions for the smooth right-hand problem
with
i1  i2  i  0,04 .
final time for professional training ( t2 ), retirement age ( t3 ), left boundary of time
with negative capital ( t4 ), the right boundary of time with negative capital ( t5 ), the
age with maximum employment time ( tl max ) for smooth ( i1  0,04 ) and
discontinuous ( i2  0,06 ) cases.</p>
      <p>The results received after the solution of the discontinuous problem for optimal
control prove the increase of “employment time” parameter in comparison with the
results of the smooth problem and the maximum of this parameter is at the age of 26.
Human capital demonstrates a slight increase. Professional education enters the
educational experience on earlier stages. Because of the capital cost factor increase, the
period with negative capital is reduced considerably. The increase of the capital cost
reduces considerably the period with negative capital (Figure 5) and increases the
growth rate of financial capital curve. The consumption is constant.</p>
      <p>In conclusion we can state that changes in capital cost factor happen through the
whole individual’s life. These changes when caused by the discontinuity of dynamic
restrictions in optimal control problem influence deeply in the allocation of human
capital and the time period for professional training in education acquisition.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Maximova</surname>
            ,
            <given-names>V.F.</given-names>
          </string-name>
          <article-title>The investment into human capital: manual /</article-title>
          <string-name>
            <given-names>V.F.</given-names>
            <surname>Maximova</surname>
          </string-name>
          . - M.: Eurasian Open University,
          <year>2010</year>
          . - 54 p.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Pohmer</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          <article-title>Microeconomic theory of individual</article-title>
          and group incomes.
          <source>- Studies in Contemporary Economics</source>
          , Vol.
          <volume>16</volume>
          . - Berlin; Heidelberg; New York; Tokyo: Springer-Verlag,
          <year>1985</year>
          . - 214 p.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Andreeva</surname>
          </string-name>
          , E.A. Mathematical modelling: manual / E.A.
          <string-name>
            <surname>Andreeva</surname>
            ,
            <given-names>V.M.</given-names>
          </string-name>
          <string-name>
            <surname>Tziruleva</surname>
          </string-name>
          . - Tver: Tver State University,
          <year>2004</year>
          . - 502 p.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>