Mathematical Method of Mapping Configuration Space for Manipulator Master-Slave Teleoperation Vyacheslav I. Petrenko Fariza B. Tebueva Vladislav B. Sychkov vip.petrenko@gmail.com fariza.teb@gmail.com vladtrav@inbox.ru NCFU NCFU NCFU Mikhail Y. Kabinyakov Nikolai Y. Untevsky micssys@gmail.com untewsky@yandex.ru NCFU NCFU North-Caucasus Federal University Stavropol, Russian Federation 355009 Abstract The aim of the article is to expand the functionality of the copy control of an anthropomorphic manipulator using an exoskeleton master de- vice. To achieve the goal, the article proposed a mathematical method for mapping the configuration space of the master manipulator into the configuration space of the slave manipulator. The developed mathe- matical method is based on the requirements of maximizing the working space of the slave manipulator, the uniqueness of the correspondence of the position of the slave manipulator to the position of the master manipulator and the human-like movements. Keywords: anthropomorphic manipulator, mathematical method, copying control. 1 Introduction Currently, many areas of human activity are intensively implemented robotic systems. One of the promising areas of robotics is anthropomorphic robots. The capabilities of anthropomorphic robots depend on the type of control used. Simple and effective type of control robots of this type is copying control. Copying control implements the virtual presence of the operator in the robot, which allows the robot to solve complex problems in non-deterministic environments: rescue operations, space exploration, military operations. The basis of this type of control is the simultaneous formation of the motion laws for all mobility degrees of the anthropomorphic robot (anthropomorphic manipulator) through the master device. Copy control is one of the first ways to control robots. This is explained by the coincidence of the kinematic schemes of the Master and the Slave with an accuracy of the scale factor. In this case, the measured values of the generalized coordinates of the Master can be used as Slave control signals. A new stage in the development of copy control systems began with the advent of master devices in the form of exoskeleton. These devices have mobility, as well as prospects for the implementation of force-moment sensing. The decisive factor when using exoskeleton is the convenience and freedom of movement, which determines their adjustment to the anthropometric parameters of a person and the difference between the Master kinematic scheme and the Slave kinematic scheme. The development of methods for calculating the rotation angles of Copyright c 2019 by the paper’s authors. Copying permitted for private and academic purposes. In: Jože Rugelj, Maria Lapina (eds.): Proceedings of SLET 2019 – International Scientific Conference Innovative Approaches to the Application of Digital Technologies in Education and Research, Stavropol – Dombay, Russia, 20-23 May 2019, published at http://ceur-ws.org 1 the operator’s hand based on the rotation angles of the driver [Tebueva2018, Teb2018, Pet2018] allows the capture of the operator’s hands movements directly. The developed exoskeleton complexes [Kutlubaev2016, Kut2016] for control of anthropomorphic manip- ulators (AM) in the majority represent the lever mechanism consisting of three rigid links (shoulder, elbow, hand) and the gripper identical to a hand of the person. In working condition, the exoskeleton is put on the operator, while the lever system is located parallel to the human hand. Registration of the rotation angles of the exoskeleton is carried out with the help of built-in encoders, the information from which is transmitted to the actuator or simulation program. At the same time, the centers of the end of the links and the rotation angles of the exoskeleton and the operator’s hands do not coincide, since they are in different positions in space. Differ- ent anthropometric parameters between the human hand and the manipulator create errors in the formation of control laws that affect on the accuracy of the target operations of the actuator. The existing approach to the control of anthropomorphic manipulator [Tebueva2018, Teb2018, Pet2018]] using a copy-type master device involves the use of generalized coordinates of the operator’s hand as control signals, rather than the master device. The scheme of the generalized coordinates calculation of the operator’s hand is shown in figure 1. Figure 1: Scheme of generalized coordinates calculation of the operator’s hand The most complex computational problem is the calculation of generalized coordinates of the operator’s hand on the basis of data on the position of the operator’s hand joints, for which the methods of solving direct and inverse problems of kinematics are used [Tebueva2018, Teb2018]. The solution of the direct kinematics problem is necessary to convert the information about the position of the manipulator from its own coordinate system to the working (absolute) coordinate system to determine the coordinates of the links of the manipulator. The solution of the inverse kinematics problem is designed to calculate the spatial configuration of the manipulator by the position of its links [Tebueva2018, Teb2018]. This solution requires a description of the overall characteristics of the manipulator in a form convenient for their analysis and recording the equations of coordinate transformation. Of the existing approaches to the description of the dimensional characteristics of the manipulator, the main ones are their expression in the form of a system of linear or matrix equations [Jaz2007]. The basis for solving the problems of kinematics is the choice of parameters that uniquely determine the orientation of a solid in space. For this purpose, there are a number of kinematic parameters: guiding cosines and Euler angles [Tebueva2018, Teb2018, Per2019, Mar2014], Rodrigue-Hamilton parameters (quaternions) [Rad2012, Isa2018, Gou2012, Gor2016], Cayley-Klein parameters [Oni2006, Jaz2007] and the Denavit- Hartenberg representation [Sic2009]. The possibility of using a geometric approach to solving the inverse problem of kinematics [Sha2018] and the high prevalence of using the Denavit-Hartenberg apparatus provides advantages when it is used in describing the kinematics of the master device and calculating the generalized coordinates of the operator’s hand. When calculating the rotation angles of the operator’s hand, the task of determining the coordinates of the elbow joint of the operator’s hand arises, since there is an infinite number of positions of this joint. The solution of this problem is proposed in the work [Pet2018]. Another important factor is the difference between the lengths of the manipulator links from the lengths of the operator’s arm parts, as well as the different ”shoulder width” of the operator and the anthropomorphic robot. This leads to various kinds of problems in the transmission 2 of the rotation angles of the operator’s hand as the rotation angles of the Slave. For example, even with the coincidence of the links lengths, with a different distance between the shoulders, a situation is possible when two Masters joined their palms, but Slaves did not. In this case, the connection of the palms of the two Slaves becomes impossible. Creating anthropomorphic manipulators with adjustable length links is possible, but it is a complex task. A simpler task is to map the configuration space of the Master to the configuration space of the Slave. This article proposes a method that solves this problem. 2 Proposed method 2.1 System description As an operator’s hand model, we will consider an anthropomorphic manipulator. In this case, the hand of the operator can be considered as a virtual master manipulator. Since the Master and Slave are anthropomorphic manipulators, one formalism can be used to describe them. Further we will designate the values relating to the Master, without a stroke, and relating to the slave - with a stroke. The kinematic scheme of the Master is shown in Figure 2. Figure 2: Kinematic scheme of anthropomorphic manipulator To describe the parameters of the kinematic scheme, we use the Denavit-Hartenberg representation. In accordance with the Denavit-Hartenberg representation, each i-th link is described by a set of four parameters: a, d, α, θ, one of which characterizes the movement of the manipulator in the i-th joint and is the generalized coordinate of the manipulator. A system of seven links is respectively described by parameter vectors.a, d, α, θ. Since all kinematic pairs of a manipulator are rotational, the vector of generalized coordinates that uniquely describes the position of the manipulator is θ. In accordance with the Denavit-Hartenberg representation, each link of the manipulator is associated with the associated coordinate system according to a certain rule. The direction and location of the associated coordinate systems of the manipulator under consideration is shown in Figure 3. The matrix of homogeneous transformation from the i-th coordinate system to the j-th can be found by the formulas [Yan2016]: Yj i i−1 T j= Ai , i 0, T0 = T x.a (−90◦ ) T z,θ (−90◦ ) . Solution of the direct kinematics problem, i.e. determining the position of points Oi in the Cartesian coordinate system for a given value of θ has the form:   0  0  Oi = Ti   0 ,  1 Oi – is the beginning of the i-th coordinate system. 4 The left upper submatrix Ri of size 3x3 of the matrix Ti describes the rotation of the i-th coordinate system relative to the global coordinate system. This rotation can also be described using Euler angles. Euler angles αi , βi , γi can be calculated by the rotation matrix Ri as follows:   nx sx ax px  ny sy ay py  Ri ≡   nz sz az , pz  0 0 0 1 αi = AT AN 2 (ax , −ay ) , βi = AT AN 2 (−cos (αi ) sx − sin (αi ) sy , cos (αi ) nx + sin (αi ) ny ) , γi = AT AN 2 (sin (αi ) ax − cos (αi ) ay , az ) , Ri – is the rotation matrix of the i-th coordinate system relative to the global coordinate system; ni ,si ,ai ,pi –Ri matrix elements; AT AN 2 – arctangent function, taking into account the angle’s quadrant. All expressions in this subsection are also valid for Slave. 2.2 Problem statement The inputs to the developed method are: • invariant Master parameters of Denavit-Hartenberg a, d, α; • distances m between Master shoulder joints; • rotation angles θ of the Master device; 0 0 0 • invariant Slave parameters of Denavit-Hartenberg a , d , α ; 0 • distances m between Slave shoulder joints; 0 The output of the method is the angles of rotation θ of the Slave. In this case, the following requirements for copying control should be met: • the movements similarity of the Master and Slave; • the coincidence of the characteristic positions of the Master and Slave; • maximization of the Slave working space involved; • avoid self-collision of the Slave manipulator links. 2.3 Proposed solution Consider the radius vector re , connecting the origin and center of the manipulator effector. |re | reaches the maximum value of rm with full straightening of the manipulator (Figure 3), zero - with the coincidence of the effector position with the origin, and intermediate in all other cases. We introduce the value of kr – the coefficient of directness of the manipulator: |re | kr = . rm 0 To maximize the involved working area of the operating space, it is necessary for kr and kr reach their maximum and minimum values simultaneously. Otherwise, this means that a bent executive arm will correspond to a fully extended master manipulator and vice versa. In the first case, it will be impossible to rectify the executive manipulator. In the second case, further straightening of the master manipulator will not have any 5 effect on the executive. To solve this problem, it is proposed to observe the following relationship in the process of copying control: 0 kr = kr . 0 Then re can be found by the formula: 0 0 |re | re = rm . rm 0 In addition to the module re it is also necessary to know its direction in order to determine the position of 0 the effector of the actuator arm. To describe the vector re it is convenient to use a spherical coordinate system 0 that uses its module re , azimuth angle αa and zenith angle βa to define the end of the radius vector (Figure 4). At first glance it may seem that the following equations can be used for copy control: 0 kr = kr , 0 αa = αa , 0 βa = β a , 0 however, this approach has some problems. Figure 5 shows a top view of an anthropomorphic robot. When re 0 hits in area 1, it is indeed possible to assume that αa = αa . The problem is connected with the connection of the “palms” of two robot manipulators in the sagittal plane. In general, the operator’s shoulder width and the robot’s “shoulder width” are different. If the distance between the shoulders of the robot is greater than the 0 distance between the shoulders of the operator, then when αa = αa the robot will not be able to connect the palms as an operator (Figure 5). If the distance between the shoulders of the robot is less than that between the shoulders of the operator, the robot will bring the palms together before the person connects them, which will lead to poor control. Figure 4: Radius-vector of the center of the operator’s hand: 1 – the maximum extended arm of the operator; 2 – the bent arm of the operator To solve this problem, it is proposed to use the following relationships: αa , if αa < π2 ,  0 αa = c3 αa + c2 αa2 + c1 αa + c0 , if αa ≥ π2 , 3 0 β a = βa , 6 Figure 5: Radius vector of the Slave effector in a spherical coordinate system ci – empirically determined coefficients of the polynomial based on ergonomic estimates. 0 The above relations completely define re but do not allow to find the vector of the generalized coordinates of 0 the executive manipulator θ . The first four degrees of mobility AM, counting from the base, are designed to move the gripper, while the other three ensure its orientation in space. The orientation of the gripper in space is determined by the triple Euler angles; we denote them as αh , βh , γh . For comfortable manipulation of objects using a copy control, the following relationships must be observed: 0 αh = αh , 0 βh = βh , 0 γh = γh . Figure 6: Radius vector of the Slave effector in a spherical coordinate system 7 0 In this case, according to the well-known position of the center of the gripper re and its orientation in space 0 0 0 0 given by the three Euler angles αh , βh , γh , the radius vector O6 of the wrist joint of the executive manipulator can be found by the formula:   a7  0 0 0 0  0 R(αh , βh , γh ) re   0 ,  O6 = 0 0 0 1  0  1 the first matrix is a homogeneous transformation matrix from the coordinate system associated with the seventh link; 0 the second matrix describes the coordinates of the wrist joint O6 in the seventh coordinate system; a7 – is the Denavit-Hartenberg parameter of the 7th link. Due to the kinematic redundancy of the anthropomorphic manipulator (Figure 6), to solve the inverse problem 0 of kinematics and calculate the desired vector θ , there is not enough knowledge of the Cartesian coordinates of 0 0 0 the re effector and the wrist joint O6 of the Slave. The Cartesian coordinates O3 of the Slave elbow joint are 0 also required. The kinematic redundancy of AM lies in the fact that the given position O6 of the wrist joint 0 corresponds in general to an infinite set of possible positions O3 of the elbow joint. It is proposed to choose one of the possible positions on the basis of the Slave’s human-like requirement. 0 To enhance human-like, let the orientation in space of the plane formed by the Slave shoulder joint O1 , the 0 0 ulnar joint O3 and the wrist joint O6 coincides with the similar plane formed by the joints of the Master As a coordinate system associated with this plane, a coordinate system associated with the elbow joint can be taken. In this case, we can assume that: 0 R3 =R3 . 0 The position of the elbow joint O3 can be found from the matrix equation:   −a3  0  0 R3 O3  0  O1 =  , 0 0 0 1  0  1  −1 −a3  0  R3 O3 0  0  = O1   . 0 0 0 1  0  1 Based on the expressions obtained, the rotation angles of the Slave can be calculated using the method given in [Pet2018]. Figure 7: Radius vector of the Slave effector in a spherical coordinate system 8 3 Results To test the effectiveness of the proposed method, a numerical simulation of the process of copying control and mapping the Master configuration space to the Slave configuration space was performed. An example of the correspondence between the position of the Master and the Slave is shown in Figure 7. Figure 7a shows the position of the Master and the Slave in a single coordinate system, and in Figure 7b in two coordinate systems scaled for clarity and superimposed on each other. As can be seen from the simulation results, when applying the proposed method, there is a clear similarity between the position of the Master and the Slave. a) b) Figure 8: Numerical simulation results: a – same scale; b – relative scale 4 Discussion The proposed method of mapping the configuration space of the Master configuration space to the Slave con- figuration space allows copy control to be performed even with significant differences in the lengths of the links of the Master and the Slave. This feature allows to effectively use promising exoskeleton Master devices. The proposed method is based on the requirements of safety and human-like movements, maximizing the use of the AM workspace. It is planned to introduce the proposed method into existing copy management systems. 5 Acnowlegments The research was carried out within the framework of the implementation of a research project on the development of a software and hardware control system based on solving the inverse problem of dynamics and kinematics within the framework of FCNIR 2014-2020 (unique identifier RFMEFI57517X0166) with the financial support of the Ministry of Science and Higher Education of the Russian Federation. 9