Informatica 28 (2004) 315-321 315 A System for Evaluation of Human Upper Extremity Nives Klopcar and Jadran Lenarčič Jožef Stefan Institute, Jamova 39, 1000 Ljubljana, Slovenia nives.klopcar@ijs.si, jadran.lenarcic@ijs.si, http://www2.ijs.si/~nklopcar/ Keywords: human arm evaluation, reachable workspace, shoulder ranges of motion, rehabilitation Received: February 13, 2004 A standard method to determine the shoulder range of motion in physiotherapy is to measure the declination angles in predefined planes in the glenohumeral joint. These angles can hardly be understood and visualized and they do not directly interpret the functionality of the arm. In this article, we report a computer program which computes the human arm reachable workspace based on a simplifed kinematic model. The program uses as input data the values of the measured declination angles in combination with the proportions of the measured limb. It thus enables to obtain a graphic interpretation of the arm's reachability, quantifes the workspace volume and represents a platform to objectively validate the functionality of the arm. The obtained numerical and graphical results can be used for visualization, computer-aided documentation, comparison between different phases of a rehabilitation process, comparison between different subjects, and can also serve for a deeper mathematical and biomechanical analysis. Povzetek: clanek opisuje sistem za izracun dosegljivega delovnega prostora cloveske roke. 1 Introduction Objective measurements, mathematical processing of the measured data, and effective interpretations and visualizations are of crucial importance in advanced rehabilitation engineering. Many contributions with the purpose to develop new techniques of data capturing, development of new therapeutical approaches and new rehabilitation devices were reported in the literature in the area of human gait. On the contrary, there is a lack of investigations aimed to evaluate the functionality of the human upper extremity. This is primarily because the human gait can be seen as a relatively simple planar motion, while the motion of the human upper extremity is spatial and extremely difficult to evaluate and interpret. The purpose of this investigation is to develop a computer program which computes, visualizes, and quanti-fes the human arm reachable workspace (AWS). The human arm reachable workspace is referred to as the volume within which all points can be reached by the chosen reference point on the wrist, namely the center point between process styloideus ulnae and process styloideus radii [1]. The AWS program is in the process of being introduced as part of a regular measurement and evaluation process of the upper extremity of (in particular hemiplegic) patients in the Institute for Rehabilitation, Ljubljana, Slovenia. The input data to the AWS program are the arm proportions and the ranges of motion in the joints of the shoulder and of the elbow complexes as measured by the physiotherapist. At the current stage, the measurement technique in the rehabilitation center is entirely manual and only standardized selective motions are measured. The main diff- culty, however, is related to the effectiveness of the computation of the workspace from the measured data since this is an extremely time-consuming numerical procedure. To make it useful and implementable on a personal computer, a very concise kinematical model of the human upper extremity must be used in the program. In this investigation, the human arm motion is seen as a combination of the shoulder and the elbow motion. The shoulder motion is composed of elementary motions in the gleno-humeral, scapulothoracic, sternoclavicular, and acromio-clavicular joint [2, 3, 4, 5]. In order to obtain the reachable workspace effectively, all these motions are modelled as a single spherical joint possessing three perpendicular rotation axes intersecting in the center of the human gleno-humeral joint. The elbow joint is understood as a uniaxial joint connecting the ulna with the humerus and the radius with the humerus. These two joints allow the elbow flexion and extension [6] and are modelled as a single rotation. The radioulnar joint, which allows the supination and pronation of the forearm, is not included in the model since it does not influence the spatial position of the wrist. The workspace is computed as a number of points in space and is then graphically converted into a three-dimensional body by the use of a proper computer graphics module. A physiotherapist can utilize the AWS program to compute and visualize the workspace of the injured arm and compare it with an ideal healthy arm. It is possible to numerically quantify the workspace in terms of its volume, compactness and other mathematical criteria representing the arm functionality. The frst section of this article presents the basic kinematic properties of the human upper extremity and de- 316 Informatica 28 (2004) 315-321 J. Lenarcic et al. velops a simplified kinematical model. In the following section we discuss the computation of the reachable workspace and its numerical evaluation. In the last section, an example of the treatment of a hemiplegic patient is reported. 2 Simplified kinematics The movements of the arm are measured relatively to the arm's reference pose, which is when the upper arm is fully extended downward by the side of the body and the forearm flexed for 90° (placed forward in a horizontal direction) so that the palm of the hand is turned towards the body. The principal shoulder movements are shown in Figure 1. The shoulder elevation through flexion and retroflexion are measured in the sagittal plane around the coronal axis, the elevation through abduction and adduction is measured in the frontal plane around an anterior-posterior axis. The internal and external rotations are measured in the horizontal plane around a vertical axis [7, 8, 9]. The principal elbow movement is the flexion-extension which is measured in the sagittal plane. Ac Gh El R (b) Figure 2: The shoulder complex joints Sc, Ac, St, Gh, the elbow El, and the wrist Wr (a) kinematical model (b). 180° 180° 90o Figure 1: The shoulder complex movements: The elevation through flexion - retroflexion (a), the elevation through abduction - adduction (b) and the internal - external rotation (c). Figure 2 presents a kinematical model of the arm that replicates the motion characteristics of each single joint included in the arm [5, 6, 10]. Here, U denotes the universal joint that contains two perpendicular rotations, S is the spherical joint that contains three perpendicular rotations, joint T is a translation and joint R a rotation. In the shoulder girdle, the sternoclavicular joint Sc is modelled as an universal joint, the acromioclavicular joint Ac as a spherical joint, and the scapulathoracic joint St as two translations and one rotation. The rest of the shoulder motion is concentrated in the glenohumeral joint Gh which is spherical. The sum of the degrees of freedom in the shoulder girdle is f = 8. The number of movable segments is N = 4 and the number of joints is n = 5. In accordance to the Grubler's formula only F = A(N - n)+ f = 6(4 - 5) + 8 = 2 degrees of freedom are independent (A = 6 is used since the girdle's motion is spatial). One can see that these two independent degrees of freedom are rotations, meaning that the primary function of the girdle is to point the gleno-humeral joint in space. The same motion can be obtained by using only an universal joint U as shown in Figure 3a. If there is a need to also replicate the changing of the size of the girdle, we have to additionally include a dependent translation T which depends on the rotations in the girdle's U joint [11]. In a similar way, we can analyze the kinematical structure of the elbow joint and of the wrist. The ulna is attached to the humerus by a rotational joint R and the radius by a spherical joint S. On the other end, the bones of ulna and radius are attached to the hand by two spherical joints S (Figure 2b). The presented forearm mechanism contains N = 3 movable links (the hand is considered as a single rigid link) and n = 4 joints. The sum of degrees of freedom in these four joints is f=10. The Grubler's formula gives F = A(N - n) + f = 6(3 - 4) + 10 = 4 independent degrees of freedom. They can be replaced by two independent U joints and, eventually, a dependent translation T that models the changing in distance of the forearm (Figure 3a). However, the position of the wrist depends only on the elbow flexion-extension, so that only one degree of freedom (rotation) is needed to model the elbow complex when computing the reachable workspace (Figure 3b). Other three are, therefore, neglected. A PROGRAM FOR EVALUATION OF. Informatica 28 (2004) 315-321 317 9ed9p S 9a '9r K|T U x / /A y y / / / / / / / ds 9f\ fc9R d„ R W (b) the shoulder girdle segment dSG representing the clavicula and scapula, the upper arm segment dH representing the humerus, and the forearm segment dF representing the radius and ulna. We fixed the origin of the reference coordinate inside the body in the region of sterna (Figure 3b). In the reference pose of the arm, when all joint angles are zero, the shoulder segment is parallel to x (medial direction), the upper arm segment to z (vertical direction) and the forearm segment to y (anterior direction). Thus, the segment vectors for the left arm are rso = (-dsG, 0, 0)n rn = (0,0, -dH)T rF = (0,dF, 0)T. (1) (2) (3) There are three rotations in the glenohumeral joint. The elevation through flexion-extension is expressed as a rotation about axis x. The rotation matrix is Figure 3: A functional kinematical model (a) and a simplified kinematical model (b) of the arm. By comparing the joint arrangements in (Figure 3a) with the functional movements of the human arm, it is possible to observe that the first two rotations ^ed and ^>pr represent the elevation-depression and the protraction-retraction of the shoulder girdle with the center in the sternoclavicular joint Sc. Angles ya, and represent the humeral abduction-adduction, flexion-retroflexion and internal-external rotations with the rotation center in the glenohumeral joint Gh. In order to compute the arm workspace effectively, the movements in the shoulder complex can additionally be simplified by producing the sum of movements in the girdle and in the glenohumeral joints. Thus, the arm elevation through abduction yA, elevation through flexion and rotation are combined by motions in the shoulder girdle and in the glenohumeral joint. For the sake of simplicity it is also assumed that the rotation center is fixed in glenohumeral joint. The final model is seen in Figure 3b. The complex anatomical properties of the arm do not directly correspond to the presented arrangement of simple rotations about fixed axes [1, 12, 13, 14]. In such a model, therefore, one has to include the interdependencies between the joint coordinates. The lower and the upper limits of joint angles depend on the values of other joint angles. Also the length of the shoulder segment, of the upper arm and of the forearm are dependent on the motions in the simplified joints. Based on the measurements of a number of healthy subjects the correlations between joint coordinates were identified in the past [1]. The simplified model, as presented in Figure 3b, is a very rough approximation of the human arm kinematics. It primarily represents the spatial motion of the reference point W on the wrist. The model includes three rigid segments, Rf 1 0 0 cos 0 sin 0 — sin cos ^f (4) The elevation through abduction-adduction is a rotation about axis y and the rotation matrix is R ■A = cos ^a 0 sin ^a 0 1 0 sin ^a 0 cos ^A (5) The internal external rotation is modelled as a rotation about axis z and the corresponding rotation matrix is as follows Rr cos ^r — sin ^r 0 sin cos 0 0 0 1 (6) It is assumed in this model that the limits of angle are constant and independent of other coordinates so that its range is as follows ¥>A = [^Am, ^AM L (7) where ^Am and ^am are measured in the reference pose of the arm. The limits of the elevation through flexion-extension are linear functions of the elevation through abduction-adduction angle [1]. The range of this coordinate varies as follows ^F = [^Fm + ^A/3,^FM — ¥>a/6], (8) where ^>Fm and ^>FM are measured in the reference pose of the arm. The limits of the internal and external rotation have a quadratic relationship with the elevation through abduction-adduction and flexion-extension angle [1]. Its range varies within the following values ^R = [^Rm + 7^a/9 — ^f/9 + 2cfA ^f/810, ^rm + 4^a/9 — 5^f/9 + 5^a^f/810], (9) 0 316 Informatica 28 (2004) 315-321 J. Lenarcic et al. where and ^rm are measured in the reference pose of the arm. In Equations 8,9 the angles are expressed in degrees. The elbow flexion-extension rotation is calculated as a rotation about axis x and the corresponding rotation matrix is "10 0 Ref = 0 cos ^ef — sin <^>EF • (10) 0 sin ^EF cos ^EF It is assumed that the limits of this angle are constant and independent on other coordinates so that its range is as follows ^EF = [^EFmi ^efmL (11) Here, ^EFm = —90° and ^EFM = 60° are fixed as for the healthy elbow [1, 7, 8]. The position of the reference point W is calculated by rw = rso + Rr • Ra • Rf • Th + Ref • ^ (12) 3 Workspace computation The input data to the AWS program are the joint limits measured in the reference pose of the arm, which are ^>Am, ^Fm, ^Rm, ^EFm, ^am, ^fm, ^rm, and ^efm. These parameters vary considerably among individuals as affected by age, sex, injuries, and stage of the illness [7]. Relatively to the hight of the subject H, the segments of the arm are normalized in accordance to the anthropometric table [15]. The length of the shoulder girdle length is then dsa = 0,129 • H, of the humerus is dH = 0,185 • H, and of the forearm dF = 0,146 • H. The procedure to determine the workspace has few stages. The first stage is to compute the set of points which can be reached by the wrist. This computation involves four nested loops, each associated with one joint angle. In every iteration, position rw (Equation 12) is computed and stored as a three dimensional vector. The procedure is repeated until all ranges of joint angles are swept [1]. In addition, the collisions between the segments of the arm (humerus and forearm) and the body (head, neck and trunk) have to be taken into account. If during the computation an arm segment intersects the body, the related position of the wrist is eliminated as impossible and is not considered as part of the workspace. An elliptical cylinder to approximate the body whose size is 0,174 • H in the frontal plane and 0,089 • H in the sagittal plane is used. The head is approximated by a sphere whose radius is 0,065 • H [15]. The resolution is set to 5° for all joint angles. It corresponds to the measurement error in the input data. Since the ranges of coordinates change from one subject to another and throughout the workspace, it is impossible to exactly predict the number of iterations. Usually, tens of thousands of iterations are needed to determine the whole set of points approximating the reachable workspace. The obtained set of points lies inside a cube of edge L = 2(dH + dF) whose center is in the center of the shoulder joint. This cube is seen as a volume of n3 smaller cubes with edge L/n, where n is a desired resolution, which is limited by L/n> (dH + dF) tan5°^ (13) The cubes that do not contain at least one point rw are eliminated. As a result, the workspace of the arm is described by a set of cubes of edge L/n. In order to increase the accuracy, the cubes forming the surface of the workspace are broken into smaller ones with edge of half length. In every step i the workspace volume is computed by V1 V i Vl+£, (14) where Vs is the volume of cubes on the surface, and V the volume of all other (inner) cubes. The procedure is ended when |Vi — V i-1| V i-1 (15) is smaller than a prescribed value v. The last stage in determining the arm workspace is to smoothing the surface cubes. For this purpose a Bezier interpolation [16] is performed. The workspace can thus be visualized with different color textures, illuminated with different positions of light, or made transparent. A comparison between the calculated and the measured reachable workspace of the healthy left arm is shown in Figure 4. The workspace in Figure 4a was measured in equidistant planes in [1]. Such a measurement is extremely complicated and time consuming. It can only be performed on healthy subjects. On the contrary, the calculated workspace (Figure 4b) can be obtained based on very simple manual measurements which are part of a standard procedure in treating hemiplegic patients in the rehabilitation center. The similarity between the measured and the calculated workspace is quite evident. Figure 4: A comparison between the measured (a) and the calculated (b) reachable workspace. 4 Example An example of a treatment of a hemiplegic patient is presented in Figure 5. The figure shows the reachable workspace of the left handicapped arm before the treatment A PROGRAM FOR EVALUATION OF.. Informatica 28 (2004) 315-321 319 (WL1) and two different phases during the treatment (WL2 and WL3). Workspace WR0 is associated with the healthy right arm inverted to the left hand side for comparison. The measured ranges of motion are collected in Table 1. Table 2: The computed workspace volume for H = 18,00 dm volume ±v WLi 190, 4 dm3 Wl2 401, 4 dm3 Wl3 364, 3 dm3 Wro 598, 2 dm3 tive to the body is an important issue. A reachable space in front of the body could in general be more useful. The AWS program is written in Matlab and converted into an autonomic form. It is designed to be used at the Institute for Rehabilitation as a standard tool for the examination of the shoulder complex. The input data form contains an identical information as the paper form used in the past. The workspace block is added (Figure 6). Figure 5: A comparison of the reachable workspace of the left handicapped arm with the reachable workspace of the right healthy arm of a hemiplegic patient. The measured ranges of motion of the handicapped left shoulder before and during the treatment, as well of the healthy right shoulder, are reported in Table 1. The elbow flexion-extension angles are taken as for the healthy arm and are ^EFm = -90° and ^>EFM = 60°. Table 1: The measured shoulder ranges ^Fm ^FM ^Am ^AM ^Rm ^RM Wli -45° 65° -10° 80° -55° 25° Wl2 -55° 140° -10° 95° -60° 40° WL3 -80° 120° -10° 95° -45° 50° Wro -60° 170° -10° 170° -60° 90° Table 2 shows the computed volume of the reachable workspace of the handicapped left arm and of the healthy right arm. The workspace was computed with v < 10% relative error. The hight of the subject is 180,0 cm. Note the workspace volume is not directly associated with functionality of the arm. Other indices in combination with the volume can be used, such as the workspace compactness [17]. The workspace compactness quantifies the similarity of the workspace shape with a sphere. It is assumed that a compact workspace is more adaptable then an elongated one. Also the location of the workspace rela- Figure 6: The input form of the AWS program. The workspace is visualized in a posterior and in an anterior view. It is possible to superimpose the workspace of the handicapped arm onto the one of the healthy arm by using a transparent envelope (Figure 7). Thus, the workspaces can be directly compared during different phases of the rehabilitation process. The results can easily be documented and stored in a computer or printed. They can be displayed and numerically processed, as well J. Lenarcic et al. 320 Informatica 28 (2004) 315-321 as electronically transferred to another user. Figure 7: A direct comparison of the workspace of the handicapped arm (WL1) with the one of the healthy arm (WR0) by superimposing the two workspaces. 5 Conclusion A computer program which computes the human arm reachable workspace is reported in this article. The program is based on a simplified kinematic model of the human upper extremity in which the shoulder complex is approximated by a spherical joint and the elbow complex by a rotation. The input data to this program are taken from a standard evaluation procedure in physiotherapy. The reachable workspace can be quantified by its volume or other mathematical indices. The main advantage of this program is that it can visualize the reachability of the measured human arm. The obtained results can be used for computer-aided documentation, numerical or visual comparison between different phases of a rehabilitation process, and numerical or visual comparison between different subjects. This helps us to plan and control the rehabilitation procedure of shoulder patients. The program is now being introduced in the Institute for Rehabilitation, Ljubljana, Slovenia. Acknowledgement This investigation was supported by the Slovenian Ministry of Education, Science and Sport. We are grateful to the employees of the Institute for Rehabilitation, Ljubljana, Slovenia, for their valuable contribution. References [1] J. Lenarcic, A. Umek (1994) Simple model of human arm reachable workspace, IEEE Trans. System, Man and Cybernetics, Vol. 24, pp. 1239-1246. [2] V. M. Zatsiorsky (1998) Kinematics of human motion, Human Kinematics. [3] A. E. Engin and S. T. Tumer (1989) Three-dimensional kinematic modeling of the human shoulder complex - part I: Physical model and determination of joint sinus cones, Trans. of the ASMEJour. of Biomech. Eng, Vol. 111, pp. 107-112. [4] J. E. Wood, S. G. Meek and S. C. Jacobsen (1989) Quantitation of human shoulder anatomy for prosthetic arm control - II. Anatomy Matrices, Jour. of Biomech, Vol. 22, No. 4, pp. 309-325. [5] Z. Dvir and N. Berme (1987) The shoulder complex in elevation on the arm: a mechanism approach, Jour. of Biomech., Vol. 11, pp. 219-225. [6] J. Lenarcic and M. Stanisic (2003) A humanoid shoulder complex and the humeral pointing kinematics, IEEE Trans. on Robotics and Automat., Vol. 19, No. 3, pp. 499-506. [7] C. C. Norkin and D. J. White (1985) Measurement of joint motion: A guide to gonimetry, F. A. Davis Company Philadelphia. [8] I. A. Kapadanji (1970) Physiology of the Joints, Churchill Livingstone, London. [9] D. J. Magee (1997) Orthopaedic Physical Assessment, W. B. Saunders Company, 3rd ed. [10] J. Hesselbach, M. B. Helm, H. Kerle, M. Frindt and A. M. Weinberg (1998) Advances in Robot Kinematics: Analysis and Control, Kluwer Academic Publishers, pp. 551-560. [11] J. Lenarcic, M. M. Stanisic. V. Parrenti-Castelli (2000) Kinematic design of a humanoid robotic shoulder complex, Proc. Int. Conf. On Robotics and Automat., San Francisco, USA. [12] V. T. Inman, J. B. Saunders, L. C. Abbott (1944) Observation on the function of the shoulder joint, Jour. of Bone and Joint Surgery, Vol. 26, pp. 1-30. A PROGRAM FOR EVALUATION OF.. Informatica 28 (2004) 315-321 319 [13] C. Hogfors, B. Peterson, G. Sigholm and P. Herberts, (1991) Biomechanical model of the human shoulder joint - II. The shoulder rhythm, Jour. of Biomech., Vol. 24, No. 8, pp. 699-709. [14] S. D. Bagg and W. J. Forrest, (1980) A Biomechanical analysis of scapular rotation during arm abduction in scapular plane, American Jour. ofPhy. Med. Rehabilitation, Vol. 67, No. 6, pp. 238-245, 1980. [15] D. A. Winter (1990) Bimechanics and motor control of human movement, Wiley-Interscience Publication, University of Waterloo. [16] F. Gerald (1990) Curves and surfaces for computer aided geometric design, Academic Press Inc. - Har-court Brace Jovanovich Publisher. [17] J. Lenarcic (1992) An approach to optimum design of robot manipulators, Laboratory Robotics and Automation, Vol. 4, pp. 137-143.