The Matrix and Quaternions FAQ
==============================

Version 1.4  26th December 1998
-------------------------------

This FAQ is maintained by "hexapod@netcom.com". Any additional suggestions
or related questions are welcome. Just send E-mail to the above address.

The latest copy of this FAQ can be found at the following web pages:

  ftp://ftp.netcom.com/pub/he/hexapod/index.html
  http://www.glue.umd.edu/~rsrodger

Feel free to distribute or copy this FAQ as you please.

Contributions
-------------

  Introduction I1: steve@mred.bgm.link.com


Introduction
------------

I1.  Important note relating to OpenGL and this document


Questions
---------


BASICS
======

Q1.  What is a matrix?
Q2.  What is the order of a matrix?
Q3.  How do I represent a matrix using the C/C++ programming languages?
Q4.  What are the advantages of using matrices?
Q5.  How do matrices relate to coordinate systems?


ARITHMETIC
==========

Q6.  What is the identity matrix?
Q7.  What is the major diagonal matrix of a matrix?
Q8.  What is the transpose of a matrix?
Q9.  How do I add two matrices together?
Q10. How do I subtract two matrices?
Q11. How do I multiply two matrices together?
Q12. How do I square or raise a matrix to a power?
Q13. How do I multiply one or more vectors by a matrix?


DETERMINANTS AND INVERSES
=========================

Q14. What is the determinant of a matrix?
Q15. How do I calculate the determinant of a matrix?
Q16. What are Isotropic and Anisotropic matrices?
Q17. What is the inverse of a matrix?
Q18. How do I calculate the inverse of an arbitary matrix?
Q19. How do I calculate the inverse of an identity matrix?
Q20. How do I calculate the inverse of a rotation matrix?
Q21. How do I calculate the inverse of a matrix using Kramer's rule?
Q22. How do I calculate the inverse of a 2x2 matrix?
Q23. How do I calculate the inverse of a 3x3 matrix?
Q24. How do I calculate the inverse of a 4x4 matrix?
Q25. How do I calculate the inverse of a matrix using linear equations?


TRANSFORMS
==========

Q26. What is a rotation matrix?
Q27. How do rotation matrices relate to coordinate systems?
Q28. How do I generate a rotation matrix in the X-axis?
Q29. How do I generate a rotation matrix in the Y-axis?
Q30. How do I generate a rotation matrix in the Z-axis?
Q31. What are Euler angles?
Q32. What are yaw, roll and pitch?
Q33. How do I combine rotation matrices?
Q34. What is Gimbal Lock?
Q35. What is the correct way to combine rotation matrices?
Q36. How do I generate a rotation matrix from Euler angles?
Q37. How do I generate Euler angles from a rotation matrix?
Q38. How do I generate a rotation matrix for a selected axis and angle?
Q39. How do I generate a rotation matrix to map one vector onto another?
Q40.  How do I use matrices to convert between two coordinate systems?
Q41. What is a translation matrix?
Q42. What is a scaling matrix?
Q43. What is a shearing matrix?
Q44. How do I perform linear interpolation between two matrices?
Q45. How do I perform cubic interpolation between four matrices?
Q46. How can I render a matrix?


QUATERNIONS
===========

Q47.  What are quaternions?
Q48.  How do quaternions relate to 3D animation?
Q49.  How do I calculate the conjugate of a quaternion?
Q50.  How do I calculate the inverse of a quaternion?
Q51.  How do I calculate the magnitude of a quaternion?
Q52.  How do I normalise a quaternion?
Q53.  How do I multiply two quaternions together?
Q54.  How do I convert a quaternion to a rotation matrix?
Q55.  How do I convert a rotation matrix to a quaternion?
Q56.  How do I convert a rotation axis and angle to a quaternion?
Q57.  How do I convert a quaternion to a rotation axis and angle?
Q58.  How do I convert spherical rotation angles to a quaternion?
Q59.  How do I convert a quaternion to spherical rotation angles?
Q60.  How do I convert Euler rotation angles to a quaternion?
Q61.  How do I use quaternions to perform linear interpolation between matrices?
Q62.  How do I use quaternions to perform cubic interpolation between matrices?


Introduction
------------ 

I1. Important note relating to OpenGl and this document
-------------------------------------------------------

  In this document (as in most math textbooks), all matrices are drawn
  in the standard mathematical manner.  Unfortunately graphics libraries
  like IrisGL, OpenGL and SGI's Performer all represent them with the
  rows and columns swapped.

  Hence, in this document you will see (for example) a 4x4 Translation
  matrix represented as follows:

          | 1  0  0  X |
          |            |
          | 0  1  0  Y |
      M = |            |
          | 0  0  1  Z |
          |            |
          | 0  0  0  1 |

  In Performer (for example) this would be populated as follows:

    M[0][1] = M[0][2] = M[0][3] =
    M[1][0] = M[1][2] = M[1][3] =
    M[2][0] = M[2][1] = M[2][3] = 0 ;
    M[0][0] = M[1][1] = M[2][2] = m[3][3] = 1 ;
    M[3][0] = X ;
    M[3][1] = Y ;
    M[3][2] = Z ;

  ie, the matrix is stored like this:

          | M[0][0]  M[1][0]  M[2][0]  M[3][0] |
          |                                    |
          | M[0][1]  M[1][1]  M[2][1]  M[3][1] |
      M = |                                    |
          | M[0][2]  M[1][2]  M[2][2]  M[3][2] |
          |                                    |
          | M[0][3]  M[1][3]  M[2][3]  M[3][3] |

  OpenGL uses a one-dimensional array to store matrices - but fortunately,
  the packing order results in the same layout of bytes in memory - so
  taking the address of a pfMatrix and casting it to a float* will allow
  you to pass it directly into routines like glLoadMatrixf.

  In the code snippets scattered throughout this document, a one-dimensional
  array is used to store a matrix. The ordering of the array elements is
  transposed with respect to OpenGL.


         This Document                  OpenGL

        | 0  1  2  3  |            | 0  4  8  12 |
        |             |            |             |
        | 4  5  6  7  |            | 1  5  9  13 |
    M = |             |        M = |             |
        | 8  9  10 11 |            | 2  6  10 14 |
        |             |            |             |
        | 12 13 14 15 |            | 3  7  11 15 |


Answers
-------

BASICS
======

Q1.  What is a matrix?
----------------------

  A matrix is a two dimensional array of numeric data, where each
  row or column consists of one or more numeric values.

  Arithmetic operations which can be performed with matrices include
  addition, subtraction, multiplication and division.

  The size of a matrix is defined in terms of the number of rows
  and columns.

  A matrix with M rows and N columns is defined as a MxN matrix.

  Individual elements of the matrix are referenced using two index
  values. Using mathematical notation these are usually assigned the
  variables 'i' and 'j'. The order is row first, column second

  For example, if a matrix M with order 4x4 exists, then the elements
  of the matrix are indexed by the following row:column pairs:

        | 00 10 20 30 |
    M = | 01 11 21 31 |
        | 02 12 22 32 |
        | 03 13 23 33 |

  The element at the top right of the matrix has i=0 and j=3
  This is referenced as follows:

    M    = M
     i,j    0,3

  In computer animation, the most commonly used matrices have either
  2, 3 or 4 rows and columns. These are referred to as 2x2, 3x3 and 4x4
  matrices respectively.

  2x2 matrices are used to perform rotations, shears and other types
  of image processing. General purpose NxN matrices can be used to
  perform image processing functions such as convolution.

  3x3 matrices are used to perform low-budget 3D animation. Operations
  such as rotation and multiplication can be performed using matrix
  operations, but perspective depth projection is performed using
  standard optimised into pure divide operations.

  4x4 matrices are used to perform high-end 3D animation. Operations
  such as multiplication and perspective depth projection can be
  performed using matrix mathematics.


Q2.  What is the "order" of a matrix?
-------------------------------------

  The "order" of a matrix is another name for the size of the matrix.
  A matrix with M rows and N columns is said to have order MxN.


Q3.  How do I represent a matrix using the C/C++ programming languages?
-----------------------------------------------------------------------

  The simplest way of defining a matrix using the C/C++ programming
  languages is to make use of the "typedef" keyword. Both 3x3 and 4x4
  matrices may be defined in this way ie:


    typedef float MATRIX3[9];
    typedef float MATRIX4[16];


  Since each type of matrix has dimensions 3x3 and 4x4, this requires
  9 and 16 data elements respectively.

  At first glance, the use of a single linear array of data values may
  seem counter-intuitive. The use of two dimensional arrays may seem
  more convenient ie.

    typedef float MATRIX3[3][3];
    typedef float MATRIX4[4][4];

  However, the use of two reference systems for each matrix element
  very often leads to confusion. With mathemetics, the order is row
  first (i), column second (j) ie.

     Mij

  Using C/C++, this becomes

     matrix[j][i]


  Using two dimensional arrays also incurs a CPU performance penalty in
  that C compilers will often make use of multiplication operations to
  resolve array index operations.

  So, it is more efficient to stick with linear arrays. However, one issue
  still remains to be resolved. How is an two dimensional matrix mapped
  onto a linear array? Since there are only two methods (row first/column
  second or column first/row column).

  The performance differences between the two are subtle. If all for-next
  loops are unravelled, then there is very little difference in the
  performance for operations such as matrix-matrix multiplication.

  Using the C/C++ programming languages the linear ordering of each
  matrix is as follows:


  mat[0]  = M        mat[3]  = M
             00                 03


  mat[12] = M        mat[15] = M
             30                 33


        |  0  1  2  3 |
        |             |              | 0 1 2 |
        |  4  5  6  7 |              |       |
    M = |             |          M = | 3 4 5 |
        |  8  9 10 11 |              |       |
        |             |              | 6 7 8 |
        | 12 13 14 15 |


Q4.  What are the advantages of using matrices?
-----------------------------------------------

  One of the first questions asked about the use of matrices in computer
  animation is why they should be used at all in the first place.
  Intuitively, it would appear that the overhead of for-next loops and
  matrix multiplication would slow down an application.

  Arguments that resolve these objections can be pointed out. These include
  the use of CPU registers to handle loop counters on-board data caches
  to optimise memory accesses.

  Advantages can also be pointed out. By following a mathematical approach
  to defining 3D algorithms, it is possible to predict and plan the
  design of a 3D animation system. Such mathematical approaches allow
  for the implementation of character animation, spline curves and inverse
  kinematics.

  However, one objection that frequently comes up is that it would be
  quicker to just multiply each pair of coordinates by the rotation
  coefficients for that axis, rather than perform a full vector-matrix
  multiplication.

  ie. Rotation in X transforms Y and Z
      Rotation in Y transforms X and Z
      Rotation in Z transforms X and Y

  The argument to this goes as follows:

  Given a vertex V = (x,y,z), rotation angles (A,B and C) and translation
  (D,E,F). A  the algorithm
  is defined as follows:

    ---------------------------

    sx = sin(A)             // Setup - only done once
    cx = cos(A)
    sy = sin(B)
    cy = cos(B)
    sz = sin(C)
    cz = cos(C)

    x1 =  x * cz +  y * sz  // Rotation of each vertex
    y1 =  y * cz -  x * sz
    z1 =  z

    x2 = x1 * cy + z1 * sy
    y2 = z1
    z2 = z1 * cy - x1 * sy

    x3 = x2
    y3 = y2 * cx + z1 * sx
    z3 = z2 * cx - x1 * sx

    xr = x3 + D             // Translation of each vertex
    yr = y3 + E
    zr = z3 + F

    ---------------------------

  Altogether, this algorithm will use the following amounts of processing
  time:

    Set-up                                 Per-vertex
    -------------------------              ------------------------
    6 trigonometric functions
    6 assignment operations.               12 assignment
                                           12 multiplication
                                            9 addition
    -------------------------              ------------------------

  Assume that the same operations is being performed using matrix
  multiplication.

  With a 4x4 matrix, the procesing time is used as follows:

    Set-up                       Change    Per-vertex               Change
    --------------------------   ------    ------------------------ ------
    6  trigonometric functions    0                                  0
    18 assignment operation      -12        3  assignment           -9
    12 multiplication            +12        9  multiplication       -3
    6  subtraction               +6         6  addition             -3
    --------------------------   ------    ------------------------ ------

  Comparing the two tables, it can be seen that setting up a rotation
  matrix costs at least 12 multiplication calculations and an extra
  18 assignment calls.

  However, while this may seem extravagant, the savings come from
  processing each vertex. Using matrix multiplication, the savings made
  from processing just 4 vertices, will outweigh the additional set-up
  cost.


Q5.  How do matrices relate to coordinate systems?
--------------------------------------------------

  With either 3x3 or 4x4 rotation, translation or shearing matrices, there
  is a simple relationship between each matrix and the resulting coordinate
  system.

  The first three columns of the matrix define the direction vector of the
  X, Y and Z axii respectively.

  If a 4x4 matrix is defined as:

        | A B C D |
    M = | E F G H |
        | I J K L |
        | M N O P |

  Then the direction vector for each axis is as follows:

     X-axis = [ A E I ]

     Y-axis = [ B F J ]

     Z-axis = [ C G K ]


ARITHMETIC
==========


Q6.  What is the identity matrix?
---------------------------------

  The identity matrix is matrix in which has an identical number of rows
  and columns. Also, all the elements in which i=j are set one. All others
  are set to zero. For example a 4x4 identity matrix is as follows:

        | 1 0 0 0 |
    M = | 0 1 0 0 |
        | 0 0 1 0 |
        | 0 0 0 1 |


Q7.  What is the major diagonal of a matrix?
--------------------------------------------

  The major diagonal of a matrix is the set of elements where the
  row number is equal to the column number ie.

    M   where i=j
     ij

  In the case of the identity matrix, only the elements on the major
  diagonal are set to 1, while all others are set to 0.


Q8.  What is the transpose of a matrix?
---------------------------------------

  The transpose of matrix is the matrix generated when every element in
  the matrix is swapped with the opposite relative to the major diagonal

  This can be expressed as the mathematical operation:

    M'   = M
      ij    ji

  However, this can only be performed if a matrix has an equal number
  of rows and columns.

  If the matrix M is defined as:

        |  0.707 -0.866 |
    M = |               |
        |  0.866  0.707 |


  Then the transpose is equal to:

        |  0.707  0.866 |
    T = |               |
        | -0.866  0.707 |

  If the matrix is a rotation matrix, then the transpose is guaranteed
  to be the inverse of the matrix.


Q9.  How do I add two matrices together?
----------------------------------------

  The rule of thumb with adding two matrices together is:

    "add row and column to row and column"

  This can be expressed mathematically as:

    R   = M   + L
     ij    ij    ij

  However, both matrices must be identical in size.

  For example, if the 2x2 matrix M is added with the 2x2 matrix L then
  the result is as follow:

    R = M + L

        | A B C |   | J K L |
        |       |   |       |
      = | D E F | + | M N O |
        |       |   |       |
        | G H I |   | P Q R |


        | A+J B+K C+L |
        |             |
      = | D+M E+N F+O |
        |             |
        | G+P H+Q I+R |


Q10.  How do I subtract two matrices?
-------------------------------------

  The rule of thumb with subtracting two matrices is:

    "subtract row and column from row and column"

  This can be expressed mathematically as:

    R   = M   - L
     ij    ij    ij

  However, both matrices must be identical in size.

  For example, if the 2x2 matrix L is subtracted from the 2x2 matrix M then
  the result is as follows:

    R = M - L

        | A B C |   | J K L |
        |       |   |       |
      = | D E F | - | M N O |
        |       |   |       |
        | G H I |   | P Q R |


        | A-J B-K C-L |
        |             |
      = | D-M E-N F-O |
        |             |
        | G-P H-Q I-R |


Q11. How do I multiply two matrices together?
---------------------------------------------

  The rule of thumb with multiplying two matrices together is:

    "multiply row into column and sum the result".

  This can be expressed mathematically as:

          n
          --
    R   = \   M   x L
     ij   /    ij    ji
          --
          i=1

  If the two matrices to be multiplied together have orders:

    M = AxB and L = CxD

  then the two values B and C must be identical.

  Also, the resulting matrix has an order of AxD

  Thus, it is possible to multiply a 4xN matrix with a 4x4 matrix
  but not the other way around.

  For example, if the 4x4 matrix M is defined as:

        | A B C D |
    M = | E F G H |
        | I J K L |
        | M N O P |

  and a 4x2 matrix L is defined as:

    L = | Q R |
        | S T |
        | U V |
        | W X |

  then the size of the resulting matrix is 2x4. The resulting matrix
  is defined as:

    R = M x L

        | A B C D |   | Q R |
      = | E F G H | x | S T |
        | I J K L |   | U V |
        | M N O P |   | W X |

        | AQ+BS+CU+DW  AR+BT+CV+DX |
      = | EQ+FS+GU+HW  ER+FT+GV+HX |
        | IQ+JS+KU+LW  IR+JT+KV+LX |
        | MQ+NS+OU+PW  MR+NT+OV+PX |


Q12. How do I square or raise a matrix to a power?
--------------------------------------------------

  A matrix may be squared or even raised to an integer power. However
  there are several restrictions. For all powers, the matrix must be
  orthogonal ie. have the same width and height

  For example,

     -1
    M   is the inverse of the matrix

     0
    M   generates the identity matrix

     1
    M   leaves the matrix undamaged.

     2
    M   squares the matrix and

     3
    M   generates the cube of the matrix


  Raising a matrix to a power greater than one involves multiplying a matrix
  by itself a specific number of times.

  For example,

     2
    M  = M . M

     3
    M  = M . M . M

  and so on.


  Raising the identity matrix to any power always generates the identity
  matrix ie.

     n
    I  = I


Q13. How do I multiply one or more vectors by a matrix?
-------------------------------------------------------

  The best way to perform this task is to treat the list of vectors as
  a single matrix, with each vector represented as a column vector.

  If N vectors are to be multiplied by a 4x4 matrix, then they can be
  treated as a single 4xN matrix:

  If the matrix is defined as:

        | A B C D |
    M = | E F G H |
        | I J K L |
        | M N O P |

  and the list of vectors is defined as:

        | x1 x2 x3 x4 x5|
    V = | y1 y2 y3 y4 y5|
        | z1 z2 z3 z4 z5|
        | 1  1  1  1   1|

  Note that an additional row of constant terms is added to the vector
  list, all of which are set to 1.0. In real life, this row does not
  exist. It is simply used to make the orders of the matrix M and the
  vector list V match.

  Then the multiplication is performed as follows:

            M . V = V'

  | A B C D |   | x1 x2 x3 x4 x5 |   | A.x1+B.y1+C.z1+D A.x2+B.y2+C.z2+D ... |
  | E F G H | . | y1 y2 y3 y4 y5 | = | E.x1+F.y1+G.z1+H E.x2+F.y2+G.z2+H ... |
  | I J K L |   | z1 z2 y3 y4 z5 |   | I.x1+J.y1+K.z1+L I.x2+J.y2+K.z2+L ... |
  | M N O P |   | 1  1  1  1  1  |   | M.x1+N.y1+O.z1+P M.x2+N.y2+O.z2+P ... |

  For each vector in the list there will be a total of 12 multiplication
  16 addition and 1 division operation (for perspective).

  If the matrix is known not to be a rotation or translation matrix then the
  division operation can be skipped.


DETERMINANTS AND INVERSES
=========================


Q14. What is the determinant of a matrix?
-----------------------------------------

  The determinant of a matrix is a floating point value which is used to
  indicate whether the matrix has an inverse or not. If zero, then no
  inverse exists. If non-zero, then a determinant exists.

  As an example, consider a matrix consisting of a single element:

    M = [ 1 ].

  For a matrix of this size, the determinant is simply the value of the 
  single element.

  Also, the inverse is simply the reciprocal of this single element: 

   -1
  M   = [ 1 / M[0][0] ] 

  If this single value is non-zero, then an inverse exists. In the case   
  of the identity matrix, this happens to be 1 / 1 or 1.0 

  However, if the value of this single element is zero, then the determinant
  is also zero.
  
  Attempting to calculate the reciprocal of zero, generates a value of
  infinity. This isn't permitted as far a matrices are concerned, so no
  inverse of the matrix exists.

  For an identity matrix, the determinant is always equal to one.
  Any matrix with a determinant of 1.0 is said to be isotropic.

  Thus all rotation matrices are said to be isotropic, since the
  determinant is always equal to 1.0.

  This can be proved as follows:

        | A B |   | cos X  -sin X |
    M = |     | = |               |
        | C D |   | sin X   cos X |

    D = AD - BC

    D = (cos X . cos X) -  (-sin X . sin X)

            2          2
    D = (cos X ) + (sin X)

            2       2
    But, cos X + sin X = 1

    Therefore,

    D = 1


Q15. How do I calculate the determinant of a matrix?
----------------------------------------------------

  The determinant of a matrix is calculated using Kramer's rule, where
  the value can be calculated by breaking the matrix into smaller
  matrices.

  For a 2x2 matrix M, the determinant D is calculated as follows:

        | A B |
    M = |     |
        | C D |

    D = AD - BC

  For 3x3 and 4x4 matrices, this is more complicated, but can be solved
  by methods such as Kramer's Rule.


Q16. What are Isotropic and Anisotropic matrices?
-------------------------------------------------

  An Isotropic matrix is one in which the sum of the squares of all
  three rows or columns add up to one.

  A matrix in which this is not the case, is said to be Anisotropic.

  When 3x3 or 4x4 matrices are used to rotate and scale an object, it
  is sometimes necessary to enlarge or shrink one axis more than the
  others.

  For example, with seismic surveys, it is convenient to enlarge the
  Z-axis by a factor or 50 or more, while letting the X and Y axii
  remain the same.

  Another example is the implementation of "squash" and "stretch"
  with character animation. When a character is hit by a heavy object
  eg. an anvil, the desired effect is to character stretched out
  sideways and squashed vertically:

  A suitable matrix would be as follows:

        |  2   0   0    0  |
    M = |  0   2   0    0  |
        |  0   0   0.5  0  |
        |  0   0   0    1  |

  However, there is problem looming ahead. While this matrix will cause
  no problems with the transformation of vertex data, it will cause
  problems with gouraud shading using outward normals.

  Because the transformation stage is implemented using matrix
  multiplication, both vertex data and outward normal data will be
  multiplied with this matrix.

  While this is not a problem with vertex data (it is the desired effect)
  it causes a major headache with the outward normal data.

  After raw multiplication, each outward normal will no longer be
  normalised and consequently will affect other calculations such as
  shading and back-face culling.


Q17. What is the inverse of a matrix?
-------------------------------------
                                                                 -1
  Given a matrix M, then the inverse of that matrix, denoted as M  , is
  the matrix which satisfies the following expression:

         -1
    M . M   = I

  where I is the identity matrix.

  Thus, multiplying a matrix with its inverse will generate the identity
  matrix. However, several requirements must be satisfied before the
  inverse of a matrix can be calculated.

  These include that the width and height of the matrix are identical and
  that the determinant of the matrix is non-zero.

  Calculating the inverse of a matrix is a task often performed in order
  to implement inverse kinematics using spline curves.


Q18. How do I calculate the inverse of an arbitary matrix?
----------------------------------------------------------

  Depending upon the size of the matrix, the calculation of the inverse
  can be trivial or extremely complicated.

  For example, the inverse of a 1x1 matrix is simply the reciprocal of
  the single element:

  ie. M = | x |

  Then the inverse is defined as:

     -1   | 1 |
    M   = | - |
          | x |

  Solving 2x2 matrices and larger can be achieved by using Kramer's Rule
  or by solving as a set of simultaneous equations.

  However, in certain cases, such as identity or rotation matrices, the
  inverse is already known or can be determined from taking the transpose
  of the matrix.


Q19. How do I calculate the inverse of an identity matrix?
----------------------------------------------------------

  Don't even bother. The inverse of an identity matrix is the identity
  matrix. ie.

         -1
    I . I   = I

  Any identity matrix will always have a determinant of +1.


Q20. How do I calculate the inverse of a rotation matrix?
---------------------------------------------------------

  Since a rotation matrix always generates a determinant of +1,
  calculating the inverse is equivalent of calculating the transpose.

  Alternatively, if the rotation angle is known, then the rotation
  angle can be negated and used to calculate a new rotation matrix.


Q21. How do I calculate the inverse of a matrix using Kramer's rule?
--------------------------------------------------------------------

  Given a 3x3 matrix M:

        | A B C |
        |       |
    M = | D E F |
        |       |
        | G H I |

  Then the determinant is calculated as follows:

             n
            ---
            \                           i
    det M = /   M    * submat    M  * -1
            ---  0,i         0,i
            i=1

  where

    submat   M defines the matrix composed of all rows and columns of M
          ij

  excluding row i and column j. submat   may be called recursively.
                                      ij

  If the determinant is non-zero then the inverse of the matrix exists.
  In this case, the value of each matrix element is defined by:

     -1      1                            i+j
    M    = -----  *  det submat     M * -1
     j,i   det M               i,j


Q22. How do I calculate the inverse of a 2x2 matrix?
----------------------------------------------------

  For a 2x2 matrix, the calculation is slightly harder. If the matrix is
  defined as follows:

        | A B |
    M = |     |
        | C D |

  Then the determinant is defined as:

    det = AD - BC

  And the inverse is defined as:

     -1     1   |  D  -B  |
    M   =  ---  |         |
           det  | -C   A  |

  This can be proved using Kramer's rule. Given the matrix M:

        | A B |
    M = |     |
        | C D |

  Then the determinant is:

                           0                            1
    det =  M    * submat M    * -1 +  M    * submat M    * -1
            0,0           0,0          0,1           0,1

    <=>    M    * M    * 1         +  M    * M    * -1
            0,0    1,1                 0,1    1,0

    <=>    A  * D                  +  B    * C    * -1

    <=>    AD                      +  BC . -1

    <=>    AD - BC

    ==============


  And the inverse is derived from:

     -1                      0+0      -1
    M    = det submat    * -1    <=> M    = M    *  1 <=> D
     0,0             0,0              0,0    1,1

     -1                      1+0      -1
    M    = det submat    * -1    <=> M    = M    * -1 <=> C * -1
     0,1             1,0              0,1    1,0

     -1                      0+1      -1
    M    = det submat    * -1    <=> M    = M    * -1 <=> B * -1
     1,0             0,1              1,0    0,1

     -1                      1+1      -1
    M    = det submat    * -1    <=> M    = M    *  1 <=> A
     1,1             1,1              1,1    0,0


  Then the inverse matrix is equal to:

     -1    1  |  D  -C |
    M   = --- |        |
          det | -B   A |

  Providing that the determinant is not zero.


Q23. How do I calculate the inverse of a 3x3 matrix?
----------------------------------------------------

  For 3x3 matrices and larger, the inverse can be calculated by
  either applying Kramer's rule or by solving as a set of linear
  equations.

  If Kramer's rule is applied to a matrix M:

        | A B C |
    M = | D E F |
        | G H I |

  then the determinant is calculated as follows:

    det M = A * (EI - HF) - B * (DI - GF) + C * (DH - GE)


  Providing that the determinant is non-zero, then the inverse is
  calculated as:

     -1     1     |   EI-FH  -(BI-HC)   BF-EC  |
    M   = ----- . | -(DI-FG)   AI-GC  -(AF-DC) |
          det M   |   DH-GE  -(AH-GB)   AE-BD  |


  This can be implemented using a pair of 'C' functions:

    ---------------------------------

    VFLOAT m3_det( MATRIX3 mat )
      {
      VFLOAT det;

      det = mat[0] * ( mat[4]*mat[8] - mat[7]*mat[5] )
          - mat[1] * ( mat[3]*mat[8] - mat[6]*mat[5] )
          + mat[2] * ( mat[3]*mat[7] - mat[6]*mat[4] );

      return( det );
      }

   ----------------------------------

   void m3_inverse( MATRIX3 mr, MATRIX3 ma )
     {
     VFLOAT det = m3_det( ma );

     if ( fabs( det ) < 0.0005 )
       {
       m3_identity( ma );
       return;
       }

     mr[0] =    ma[4]*ma[8] - ma[5]*ma[7]   / det;
     mr[1] = -( ma[1]*ma[8] - ma[7]*ma[2] ) / det;
     mr[2] =    ma[1]*ma[5] - ma[4]*ma[2]   / det;

     mr[3] = -( ma[3]*ma[8] - ma[5]*ma[6] ) / det;
     mr[4] =    ma[0]*ma[8] - ma[6]*ma[2]   / det;
     mr[5] = -( ma[0]*ma[5] - ma[3]*ma[2] ) / det;

     mr[6] =    ma[3]*ma[7] - ma[6]*ma[4]   / det;
     mr[7] = -( ma[0]*ma[7] - ma[6]*ma[1] ) / det;
     mr[8] =    ma[0]*ma[4] - ma[1]*ma[3]   / det;
     }

    ---------------------------------


Q24. How do I calculate the inverse of a 4x4 matrix?
----------------------------------------------------

  As with 3x3 matrices, either Kramer's rule can be applied or the
  matrix can be solved as a set of linear equations.

  An efficient way is to make use of the existing 'C' functions defined
  to calculate the determinant and inverse of a 3x3 matrix.

  In order to implement Kramer's rule with 4x4 matrices, it is necessary
  to determine individual sub-matrices. This is achieved by the following
  routine:

    --------------------------
    void m4_submat( MATRIX4 mr, MATRIX3 mb, int i, int j )
      {
      int ti, tj, idst, jdst;

      for ( ti = 0; ti < 4; ti++ )
        {
        if ( ti < i )
          idst = ti;
        else
          if ( ti > i )
            idst = ti-1;

        for ( tj = 0; tj < 4; tj++ )
          {
          if ( tj < j )
            jdst = tj;
          else
            if ( tj > j )
              jdst = tj-1;

          if ( ti != i && tj != j )
            mb[idst*3 + jdst] = mr[ti*4 + tj ];
          }
        }
      }

    --------------------------

  The determinant of a 4x4 matrix can be calculated as follows:

    --------------------------

    VFLOAT m4_det( MATRIX4 mr )
      {
      VFLOAT  det, result = 0, i = 1;
      MATRIX3 msub3;
      int     n;

      for ( n = 0; n < 4; n++, i *= -1 )
        {
        m4_submat( mr, msub3, 0, n );

        det     = m3_det( msub3 );
        result += mr[n] * det * i;
        }

      return( result );
      }

    --------------------------

  And the inverse can be calculated as follows:

    --------------------------

    int m4_inverse( MATRIX4 mr, MATRIX4 ma )
      {
      VFLOAT  mdet = m4_det( ma );
      MATRIX3 mtemp;
      int     i, j, sign;

      if ( fabs( mdet ) < 0.0005 )
        return( 0 );

      for ( i = 0; i < 4; i++ )
        for ( j = 0; j < 4; j++ )
          {
          sign = 1 - ( (i +j) % 2 ) * 2;

          m4_submat( ma, mtemp, i, j );

          mr[i+j*4] = ( m3_det( mtemp ) * sign ) / mdet;
          }

      return( 1 );
      }

    --------------------------

  Having a function that can calculate the inverse of any 4x4 matrix is
  an incredibly useful tool. Application include being able to calculate
  the base matrix for splines, inverse rotations and rearranging matrix
  equations.


Q25. How do I calculate the inverse of a matrix using linear equations?
-----------------------------------------------------------------------

  If a matrix M exists, such that:

         | A B C |
    M  = | D E F |
         | G H I |

  then the inverse exists:

         | P Q R |
    M' = | S T U |
         | V W X |

  and the following expression is valid:

                     -1
        M     .     M     = I

    | A B C |   | P Q R |   | 1 0 0 |
    | D E F | . | S T U | = | 0 1 0 |
    | G H I |   | V W X |   | 0 0 1 |


  The inverse can then be calculated through the solution as a set of
  linear equations ie.:

    | AP + BS + CV |   | 1 |   Column 0 (X)
    | DP + ES + FV | = | 0 |
    | GP + HS + IV |   | 0 |

    | AQ + BT + CW |   | 0 |   Column 1 (Y)
    | DQ + ET + FW | = | 1 |
    | GQ + HT + IW |   | 0 |

    | AR + BU + CX |   | 0 |   Column 2 (Z)
    | DR + EU + FX | = | 0 |
    | GR + HU + IX |   | 1 |


TRANSFORMS
==========

Q26. What is a rotation matrix?
-------------------------------

  A rotation matrix is used to rotate a set of points within a
  coordinate system. While the individual points are assigned new
  coordinates, their relative distances do not change.

  All rotations are defined using the trigonometric "sine" and "cosine"
  functions.

  For a two-dimensional coordinate system, the rotation matrix is as
  follows:

    | cos(A)  -sin(A) |
    |                 |
    | sin(A)   cos(A) |


  With the rotation angle A set to zero, this generates the identity
  matrix:

        |  1  0 |
    I = |       |
        |  0  1 |


  If the rotation is set to +90 degrees, then the matrix is as follows:

        |  0 -1 |
    M = |       |
        |  1  0 |

  If the rotation is set to -90 degrees, then the matrix is as follows:

        |  0  1 |
    M = |       |
        | -1  0 |


  Negating the rotation angle is equivalent to generating the transpose
  of the matrix.

  If a rotation matrix is multiplied with its transpose, the result is
  the identity matrix.

Q27. How do rotation matrices relate to coordinate systems?
------------------------------------------------------

  Rotation matrices relate to coordinate systems in the following way.
  Mathematical convention requires that a positive rotation angle
  generates a clockwise rotation when looking from the origin towards
  the positive end of the rotation axis.

  Applying this rule, allows for the derivation of three Cartesian
  rotation matrices. Consider a right-handed coordinate system. For each
  rotation axis, look from the origin towards the positive end of the
  selected axis. This generates the following three views:


     +----------------------------------------+
     |                                        |
     |   X-axis       Y-axis        Z-axis    |
     |                                        |
     |                                        |
     |  ^ Y          ^ Z                Y ^   |
     |  |            |                    |   |
     |  |            |                    |   |
     |  |            |                    |   |
     |  |            |                    |   |
     |  O----> Z     O----> X      X <----O   |
     |                                        |
     +----------------------------------------+


  Since a positive rotation angle generates a clockwise rotation, it is
  possible to generate a set of coordinate mappings for each rotation.
  For simplicity, a rotation of +90 will be considered:

  Starting with the X-axis:

   ( 0, 1, 0 ) -> ( 0, 0, 1 )
   ( 0, 0, 1 ) -> ( 0,-1, 0 )
   ( 0,-1, 0 ) -> ( 0, 0,-1 )
   ( 0, 0,-1 ) -> ( 0, 1, 0 )

  These can be simplified to:

    X' =  X
    Y' = -Z
    Z' =  Y

  These can then be placed into a matrix:

         | 1  0       0     |
    Rx = | 0  cos A  -sin A |
         | 0  sin A   cos A |


  Doing the same for the Y-axis:

    ( 0, 0, 1) -> ( 1,0, 0)
    ( 1, 0, 0) -> ( 0,0,-1)
    ( 0, 0,-1) -> (-1,0, 0)
    (-1, 0, 0) -> ( 0,0, 1)

  These can be simplified to:

    X' = Z
    Y' = Y
    Z' = -X

  These can then be placed into a matrix:

         |  cos A   0   sin A  |
    Ry = |  0       1   0      |
         | -sin A   0   cos A  |

  And finally for the Z-axis:

    ( 0, 1, 0 ) -> ( -1,  0, 0 )
    (-1, 0, 0 ) -> (  0, -1, 0 )
    ( 0,-1, 0 ) -> (  1,  0, 0 )
    ( 1, 0, 0 ) -> (  0,  1, 0 )

  These can be simplified to:

    X' = -Y
    Y' =  X
    Z' =  Z

  Placing these into a matrix:

         |  cos A   -sin A    0  |
    Rz = |  sin A    cos A    0  |
         |  0        0        1  |

  These are the three basic rotation matrices used by OpenGL.


Q28. How do I generate a rotation matrix in the X-axis?
-------------------------------------------------------

  Use the 4x4 matrix:

         |  1  0       0       0 |
     M = |  0  cos(A) -sin(A)  0 |
         |  0  sin(A)  cos(A)  0 |
         |  0  0       0       1 |


Q29. How do I generate a rotation matrix in the Y-axis?
-------------------------------------------------------

  Use the 4x4 matrix:

         |  cos(A)  0  -sin(A)  0 |
     M = |  0       1   0       0 |
         |  sin(A)  0   cos(A)  0 |
         |  0       0   0       1 |


Q30. How do I generate a rotation matrix in the Z-axis?
-------------------------------------------------------

  Use the 4x4 matrix:

         |  cos(A)  -sin(A)   0   0 |
     M = |  sin(A)   cos(A)   0   0 |
         |  0        0        1   0 |
         |  0        0        0   1 |


Q31. What are Euler angles?
---------------------------

  Euler angles are the name given to the set of rotation angles which
  specify the rotation in each of the X, Y and Z rotation axii.

  These are specfied in vector format eg. |x y z| and can be stored
  as a VECTOR data structure.

  For example, the set

  |  0 0  0 | will always generate the identity matrix.

  Other angles are represented as follows:

  | 90 0  0 | is a rotation of +90 degrees in the X-axis.

  | 0 90  0 | is a rotation of +90 degrees in the Y-axis and

  | 0  0 90 | is a rotation of +90 degrees in the Z-axis.

  Euler angles can be represented using a single vector data structure.


Q32. What are Yaw, Roll and Pitch?
----------------------------------

  Yaw, Roll and Pitch are aeronautical terms for rotation using the
  Euclidean coordinate system (Euler angles), relative to the local
  coordinate system of an aeroplane.

  Imagine you are viewing an aeroplane from above and from directly behind.

  The Z-axis is lined up with the tail and nose of the aeroplane.
  The X-axis runs from the tip of the left wing to the tip of the right
  wing.

  The Y axis points straight up from the ground.

  Pitch then becomes rotation in the X-axis, Yaw becomes rotation in the
  Y-axis and Roll becomes rotation in the Z-axis.


Q33. How do I combine rotation matrices?
----------------------------------------

  Rotation matrices are combined together using matrix multiplication.
  As a result, the order of multiplication is very important.


Q34. What is Gimbal lock?
-------------------------

  Gimbal lock is the name given to a problem that occurs with the use of
  Euler angles. Because the final rotation matrix depends on the order
  of multiplication, it is sometimes the case that the rotation in one
  axis will be mapped onto another rotation axis.

  Even worse, it may become impossible to rotate an object in a desired
  axis. This is called Gimbal lock.

  For example, assume that an object is being rotated in the order Z,Y,X
  and that the rotation in the Y-axis is 90 degrees.

  In this case, rotation in the Z-axis is performed first and therefore
  correctly. The Y-axis is also rotated correctly. However, after
  rotation in the Y axis, the X-axis is rotated onto the Z-axis.

  Thus, any rotation in the X-axis actually rotates the object in the
  Z-axis. Even worse, it becomes to rotate the object in the X-axis.

  The only solution to this problem is to make use of Quaternions.


Q35. What is the correct way to combine rotation matrices?
----------------------------------------------------------

  Really, there is no "correct way" of combining rotation matrices.
  However, in order to be able to predict the result of combining
  matrices together, some organisation is required. This is also
  necessary if a full 3D matrix library is to be built.

  The simplest way to rotate an object is to multiply the matrices
  using the order:

    M = X.Y.Z

  where M is the final rotation matrix, and X,Y,Z are the individual
  rotation matrices. This defines a rotation in the X-axis (pitch) first,
  followed by the Y-axis (yaw) and a final rotation in the Z-axis (roll).

  However, whenever the view from the camera viewpoint is being
  evaluated, then the order and signs of the rotation is reversed.

  For example, if you are standing up, and turn to your left, everything
  in your field of view appears to move towards the right.

  However, someone else facing you will say that you turned towards their
  right.

  Thus the view from the camera is modelled using the order:

    M = -Z.-Y.-X

  This is the inverse (or transpose) of the rotation matrix generated
  if the camera were being rendered as another object.


Q36. How do I generate a rotation matrix from Euler angles?
-----------------------------------------------------------

  At first glance, the most obvious method to generate a rotation matrix
  from a set of Euler angles is to generate each matrix individually and
  multiply all three together ie.

    m3_rotx( mat_x,     vec -> angle_x );
    m3_roty( mat_y,     vec -> angle_y );
    m3_rotz( mat_z,     vec -> angle_z );
    m3_mult( mat_tmp,   mat_z, mat_y   );
    m3_mult( mat_final, mat_tmp, mat_x );

  This set of calls could be placed in a separate routine eg.

    m3_fromeuler( MATRIX *mat_final, VECTOR3 *euler )

  However, to perform this sequence of calls is very wasteful in terms
  of processing time. Given that each 4x4 rotation matrix is guaranteed
  to have 10 elements with value zero (0), 2 elements with value one (1)
  and four others of arbitary value, over 75% of every matrix operation
  is wasted. This does not include the set up and initialisation of each
  matrix.

  Altogether, over 75% of all matrix operations are spent processing
  arithmetic expressions which lead to either zero or one.

  A more efficient way must be found. Fortunately, there is another way
  of determining the final resulting matrix.

  If all three matrices are combined in algebraic format, the following
  expression is defined:

    M = X.Y.Z

  where M is the final matrix,
        X is the rotation matrix for the X-axis,
        Y is the rotation matrix for the Y-axis,
        Z is the rotation matrix for the Z-axis.

  Expanding into rotation matrices in algebraic format gives:

         |  1  0  0 |
    X  = |  0  A -B |
         |  0  B  A |

         |  C  0 -D |
    Y  = |  0  1  0 |
         |  D  0  C |

         |  E -F  0 |
    Z  = |  F  E  0 |
         |  0  0  1 |

  where A,B are the cosine and sine of the X-axis rotation axis,
        C,D are the cosine and sine of the Y-axis rotation axis,
        E,F are the cosine and sine of the Z-axis rotation axis.

  Then the expression:

    M  = X.Y.Z

  can be split into two matrix multiplications:

    M' = X.Y

    M  = M'.Z

  Evaluating M' first:


    M' = X.Y

         | 1  0  0 |   | C  0 -D |
    M' = | 0  A -B | . | 0  1  0 |
         | 0  B  A |   | D  0  C |

         | 1.C + 0.0 +  0.D   1.0 + 0.1 +  0.0   1.-D + 0.0 +  0.C |
    M' = | 0.C + A.0 + -B.D   0.0 + A.1 + -B.0   0.-D + A.0 + -B.C |
         | 0.C + B.0 +  A.D   0.0 + B.1 +  A.0   0.-D + B.0 +  A.C |

  Simplifying M' gives:

         |  C     0  -D   |
    M' = | -B.D   A  -B.C |
         |  A.D   B   A.C |


  Evaluating M gives:

    M  = M'.Z

         |  C   0  -D  |   | E -F  0 |
    M  = | -BD  A  -BC | . | F  E  0 |
         |  AD  B   AC |   | 0  0  1 |

         |   C.E + 0.F +  -D.0    C.-F + 0.E + -D.0     C.0 + 0.0 +  -D.1 |
    M  = | -BD.E + A.F + -BC.0  -BD.-F + A.E + -BC.0  -BD.0 + A.0 + -BC.1 |
         |  AD.E + B.F +  AC.0   AD.-F + B.E +  AC.0   AD.0 + 0.0 +  AC.1 |

  Simplifying M gives a 3x3 matrix:

         |  CE      -CF      -D  |
    M  = | -BDE+AF  -BDF+AE  -BC |
         |  ADE+BF  -ADF+BE   AC |

  This is the final rotation matrix. As a 4x4 matrix this is:

         |  CE      -CF      -D   0 |
    M  = | -BDE+AF   BDF+AE  -BC  0 |
         |  ADE+BF  -ADF+BE   AC  0 |
         |  0        0        0   1 |

  The individual values of A,B,C,D,E and F are evaluated first. Also, the
  values of BD and AD are also evaluated since they occur more than once.

  Thus, the final algorithm is as follows:

    -----------------------

    A       = cos(angle_x);
    B       = sin(angle_x);
    C       = cos(angle_y);
    D       = sin(angle_y);
    E       = cos(angle_z);
    F       = sin(angle_z);

    AD      =   A * D;
    BD      =   B * D;

    mat[0]  =   C * E;
    mat[1]  =  -C * F;
    mat[2]  =  -D;
    mat[4]  = -BD * E + A * F;
    mat[5]  =  BD * F + A * E;
    mat[6]  =  -B * C;
    mat[8]  =  AD * E + B * F;
    mat[9]  = -AD * F + B * E;
    mat[10] =   A * C;

    mat[3]  =  mat[7] = mat[11] = mat[12] = mat[13] = mat[14] = 0;
    mat[15] =  1;

    -----------------------

  Using basic matrix calculations, the operation count would reach
  128 multiplications, 96 additions and  80 assignments operations.

  Using the optimised algorithm, only 12 multiplications, 6 subtractions
  and 18 assignment operations are required.

  So, it is obvious that by using the optimised algorithm, a performance
  achievement of 1000% is achieved!


Q37. How do I convert a rotation matrix to Euler angles?
--------------------------------------------------------

  This operation is the exact opposite to the one answered in the question
  above. Given that the rotation matrix is:

         |  CE      -CF      -D   0 |
    M  = | -BDE+AF   BDF+AE  -BC  0 |
         |  ADE+BF  -ADF+BE   AC  0 |
         |  0        0        0   1 |

  where A,B are the cosine and sine of the X-axis rotation axis,
        C,D are the cosine and sine of the Y-axis rotation axis,
        E,F are the cosine and sine of the Z-axis rotation axis.

  Using the C data structure for a 4x4 matrix, the index values are
  as follows:

         |  0  1  2  3 |
    M =  |  4  5  6  7 |
         |  8  9 10 11 |
         | 12 13 14 15 |
     
  From looking at these two tables, it can be see that array element 
  [2] has the value of -D or -sin(Y). Then the rotation angle in the
  Y-axis can be calculated from a call to to the inverse-sine function.
  Passing this value to the cosine function then gives the value of 
  C.

  If C is not zero, then the rotation angles in each of the X and Z
  axii, can be derived from the terms on the third column and first row
  respectively. These are as follows:

    X-axis:  M[6]  = -BC        
             M[10] =  AC  
 
    Z-axis:  M[0]  =  CE
             M[1]  = -CF

  The actual rotation angles can be derived by taking each pair of values
  dividing by C and passing the results to the inverse tangent function.

  If C is zero, then these calculations are not possible. In this case
  the rotation angle in the Y-axis will be either -90 or +90. Thus D 
  will either have the value of 1 or -1.

  In this case, Gimbal Lock will have occurred. Rotations in both the
  X and Z axii will appear to be in the same axis. This can be seen
  through the evaluation of the rotation axis.

         |  0.E       -0.F        1    0 |
    M  = | -B.1.E+AF   B.1.F+AE  -B.0  0 |
         |  A.1.E+BF  -A.1.F+BE   A.0  0 |
         |  0          0          0    1 |

  Multiplying out each term gives:

         |  0          0          1    0 |
    M  = | -BE+AF      BF+AE      0    0 |
         |  AE+BF     -AF+BE      0    0 |
         |  0          0          0    1 |

  Rearranging these terms gives:

         |  0          0          1    0 |
    M  = | -BE+AF      AE+BF      0    0 |
         |  AE+BF      BE-AF      0    0 |
         |  0          0          0    1 |

  Then it can be seen that the matrix is really of the form:

         |  0   0  -1   0 |
    M  = | -V   W   0   0 |
         |  W   V   0   0 |
         |  0   0   0   1 |

  Where V has the value of BE-AF and
        W has the value of AE+BF

  These two values can be considered to be the sin and cosine of a
  single rotation axis.

  The final algorithm is then as follows:

    -----------------------------------

    angle_y = D = -asin( mat[2]);        /* Calculate Y-axis angle */
    C           =  cos( angle_y );
    angle_y    *= RADIANS;

    if ( fabs( C ) > 0.005 )             /* Gimball lock? */
      {
      trx      =  mat[10] / C;           /* No, so get X-axis angle */
      try      = -mat[6]  / C;

      angle_x  = atan2( try, trx ) * RADIANS;

      trx      =  mat[0] / C;            /* Get Z-axis angle */
      try      = -mat[1] / C;

      angle_z  = atan2( try, trx ) * RADIANS;
      }
    else                                 /* Gimball lock has occurred */
      {
      angle_x  = 0;                      /* Set X-axis angle to zero */

      trx      = mat[5];                 /* And calculate Z-axis angle */
      try      = mat[4];

      angle_z  = atan2( try, trx ) * RADIANS;
      }

    angle_x = clamp( angle_x, 0, 360 );  /* Clamp all angles to range */
    angle_y = clamp( angle_y, 0, 360 );
    angle_z = clamp( angle_z, 0, 360 );

    -----------------------------------

Q38. How do I generate a rotation matrix for a selected axis and angle?
-----------------------------------------------------------------------

  The only way to generate this type of rotation matrix is through the
  use of quaternion mathematics.

  See question [Q53. How do I convert a quaternion to a rotation matrix?]
  for further details.


Q39. How do I generate a rotation matrix to map one vector onto another?
------------------------------------------------------------------------

  When developing animation software, a common requirement is to find
  a rotation matrix that will map one direction vector onto another.

  This problem may be visualised by considering the two direction
  vectors to be attached at their starting points. Then the entire
  rotation space forms a unit sphere.

  In theory, there are an infinite number of rotation axii and angles
  that will map one vector onto the other. All of these axii lie on the
  plane where all of the points are the exact same distance from both
  vectors.

  However, only one solution is of practical interest. This is the path
  which covers the shortest angular distance between the two vectors.

  The rotation axis to this path is calculated by taking the cross
  product between the two vectors:

    Vaxis = Vs x Vf

  The rotation angle is calculated by taking the dot product between the
  two vectors:

                -1
    Vangle = cos   ( Vs . Vf )

  One practical application of the solution to this problem is finding
  the shortest flight path between two cities. In this case, each city
  is represented as a direction vector generated from spherical
  coordinates. Since planet Earth is spherical, the desired flight path
  is the shortest angular rotation between the two cities.


Q40. How do I use matrices to convert one coordinate system to another?
-----------------------------------------------------------------------

  Similar to the previous problem, the requirement is to map one
  coordinate system onto another. However, instead of just trying to
  map one coordinate axis onto another, all three axii have to be matched.
  Both coordinate systems are therefore represented as either 3x3 or
  4x4 matrices.

  The problem is therefore to find the rotation matrix that will map one
  matrix onto another. This can be expressed mathematically:

    Mfinal = Mrot . Morig

  where Mfinal is the final coordinate system matrix,
        Morig  is the original coordinate system and
        Mrot   is the desired rotation matrix.

  The goal is then to find the matrix Mrot. This can be achieved by
  rearranging the equation to give:

                  -1
    Mfinal . Morig   = Mrot

                           -1
    Mrot   = Mfinal . Morig

  Thus, the desired rotation matrix can be by calculatng the inverse of
  the original coordinate system and multiplying it with the final
  rotation matrix.

  As a check, consider the cases when either the original or final
  rotation matrices are the identity matrix. In each case, the rotation
  matrix should match the final matrix and the inverse of the final
  matrix respectively.

  Once calculated, the rotation matrix may be converted into a
  quaternion.

Q41. What is a translation matrix?
----------------------------------

  A translation matrix is used to position an object within 3D space
  without rotating in any way. Translation operations using matrix
  multiplication can only be performed using 4x4 matrices.


  If the translation is defined by the vector [X Y Z ], then the 4x4
  matrix to implement translation is as follows:

        | 1  0  0  X |
        |            |
        | 0  1  0  Y |
    M = |            |
        | 0  0  1  Z |
        |            |
        | 0  0  0  1 |

  If the vector is [0 0 0] then the vertex list will remain as before.


Q42. What is a scaling matrix?
------------------------------

  A scaling matrix is used to enlarge or shrink the size of a 3D
  model.

  If the scaling vector is [X Y Z] then the matrix to perform this is
  as follows:

        | X  0  0  0 |
        |            |
        | 0  Y  0  0 |
    M = |            |
        | 0  0  Z  0 |
        |            |
        | 0  0  0  1 |

  If the scaling vector is [1 1 1], then this generates the identity
  matrix and vertex geometry will remain unchanged.


Q43. What is a shearing matrix?
-------------------------------

  A shearing matrix is used to make a 3D model appear to slant sideways.
  For example, "italic" text requires each character to slant towards the
  right.

  In three dimensions six possible shearing directions exist:

    o shear X by Y
    o shear X by Z
    o shear Y by X
    o shear Y by Z
    o shear Z by X
    o shear Z by Y

  All six shearing directions may be combined into a single matrix:

        | 1    Syx  Szx  0 |
        |                  |
        | Sxy  1    Szy  0 |
    M = |                  |
        | Sxz  Syz  1    0 |
        |                  |
        | 0    0    0    1 |
        |                  |

    Where Sij implements a shear of I by J

    Thus, Sxy shears X by Y

  In theory, rotation in three dimensions may be considered a combination
  of six shearing directions.


Q44. How do I perform linear interpolation between two matrices?
----------------------------------------------------------------

  Given two rotation matrices, the problem is to find a way of
  determining intermediate positions specified by a parametric
  variable t, where t ranges from 0.0 to 1.0

  This can be achieved by converting the two matrices into either
  Euler angles or Spherical rotation angles (via quaternions) and
  a translation vector.
  In either case, each matrix is converted into a pair of 3D vectors.

  Interpolation between these two vectors can then be performed
  through the use of the standard linear interpolation equation:

      Vr = Va + t .(Vb - Va )

  where Vr is the resulting vector
        Va is the start position vector
        Vb is the final position vector

  This equation may be applied to both translation and rotation
  vectors.

  Once determined, the resulting translation and rotation are then
  converted back into the desired intermediate matrix.


Q45. How do I perform cubic interpolation between four matrices?
----------------------------------------------------------------

  Given four rotation or translation matrices, the problem is to
  find a way  of determining intermediate positions specified by a
  parametric variable t.

  This can be achieved by making use of cubic interpolation. As with
  linear interpolation, the four matrices are converted into their
  corresponding translation and rotation vectors (Again, either Euler
  angles or spherical rotation angles).

  Each set of four vectors is then converted into a single geometry
  vector G. Through the use of spline mathematics, this geometry vector
  is converted into an interpolation matrix M.

  If the geometry vector is defined as:

         | x1 x2 x3 x4 |
     G = | y1 y2 y3 y4 |
         | z1 z2 z3 z4 |

  Then multiplication by the base matrix:

         |  -4.5    9.0  -5.5  1.0  |
    Mb = |  13.5  -22.5   9.0  0.0  |
         | -13.5   18.0  -4.5  0.0  |
         |   4.5   -4.5   1.0  0.0  |

  will generate the 3x4 interpolation matrix Mi:

    Mi = G .Mb

  This can be implemented through a standard matrix-vector multiplication.

  Interpolation can then be performed by the use of the parametric
  variable t:

        R  = Mi . t

                           |t^3|
    | xr |   | A B C D |   |t^2|
    | yr | = | E F G H | . |t  |
    | zr |   | I J K L |   |1  |

  The result vector can then be converted back into a rotation or
  translation matrix.

  It should be noted that the rotation paths that are generated may
  occasionally become rather loopy. This is normal, as the algorithm
  is trying to find the path with the least amount of rotation between
  all four vectors.

  Of the two methods, spherical rotation angles will usually be seen to
  provide the cleanest interpolation paths for rotation.


Q46. How can I render a matrix?
-------------------------------

  When using a graphics window for 3D animation, it is convenient to be
  able to view a rotation matrix concurrently with the animation.

  However, displaying a rotation matrix as an array of numeric values
  does not provide a very meaningful context.

  An alternative to rendering numeric data is to make use of graphical
  display methods such as bar-graphs.

  Much like a graphic equalizer on a stereo, a rotation matrix may be
  displayed in a bar graph format. Each element of the rotation matrix
  is rendered as an individual bar-graph in the range -1 to +1.

  A 3x3 matrix would look like the following:

    +--+ +--+ +--+
    |##| |  | |  |
    +--+ +--+ +--+
    |  | |  | |  |
    +--+ +--+ +--+

    +--+ +--+ +--+
    |  | |##| |  |
    +--+ +--+ +--+
    |  | |  | |  |
    +--+ +--+ +--+

    +--+ +--+ +--+
    |  | |  | |##|
    +--+ +--+ +--+
    |  | |  | |  |
    +--+ +--+ +--+

  In this case, the rotation matrix is the identity matrix, since each
  element in the major diagonal is +1, and all others are zero.

  For added visual clarity, parameters which are negative may shaded
  in a different colour than those which are positive.


QUATERNIONS
===========

Q47. What are quaternions?
--------------------------

  Quaternions extend the concept of rotation in three dimensions to
  rotation in four dimensions. This avoids the problem of "gimbal-lock"
  and allows for the implementation of smooth and continuous rotation.

  In effect, they may be considered to add a additional rotation angle
  to spherical coordinates ie. Longitude, Latitude and Rotation angles

  A Quaternion is defined using four floating point values |x y z w|.

  These are calculated from the combination of the three coordinates
  of the rotation axis and the rotation angle.


Q48. How do quaternions relate to 3D animation?
-----------------------------------------------

  As mentioned before, Euler angles have the disadvantage of being
  susceptible to "Gimbal lock" where attempts to rotate an
  object fail to appear as expected, due to the order in which the 
  rotations are performed.

  Quaternions are a solution to this problem. Instead of rotating an
  object through a series of successive rotations, quaternions allow
  the programmer to rotate an object through an arbitary rotation axis
  and angle. 

  The rotation is still performed using matrix mathematics. However,
  instead of multiplying matrices together, quaternions representing
  the axii of rotation are multiplied together. The final resulting 
  quaternion is then converted to the desired rotation matrix.

  Because the rotation axis is specifed as a unit direction vector,
  it may also be calculated through vector mathematics or from 
  spherical coordinates ie (longitude/latitude).

  Quaternions offer another advantage in that they be interpolated.
  This allows for smooth and predictable rotation effects.


Q49. How do I calculate the conjugate of a quaternion?
------------------------------------------------------

  This can be achieved by reversing the polarity (or negating) the
  vector part of the quaternion, ie:
    --
    Qr =  ( Qr.scalar, -Qr.vector )

  ----------------------------------------------------------------

  quaternion_conjugate( QUAT *qr, QUAT *qa )
    {
    qr -> qw =  qa -> qw;
    qr -> qx = -qa -> qx;
    qr -> qy = -qa -> qy;
    qr -> qz = -qa -> qz;
    }

  --------------------------------------

Q50. How do I calculate the inverse of a quaternion?
----------------------------------------------------

  This is equivalent to calculating the conjugate of the quaternion. 
  See Q49. How do I calculate the conjugate of a quaternion?


Q51. How do I calculate the magnitude of a quaternion?
------------------------------------------------------

  The magnitude of a quaternion is calculated by multiplying the
  quaternion with its conjugate ie:

              ------------
             /      --
  |Qr| =  \/     Qr.Qr

  This can be implemented as the following code sequence:

  -------------------------------------------------------------------

  QFLOAT quaternion_magnitude( QUAT *qa )
    {
    return( sqrt(qa->qw*qa->qw+
                 qa->qx*qa->qx+ qa->qy*qa->qy+qa->qz*qa->qz) )
    }

  -------------------------------------------------------------------


Q52. How do I normalise a quaternion?
-------------------------------------

  A quaternion can be normalised in a way similar to vectors. The
  magnitude of the quaternion is calculated first. Then both the
  scalar and vector part of the quaternion are divided by this value.

  A unit quaternion will always have a magnitude of 1.0


Q53. How do I multiply two quaternions together?
------------------------------------------------

  Given two quaternions Q1 and Q2, the goal is to calculate the
  combined rotation Qr:

    Qr = Q1.Q2

  This is achieved through the expression:

    Qr = Q1.Q2 = ( w1.w2 - v1.v2, w1.v2 + w2.v1 + v1 x v2 )

  where v1 = (x,y,z) of Q1
        w1 = (w)     of Q1
        v2 = (x,y,z) of Q2
        w2 = (w)     of Q2

  and both . and x are the standard vector dot and cross products.

  This can be implemented using the following code segment:

  ---------------------------------------------------

  quaternion_multiply( QUAT *qr, QUAT *qa, QUAT *qb )
    {
    qr.scalar = v3_dot( &qa->vector, &qb->vector );

    v3_cross(  &va, &qa->vector, &qb->vector );
    v3_scalef( &vb, &qa->vector, &qb->scalar );
    v3_scalef( &vc, &qb->vector, &qa->scaler );
    v3_add(    &va,         &va, &vb );
    v3_add(    &qr->vector, &va, &vc );

    quaternion_normalise( qr );
    }

  ---------------------------------------------------


Q54. How do I convert a quaternion to a rotation matrix?
--------------------------------------------------------

  Assuming that a quaternion has been created in the form:

    Q = |X Y Z W|

  Then the quaternion can then be converted into a 4x4 rotation
  matrix using the following expression:


        |       2     2                                |
        | 1 - 2Y  - 2Z    2XY - 2ZW      2XZ + 2YW     |
        |                                              |
        |                       2     2                |
    M = | 2XY + 2ZW       1 - 2X  - 2Z   2YZ - 2XW     |
        |                                              |
        |                                      2     2 |
        | 2XZ - 2YW       2YZ + 2XW      1 - 2X  - 2Y  |
        |                                              |


  If a 4x4 matrix is required, then the bottom row and right-most column
  may be added.

  The matrix may be generated using the following expression:

    ----------------

    xx      = X * X;
    xy      = X * Y;
    xz      = X * Z;
    xw      = X * W;

    yy      = Y * Y;
    yz      = Y * Z;
    yw      = Y * W;

    zz      = Z * Z;
    zw      = Z * W;

    mat[0]  = 1 - 2 * ( yy + zz );
    mat[1]  =     2 * ( xy - zw );
    mat[2]  =     2 * ( xz + yw );

    mat[4]  =     2 * ( xy + zw );
    mat[5]  = 1 - 2 * ( xx + zz );
    mat[6]  =     2 * ( yz - xw );

    mat[8]  =     2 * ( xz - yw );
    mat[9]  =     2 * ( yz + xw );
    mat[10] = 1 - 2 * ( xx + yy );

    mat[3]  = mat[7] = mat[11 = mat[12] = mat[13] = mat[14] = 0;
    mat[15] = 1;

    ----------------


Q55. How do I convert a rotation matrix to a quaternion?
--------------------------------------------------------

  A rotation may be converted back to a quaternion through the use of
  the following algorithm:

  The process is performed in the following stages, which are as follows:

    Calculate the trace of the matrix T from the equation:

                2     2     2
      T = 4 - 4x  - 4y  - 4z

                 2    2    2
        = 4( 1 -x  - y  - z )

        = mat[0] + mat[5] + mat[10] + 1


    If the trace of the matrix is greater than zero, then
    perform an "instant" calculation.

      S = 0.5 / sqrt(T)

      W = 0.25 / S

      X = ( mat[9] - mat[6] ) * S

      Y = ( mat[2] - mat[8] ) * S

      Z = ( mat[4] - mat[1] ) * S


    If the trace of the matrix is less than or equal to zero
    then identify which major diagonal element has the greatest
    value.

    Depending on this value, calculate the following:

      Column 0:
        S  = sqrt( 1.0 + mr[0] - mr[5] - mr[10] ) * 2;

        Qx = 0.5 / S;
        Qy = (mr[1] + mr[4] ) / S;
        Qz = (mr[2] + mr[8] ) / S;
        Qw = (mr[6] + mr[9] ) / S;

      Column 1:
        S  = sqrt( 1.0 + mr[5] - mr[0] - mr[10] ) * 2;

        Qx = (mr[1] + mr[4] ) / S;
        Qy = 0.5 / S;
        Qz = (mr[6] + mr[9] ) / S;
        Qw = (mr[2] + mr[8] ) / S;

      Column 2:
        S  = sqrt( 1.0 + mr[10] - mr[0] - mr[5] ) * 2;

        Qx = (mr[2] + mr[8] ) / S;
        Qy = (mr[6] + mr[9] ) / S;
        Qz = 0.5 / S;
        Qw = (mr[1] + mr[4] ) / S;

     The quaternion is then defined as:

       Q = | Qx Qy Qz Qw |


Q56. How do I convert a rotation axis and angle to a quaternion?
----------------------------------------------------------------

  Given the rotation axis and angle, the following algorithm may be
  used to generate a quaternion:

    ------------------------------------------------
    sin_a = sin( angle / 2 )
    cos_a = cos( angle / 2 )

    q -> x    = axis -> x * sin_a
    q -> y    = axis -> y * sin_a
    q -> z    = axis -> z * sin_a
    q -> w    = cos_a

    quaternion_normalise( q );
    ------------------------------------------------

  It is necessary to normalise the quaternion in case any values are 
  very close to zero.


Q57. How do I convert a quaternion to a rotation axis and angle?
----------------------------------------------------------------

  A quaternion can be converted back to a rotation axis and angle
  using the following algorithm:
 
    ---------------------------------------------------
    quaternion_normalise( qr );

    cos_angle  = qr -> qw;
    angle      = acos( cos_angle ) * 2 * RADIANS;
    sin_angle  = sqrt( 1.0 - cos_angle * cos_angle );


    if ( fabs( sin_angle ) < 0.0005 )
      sa = 1;

    axis -> vx = qr -> qx / sa;
    axis -> vy = qr -> qy / sa;
    axis -> vz = qr -> qz / sa;
    --------------------------------------------------- 


Q58. How do I convert spherical rotation angles to a quaternion?
----------------------------------------------------------------

  A rotation axis itself may be defined using spherical coordinates
  (latitude and longitude) and a rotation angle

  In this case, the quaternion can be calculated as follows:

    -----------------------
    sin_a    = sin( angle / 2 )
    cos_a    = cos( angle / 2 )

    sin_lat  = sin( latitude )
    cos_lat  = cos( latitude )

    sin_long = sin( longitude )
    cos_long = cos( longitude )

    qx       = sin_a * cos_lat * sin_long
    qy       = sin_a * sin_lat
    qz       = sin_a * sin_lat * cos_long
    qw       = cos_a
    -----------------------


Q59. How do I convert a quaternion to spherical rotation angles?
----------------------------------------------------------------

  A quaternion can be converted to spherical coordinates by extending
  the conversion process:

    -----------------------
    cos_angle  = q -> qw;
    sin_angle  = sqrt( 1.0 - cos_angle * cos_angle );
    angle      = acos( cos_angle ) * 2 * RADIANS;

    if ( fabs( sin_angle ) < 0.0005 )
      sa = 1;

    tx = q -> qx / sa;
    ty = q -> qy / sa;
    tz = q -> qz / sa;

    latitude = -asin( ty );

    if ( tx * tx + tz * tz < 0.0005 )
      longitude   = 0;
    else
       longitude  = atan2( tx, tz ) * RADIANS;

    if ( longitude < 0 )
      longitude += 360.0;
    -----------------------

Q60. How do I convert Euler rotation angles to a quaternion?
-------------------------------------------------------------------

  Converting Euler rotation angles to quaterions can be achieved through
  the use of quaternion multiplication. Each rotation angle is converted 
  to an axis-angle pair, with the axis corresponding to one of the 
  Euclidean axii. The axis-angle pairs are converted to quaternions and 
  multiplied together. The final quaternion is the desired result.
  
  The following code segment demonstrates this:
  ---------------------------------------------

  quaternion_from_euler( QUATERNION *q, VFLOAT ax, VFLOAT ay, VFLOAT az )
    {
    VECTOR3 vx = { 1, 0, 0 }, vy = { 0, 1, 0 }, vz = { 0, 0, 1 };
    QUATERNION qx, qy, qz, qt;

    quaternion_from_axisangle( qx, &vx, rx );
    quaternion_from_axisangle( qy, &vy, ry );
    quaternion_from_axisangle( qz, &vz, rz );

    quaternion_multiply( &qt, &qx, &qy );
    quaternion_multiply( &q,  &qt, &qz );
    }
  ---------------------------------------------
   

Q61. How do I use quaternions to perform linear interpolation between matrices?
-------------------------------------------------------------------------------

  For many animation applications, it is necessary to interpolate
  between two rotation positions of a given object. These positions may
  have been specified using keyframe animation or inverse kinematics.

  Using either method, at least two rotation matrices must be known, and
  the desired goal is to interpolate between them. The two matrices are
  referred to as the starting and finish matrices( MS and MF).

  Using linear interpolation, the interpolated rotation matrix is
  generated using a blending equation with the parameter T, which
  ranges from 0.0 to 1.0.

  At T=0, the interpolated matrix is equal to the starting matrix.
  At T=1, the interpolated matrix is equal to the finishing matrix.

  Then the interpolated rotation matrix (MI) is specified as:

    MI = F( MS, MI, T )

  where F is a blending function.

  The first stage in interpolating between the two matrices is to
  determine the rotation matrix that will convert MS to MF.
  This is achieved using the following expression:

          -1
    T = Ms  . Mf

  where Ms is the start matrix,
        Mf is the finish matrix,
    and T is the intermediate matrix.

  The next stage is to convert this matrix into a rotation axis and
  angle. This is achieved by converting the matrix into a quaternion
  and finally into the required rotation axis and angle.

  In order to generate the interpolated rotation matrix, it is only
  necessary to scale the rotation angle and convert this angle and
  the rotation axis back into a rotation matrix.

  Using a 4x4 matrix library, this is as follows:

    m4_transpose(    mt, ms );                /* Inverse             */
    m4_mult(         ms, mt, mb );            /* Rotation matrix     */
    m4_to_axisangle( ms, axis, angle );       /* Rotation axis/angle */


    for ( t = 0; t < 1.0; t += 0.05 )
      {
      m4_from_axisangle( mi, axis, angle * t ); /* Final interpolation */

      ... whatever ...

      }

  where t is the interpolation factor ranging from 0.0 to 1.0


Q62. How do I use quaternions to perform cubic interpolation between matrices?
------------------------------------------------------------------------------

  For some applications, it may not be convenient or possible to use linear
  interpolation for animation purposes. In this case, cubic interpolation
  is another alternative.

  In order to use cubic interpolation, at least four rotation matrices must
  be known.

  Each of these is then converted into a set of spherical rotations
  via quaternions and spherical rotation angles (ie. longitude, latitude
  and rotation angle).

  These are then multiplied with the base matrix for a Cardinal spline
  curve. This interpolation matrix can then be used to determine the
  intermediate spherical rotation angles.

  Once the interpolated coordinates are known (latitude, longitude and
  rotation angle), the interpolated rotation matrix can then be generated
  through the conversion to quaternions.

  Using a 4x4 matrix library, the algorithm is as follows:

    ----------------------------------------------------------------------

    for ( n = 0; n < 4; n++ )
      m4_to_spherical( mat[n], &v_sph[n] );      /* Spherical coordinates */

    m4_multspline( m_cardinal, v_sph, v_interp ); /* Interpolation vector */

    ...

    v3_cubic( v_pos, v_interp, t );            /* Interpolation */

    m4_from_spherical( m_rot, v_pos );        /* Back to a matrix */

    ----------------------------------------------------------------------