Dev:Bone Layer

From Synfig Studio :: Documentation
Jump to: navigation, search

Initial seed for concepts

This portion of IRC logs sets the basis for the implementation of a Bone Layer. The interesting part is from 16:49 to 18:56.

Also this one has some interesting thoughts. From 8:20 to 14:43

Concepts

This is an unsorted list of concepts to let me clarify my thoughts and also allow others to understand the following sections.

Bones intentions

Initial intention of Bones is to attempt to emulate the skeleton of a vertebrate animal. In this way you have the skin and a skeleton. Part of the skin are associated with the various bones of the skeleton. When the skeleton moves the skin follows.

Application of bones in animation

In traditional animation producing a walk cycle implies drawing each keyframe for the walk and maybe, depending on the walking speed, drawing the in betweens too. To avoid having to draw the in between images there are tweening animation programs (like Synfig) to help the animator. Then the animator just needs to draw the keyframes and the application does the rest. That's quite good but in certain situations you see your self redrawing the same pose (with small variations) frequently at different times. Then bones come to help. They aid the animator in the following manner.

  • With the manipulation of a single object (or a set of them) you can manage a lot of points of the drawing definition.
  • Rotations of drawings using keyframes needs lots of them (by nature of the fact that tweening is defined in the x,y coordinates system and the rotation is performed in the angle, radius coordinate system). Using bones you can perform rotations of large angles with just two waypoints. Also since characters have limbs and limbs in living beings do mainly rotations, the usage of bones becomes handy in that kind of animation.
  • Once the character (or whatever thing that uses bones) is rigged (the skeleton structure is created and the relationship between it and the skin is defined) it is possible to produce different kinds of keyframes for different purposes: Walk, run, jump, sit, ...

How can we do implement this?

The relationship between the skeleton and the skin is like this:

  • The Skin is made using Points and BLines. BLines are defined by Points. Points are made of Vertexes and Tangents
  • Skeleton is made of bones and the relationships between them.
  • If Bones would have influence on the Vertexes and Tangents then the bones movements would move the points and therefore the skin would be moved.

That's the key, if we understand how a bone has influence on a vertex and a tangent then we can find the way a skeleton can have influence over a skin.

Bones Properties

From my experience with bones in other 2D animation applications, watching the strong and weak points, bones needs to have the following properties:

  • A bone has an origin point about which the rotation is performed.
  • A bone has a length.
  • A bone has an angle.
  • A bone can have a region of influence.
  • A bone can have a one or zero parent bones.
  • A bone can have one or more child bones.
  • A skeleton is defined as a connected set of bones (consisting of exactly one parent-less bone and its children bones and their descendants).

All the bones in a Synfig Document can produce several distinct skeletons (depending on how many parent-less bones are in it).

How does a Vertex move under the influence of a single Bone?

Conceptually a bone has influence over a point by doing affine transformations of its position according to the bone values. See also transformation matrix. A bone produces rotation, scale and translation to a point in this way:

Image:Bonesimulation2.png

As you can see the values that produce the movement of the point P to the point P' are given by:

  • Translation of the bone: O'-O
  • Rotation of the bone:
  • Scale of the bone: s=length'/length

Then, given a Point P in the 2D space and knowing the translation, rotation and scale of the bone you can calculate the new position P' using this formula:

Translation to origin (0,0)

Rotate by an angle of amount '' about the origin. That aligns the bone with the X axis

Scale by a value of 's=length'/length' in the direction of X (the current direction of the bone).

Rotate by an angle of amount '' about the origin.

Translation to new position O'

Then the transformation from P to P' is given by the matrix multiplication:

Can Points (Bone influenced) be moved independently?

Yes, they should be. If not the animator is restricted to only doing the animation with bones which would lead to some insoluble problems during the animation. Considering this, the point position result comes from the addition of two terms:

  • (a) The movement of the point as described by the influence of the bone(s): P(B)
  • (b) The free movement of the point in the 2D space. P(animated)

In terms of the interface with the user, the value P(animated) is just obtained in this way:

  1. In any position of the time line (bones are animated) the point has a position given by the influence of the bones: P(B).
  2. The user selects a point, drags it, placing it at P'.
  3. The final position of the point is P' but the user cannot modify the first term P(B) so the second term (b) becomes: P(animated)=P'-P(B).

What happen if there are more than one bone affecting the point?

The first thing you can think when you deal with more than one bone having influence over the same point is to calculate the average of the sum of the influences of all bones. So if there are N bones affecting the point then we can think of summing all the resulting points from each bone and then dividing the result by N to not scale the result.

Where is the bone matrix for the bone k on the point P.

That's fine but I would like to have more control to the way the bones affect the points. When you move a bone it looks reasonable that not all the points are influenced in the same way. This can be solved by using a "weighted" average instead of a plain one. That means giving a different amount of influence to one bone than to the other.

Where is the weight for the bone k over the point P.

Skeleton

A skeleton is a set of bones linked one to others in a tree hierarchy. A bone can have several children (or none) but only one parent (or none). This configuration allows to do a easy calculation of the forward kinematic (FK )of the chain and the inverse kinematic (IK) of the chain of bones. If the hierarchy were not tree type then the FK and IK can be not soluble.

For those IK and FK calculations it is good to have the bone referenced to its parent. So the parameters of the bone are described as relative to the parent bone. The parent bone defines a local coordinate system where the origin of the coordinate system lies on the Origin of the bone and the tip of the bone is pointing to the positive direction of the X axis.

Image: skeleton.png

As you can see in this image, each skeleton position and orientation is defined by the relative position of its immediate parent bone. In the diagram bone3 is a child of bone2 and bone 2 is a child of bone1. The bone 1 is the root parent bone but you can imagine it attached to a "master root bone" (defined by the origin of coordinates -red circumference- and the horizontal) so it can be said that the bone1 has its origin and angle defined relative to its "parent".

In this skeleton the three bones are parented in a linear way. But as you can imagine, following the rules stated for child-parent, a bone can have more than one child but not more than one parent. That means that defined a bone in the skeleton, there is only one sequence of parents to reach the root parent of the skeleton. Also it means too that one root bone defines one skeleton so each skeleton has only one root bone and only one.

Consider this: B3 is child of B2 and B2 is child of B1. Also B4 is child of B2 and B5 is child of B4. The way to travel from B5 to B1 is unique: B5->B4->B2->B1.

Setup and Animation

During the animation of the skeleton it is supposed that the position of each bone, its angle and its scale changes. Position and angle are relative to the parent bone, but scale is a value that calculates the current length of the bone compared with the "original" bone length (scale=length'/length) as you can see from the original formulas in the previous section. That means that the "original" bone length shouldn't be never zero, otherwise there will be a division by zero and the scale of the bone becomes infinite.

Also, the final position P' of a point that moves influenced by a single bone is given by the original point position relative to the bone in its "original" position (P).

What I'm trying to explain is that it is needed that the setup of the bone (position, alpha and length) and the setup position of the point (P) to be moved would be given to calculate the final position of the point (P') given a moved position of the bone (position', alpha', length')

Said this and considered the information of the previous sections, the bones and points that are influenced from the bones should have the following parameters:

BONES PARAMETERS

Parameter Notation Type Animated Comment
Origin Vector (Real,Real) Yes Relative to the parent
Angle Angle (DEG) Yes Relative to the parent
Length Real Yes Calculated, not animatable.
Scale Real Yes
Setup Origin Vector (Real,Real) Yes Relative to the parent
Setup Angle Angle (DEG) Yes Relative to the parent
Setup Length Real No Constant, zero not allowed.
Setup Scale Real No
Parent Bone Yes


POINT PARAMETERS

Parameter Notation Type Animated Comment
Position Vector (Real,Real) Yes Calculated: Global coordinates
Free Position Vector (Real, Real) Yes Global Coordinates
Setup Position Vector (Real, Real) Yes Global Coordinates
Bone Influence Matrix Matrix (3x3) Yes Calculated. See formulas below
Bone Influence Id Bone No 'i' is the index for all the Bones that influences on the Point
Influence weight Real Yes the weight associated to the BoneID_i

(t) denotes calculated at the time t

Position of a Point due to Bones Influence

According to the table, the final position of a point influenced by the bones is calculated based on two terms: A free movement of the point plus a bone drive movement. In this section we are going to calculate the second term.

where i is a index that runs all the Bones Influence ID from i=1 to N (N= total number of bones that influence to the point)

where 'j' runs the bone skeleton jumping from a child/parent bone to a parent/child bone each time. The travel of the index 'j' from root to i and from i to root is fixed -and unique- by the nature of skeletons constructions (a bone, a parent), as mentioned before.

This matrix calculates the position of the point in local coordinates in relation to the bone 'j' at setup position. Notice that is equal to for any bone and for any time.

This matrix calculates the global position of the point due to the bone 'j' at animated position of the skeleton.

Calculate the position and angle of a bone in a skeleton

Position and Angle at Setup

If the bones are described using relative coordinates to its predecessor, the position and the angle of the bone 'j' in relation to the "master root bone" (ie. the global coordinate system) is given by those equations:

where

where 'i' goes form the root bone to the parent of the bone 'j' and climbs down by one child each time until it reaches the 'parent of bone j' bone of the skeleton.

is the inverse matrix transformation of the position of the bone relative to its immediate parent.

Notice that at setup, is always equal to 1.

Animated Position and Angle

Once calculated the position and angle of a bone in global coordinates you can calculate its animated position and angle by the transformation of their parents in the skeleton.

where

where 'i' goes form the parent bone and jumps up by one parent each time until it reaches the 'root' bone of the bone 'j'.

is the transformation matrix of the position of the bone 'j' at the time t.

The results are obtained in global coordinates.