Annotating with 'sticky' light for remote guidance

As the stream of data containing the helper’s sketching is received, a ray is cast from the virtual camera location and the point of collision with any (currently tracked) virtual object is calculated. This ray represents the helper’s line of sight through the pen tip to the drawing point on the object. Successive surface collision points are used to create a 3D line set representing the helper’s annotation.