Video annotation applies various methods to extract spatial and temporal data between frames. Popular forms are:
Bounding Boxes – Rectangular bounding boxes that are drawn around objects to identify and follow them over time (e.g., recognizing surgical instruments or tracking the movement of patients).
Polygons – More accurate boundary descriptions used for objects with irregular shapes, enabling fine-grained segmentation of organs, lesions, or instruments.
Keypoints – Joint-specific markers or anatomical landmarks (e.g., knee, shoulder) utilized in pose estimation and motion analysis.
Semantic Segmentation – Pixel-wise labeling of every region in each frame to identify tissues, organs, or surgical areas.
Activity Labeling – Sequences annotated according to actions or behaviors (e.g., walking, suturing, or patient distress).
Object Tracking – Preserving object identity through frames to trace its path and interactions over time, essential for robotics and behavioral studies.