This is the multi-page printable view of this section. Click here to print.

Return to the regular view of this page.

Annotation modes

Overview of editor-level modes in CVAT and how they affect the annotation workflow.

CVAT provides several editor-level modes that change how the annotation workspace behaves. These modes control what actions are available to the user, which tools can be used, and how objects can be created or modified.

Use this section to understand when to switch modes and how each mode supports a specific step of the annotation workflow.

1 - Single shape

Guide to annotating tasks using Single Shape mode

The CVAT Single Shape annotation mode accelerates the annotation process and enhances workflow efficiency for specific scenarios.

By using this mode you can label objects with a chosen annotation shape and label when an image contains only a single object. By eliminating the necessity to select tools from the sidebar and facilitating quicker navigation between images without the reliance on hotkeys, this feature makes the annotation process significantly faster.

See:

Single Shape mode annotation interface

A set of controls in the interface of the Single Shape annotation mode may vary depending on different settings.

Images below displays the complete interface, featuring all available fields; as mentioned above, certain fields may be absent depending on the scenario.

For instance, when annotating with rectangles, the Number of points field will not appear, and if annotating a single class, the Labels selector will be omitted.

To access Single Shape mode, open the job, navigate to the top right corner, and from the drop-down menu, select Single Shape.

Single Shape Annotation Mode Interface

The interface will be different if the shape type was set to Any in the label Constructor:

Single Shape Annotation Mode Interface

The Single Shape annotation mode has the following fields:

Feature Explanation
Prompt for Shape and Label Displays the selected shape and label for the annotation task, for example: “Annotate cat on the image using rectangle”.
Skip Button Enables moving to the next frame without annotating the current one, particularly useful when the frame does not have anything to be annotated.
List of Hints Offers guidance on using the interface effectively, including:
- Click Skip for frames without required annotations.
- Hold the Alt button to avoid unintentional drawing (e.g. when you want only move the image).
- Use the Ctrl+Z combination to undo the last action if needed.
- Use the Esc button to completely reset the current drawing progress.
Label selector Allows for the selection of different labels (cat, or dog in our example) for annotation within the interface.
Label type selector A drop-down list to select type of the label (rectangle, ellipse, etc). Only visible when the type of the shape is Any.
Options to Enable or Disable Provides configurable options to streamline the annotation process, such as:
- Automatically go to the next frame.
- Automatically save when finish.
- Navigate only empty frames.
- Predefined number of points - Specific to polyshape annotations, enabling this option auto-completes a shape once a predefined number of points is reached. Otherwise, pressing N is required to finalize the shape.
Number of Points Applicable for polyshape annotations, indicating the number of points to use for image annotation.

Annotating in Single Shape mode

To annotate in Single Shape mode, follow these steps:

  1. Open the job and switch to Single Shape mode.
  2. Annotate the image based on the selected shape. For more information on shapes, see Annotation Tools.
  3. (Optional) If the image does not contain any objects to annotate, click Skip at the top of the right panel.
  4. Submit your work.

Query parameters

Also, we introduced additional query parameters, which you may append to the job link, to initialize the annotation process and automate workflow:

Query Parameter Possible Values Explanation
defaultWorkspace Workspace identifier (e.g., single_shape, tags, review, attributes) Specifies the workspace to be used initially, streamlining the setup for different annotation tasks.
defaultLabel A string representation of a label (label name) Sets a default label for the annotation session, facilitating consistency across similar tasks.
defaultPointsCount Integer - number of points for polyshapes Defines a preset number of points for polyshape annotations, optimizing the annotation process.

You can combine these parameters to customize the workspace for an annotator, for example:

/tasks/<tid>/jobs/<jid>?defaultWorkspace=single_shape&defaultLabel=dog&defaultPointsCount=10

Will open the following job:

Query Example

Video tutorial

For a better understanding of how Single Shape mode operates, we recommend watching the following tutorial.

2 - Attribute annotation mode

Usage examples and basic operations available in attribute annotation mode.
  • In this mode, you can edit attributes with fast navigation between objects and frames using a keyboard. Open the drop-down list in the top panel and select Attribute annotation.

    User interface with opened menu for changing annotation mode

  • In this mode, objects panel change to a special panel:

    Object panel interface in attribute annotation mode with marked elements

  • The active attribute will be red. In this case, it is gender. Look at the bottom side panel to see all possible shortcuts for changing the attribute. Press key 2 on your keyboard to assign a value (female) for the attribute or select from the drop-down list.

    Example of assigning an attribute value in objects sidebar

  • Press Up Arrow/Down Arrow on your keyboard or select the buttons in the UI to go to the next/previous attribute. In this case, after pressing Down Arrow you will be able to edit the Age attribute.

    Example of selecting an attribute value in objects sidebar with keyboard

  • Use Right Arrow/Left Arrow keys to move to the previous/next image with annotation.

To display all the hot keys available in the attribute annotation mode, press F2.

It is possible to handle lots of objects on the same frame in the mode.

Example of user interface in attribute annotation mode

It is more convenient to annotate objects of the same type. In this case you can apply the appropriate filter. For example, the following filter will hide all objects except person: label=="Person".

To navigate between objects (person in this case), use the following buttons switch between objects in the frame on the special panel:

Panel for attribute annotation with marked options and parameters

or shortcuts:

  • Tab — go to the next object
  • Shift+Tab — go to the previous object.

In order to change the zoom level, go to settings (press F3) in the workspace tab and set the value Attribute annotation mode (AAM) zoom margin in px.

3 - 3D object annotation

Overview of basic operations available when annotating 3D objects.

Use the 3D Annotation tool for labeling 3D objects and scenes, such as vehicles, buildings, landscapes, and others.

Check out:

The 3D annotation canvas looks like the following:

3D canvas

For information on the available tools, consult Controls sidebar.

You can navigate, using the mouse, or navigation keys:

Navigation keys used in 3D annotation

You can also use keyboard shortcuts to navigate:

Action Keys
Camera rotation Shift + Arrow (Up, Down, Left, Right)
Left/Right Alt+J/ Alt+L
Up/down Alt+U/ Alt+O
Zoom in/ou Alt+K/ Alt+I

Annotation with cuboids

There are two options available for 3D annotation:

  • Shape: for tasks like object detection.
  • Track: uses interpolation to predict the position of objects in subsequent frames. A unique ID will be assigned to each object and maintained throughout the sequence of images.

Annotation with shapes

To add a 3D shape:

  1. On the objects pane, select Draw new cuboid > select the label from the drop-down list > Shape.

    Opened &ldquo;Draw new cuboid&rdquo; window

  2. The cursor will be followed by a cuboid. Place the cuboid on the 3D scene.

    Example of placing cuboid on a 3D scene

  3. Use projections to adjust the cuboid. Click and hold the left mouse button to edit the label shape on the projection.

    Example of a cuboid adjustment with projections

  4. (Optional) Move one of the four points to change the size of the cuboid.

    Example of a cuboid size change using cuboid points

  5. (Optional) To rotate the cuboid, select the middle point and then drag the cuboid up/down or to left/right.

    Example of a cuboid rotation using cuboid middle point

Tracking with cuboids

To track with cuboids:

  1. On the objects pane, select Draw new cuboid > select the label from the drop-down list > Track.

  2. The cursor will be followed by a cuboid. Place the cuboid on the 3D scene.

  3. Use projections to adjust the cuboid. Select and hold the left mouse button to edit the label shape on the projection.

    Adjusting cuboid

  4. (Optional) Move one of the four points to change the size of the cuboid.

    Moving cuboid

  5. (Optional) To rotate the cuboid, click on the middle point and then drag the cuboid up/down or to left/right.

    Rotating cuboid

  6. Move several frames forward. You will see the cuboid you’ve added in frame 1. Adjust it, if needed.

  7. Repeat to the last frame with the presence of the object you are tracking.

For more information about tracking, consult Track mode.

As well as 2D-task objects, 3D-task objects support the ability to change appearance, attributes, properties and have an action menu. Read more in objects sidebar section.

Moving an object

If you hover the cursor over a cuboid and press Shift+N, the cuboid will be cut, so you can paste it in other place (double-click to paste the cuboid).

Copying

As well as in 2D task you can copy and paste objects by Ctrl+C and Ctrl+V, but unlike 2D tasks you have to place a copied object in a 3D space (double click to paste).

Example of copying a cuboid and placing the copy in 3D space

Image of the projection window

You can copy or save the projection-window image by left-clicking on it and selecting a “save image as” or “copy image”.

Cuboid orientation

The feature enables or disables the display of cuboid orientation arrows in the 3D space. It is controlled by a checkbox located in the appearance block. When enabled, arrows representing the cuboid’s axis orientation (X - red, Y - green, Z - blue) are displayed, providing a visual reference for the cuboid’s alignment within the 3D environment. This feature is useful for understanding the spatial orientation of the cuboid.

User interface with cuboid projections and orientation elements

Cuboid size input

The size input feature allows users to manually specify the dimensions of a cuboid in the 3D space. This feature is accessible through the objects sidebar - details panel, where you can input precise values for the width, height, and length (X - width, Y - height, Z - length) of the cuboid. By entering these values, the cuboid’s size is adjusted accordingly to its orientation, providing greater control and accuracy when annotating objects in 3D tasks.

Example of changing a cuboid size using input fields in sidebar

4 - Annotation with tags

It is used to annotate frames, tags are not displayed in the workspace. Before you start, open the drop-down list in the top panel and select Tag annotation.

Open drop-down list with highlighted &ldquo;Tag annotation&rdquo; option

The objects sidebar will be replaced with a special panel for working with tags. Here you can select a label for a tag and add it by clicking on the Plus button. You can also customize hotkeys for each label.

Panel for tag annotation with marked options and parameters

If you need to use only one label for one frame, then enable the Automatically go to the next frame checkbox, then after you add the tag the frame will automatically switch to the next.

Tags will be shown in the top left corner of the canvas. You can show/hide them in the settings.

Example of tag labels on an annotation