Creating an annotation task
-
Create an annotation task pressing
Create new task
button on the tasks page or on the project page. -
Specify parameters of the task:
Basic configuration
Name
The name of the task to be created.
Projects
The project that this task will be related with.
Labels
There are two ways of working with labels (available only if the task is not related to the project):
-
The
Constructor
is a simple way to add and adjust labels. To add a new label click theAdd label
button.You can set a name of the label in the
Label name
field and choose a color for each label.If necessary you can add an attribute and set its properties by clicking
Add an attribute
:The following actions are available here:
- Set the attribute’s name.
- Choose the way to display the attribute:
- Select — drop down list of value
- Radio — is used when it is necessary to choose just one option out of few suggested.
- Checkbox — is used when it is necessary to choose any number of options out of suggested.
- Text — is used when an attribute is entered as a text.
- Number — is used when an attribute is entered as a number.
- Set values for the attribute. The values could be separated by pressing
Enter
. The entered value is displayed as a separate element which could be deleted by pressingBackspace
or clicking the close button (x). If the specified way of displaying the attribute is Text or Number, the entered value will be displayed as text by default (e.g. you can specify the text format). - Checkbox
Mutable
determines if an attribute would be changed frame to frame. - You can delete the attribute by clicking the close button (x).
Click the
Continue
button to add more labels. If you need to cancel adding a label - press theCancel
button. After all the necessary labels are added click theDone
button. After clickingDone
the added labels would be displayed as separate elements of different colour. You can edit or delete labels by clickingUpdate attributes
orDelete label
. -
The
Raw
is a way of working with labels for an advanced user. Raw presents label data in json format with an option of editing and copying labels as a text. TheDone
button applies the changes and theReset
button cancels the changes.
In
Raw
andConstructor
mode, you can press theCopy
button to copy the list of labels.Select files
Press tab
My computer
to choose some files for annotation from your PC. If you select tabConnected file share
you can choose files for annotation from your network. If you selectRemote source
, you’ll see a field where you can enter a list of URLs (one URL per line). If you upload a video or dataset with images and selectUse cache
option, you can attach amanifest.jsonl
file. You can find how to prepare it here.Data formats for a 3D task
To create a 3D task, you need to use the following directory structures:
VELODYNE FORMAT Structure: velodyne_points/ data/ image_01.bin IMAGE_00 # unknown dirname, Generally image_01.png can be under IMAGE_00, IMAGE_01, IMAGE_02, IMAGE_03, etc data/ image_01.png
3D POINTCLOUD DATA FORMAT Structure: pointcloud/ 00001.pcd related_images/ 00001_pcd/ image_01.png # or any other image
3D, DEFAULT DATAFORMAT Option 1 Structure: data/ image.pcd image.png
3D, DEFAULT DATAFORMAT Option 2 Structure: data/ image_1/ image_1.pcd context_1.png # or any other name context_2.jpg
Advanced configuration
Use zip chunks
Force to use zip chunks as compressed data. Actual for videos only.
Use cache
Defines how to work with data. Select the checkbox to switch to the “on-the-fly data processing”, which will reduce the task creation time (by preparing chunks when requests are received) and store data in a cache of limited size with a policy of evicting less popular items. See more here.
Image Quality
Use this option to specify quality of uploaded images. The option helps to load high resolution datasets faster. Use the value from
5
(almost completely compressed images) to100
(not compressed images).Overlap Size
Use this option to make overlapped segments. The option makes tracks continuous from one segment into another. Use it for interpolation mode. There are several options for using the parameter:
- For an interpolation task (video sequence). If you annotate a bounding box on two adjacent segments they will be merged into one bounding box. If overlap equals to zero or annotation is poor on adjacent segments inside a dumped annotation file, you will have several tracks, one for each segment, which corresponds to the object.
- For an annotation task (independent images). If an object exists on overlapped segments, the overlap is greater than zero and the annotation is good enough on adjacent segments, it will be automatically merged into one object. If overlap equals to zero or annotation is poor on adjacent segments inside a dumped annotation file, you will have several bounding boxes for the same object. Thus, you annotate an object on the first segment. You annotate the same object on second segment, and if you do it right, you will have one track inside the annotations. If annotations on different segments (on overlapped frames) are very different, you will have two shapes for the same object. This functionality works only for bounding boxes. Polygons, polylines, points don’t support automatic merge on overlapped segments even the overlap parameter isn’t zero and match between corresponding shapes on adjacent segments is perfect.
Segment size
Use this option to divide a huge dataset into a few smaller segments. For example, one job cannot be annotated by several labelers (it isn’t supported). Thus using “segment size” you can create several jobs for the same annotation task. It will help you to parallel data annotation process.
Start frame
Frame from which video in task begins.
Stop frame
Frame on which video in task ends.
Frame Step
Use this option to filter video frames. For example, enter
25
to leave every twenty fifth frame in the video or every twenty fifth image.Chunk size
Defines a number of frames to be packed in a chunk when send from client to server. Server defines automatically if empty.
Recommended values:
- 1080p or less: 36
- 2k or less: 8 - 16
- 4k or less: 4 - 8
- More: 1 - 4
Dataset Repository
URL link of the repository optionally specifies the path to the repository for storage (
default: annotation / <dump_file_name> .zip
). The .zip and .xml file extension of annotation are supported. Field format:URL [PATH]
example:https://github.com/project/repos.git [1/2/3/4/annotation.xml]
Supported URL formats :
https://github.com/project/repos[.git]
github.com/project/repos[.git]
git@github.com:project/repos[.git]
The task will be highlighted in red after creation if annotation isn’t synchronized with the repository.
Use LFS
If the annotation file is large, you can create a repository with LFS support.
Issue tracker
Specify full issue tracker’s URL if it’s necessary.
Push
Submit
button and it will be added into the list of annotation tasks. Then, the created task will be displayed on a tasks page: -
-
The tasks page contains elements and each of them relates to a separate task. They are sorted in creation order. Each element contains: task name, preview, progress bar, button
Open
, and menuActions
. Each button is responsible for a in menuActions
specific function:Dump Annotation
andExport as a dataset
— download annotations or annotations and images in a specific format. The following formats are available:- CVAT for video is highlighted if a task has the interpolation mode.
- CVAT for images is highlighted if a task has the annotation mode.
- PASCAL VOC
- (VOC) Segmentation mask — archive contains class and instance masks for each frame in the png format and a text file with the value of each color.
- YOLO
- COCO
- TFRecord
- MOT
- LabelMe 3.0
- Datumaro
- Point Cloud Format 1.0 (Available in 3d task)
- Velodyn points format 1.0 (Available in 3d task)
Upload annotation
is available in the same formats as inDump annotation
.- CVAT accepts both video and image sub-formats.
- Point Cloud Format 1.0 (Available in 3d task)
- Velodyn points format 1.0 (Available in 3d task)
Automatic Annotation
— automatic annotation with OpenVINO toolkit. Presence depends on how you build CVAT instance.Export task
— Export a task into a zip archive. Read more in the export/import a task section.Move to project
— Moving the task to the project (can be used to move a task from one project to another). Note that attributes reset during the moving process. In case of label mismatch, you can create or delete necessary labels in the project/task. Some task labels can be matched with the target project labels.Delete
— delete task.
Push Open
button to go to task details.