CVAT Overview
CVAT is an enterprise-grade platform for managing high-quality visual datasets for computer vision applications. It offers advanced tools for image, video, and 3D annotation, built-in quality assurance (QA), automation, and secure team collaboration.
Backed by an active open-source community with over 14,500 GitHub stars and trusted by hundreds of organizations worldwide, CVAT helps organizations streamline data labeling for faster, more accurate model development.
CVAT comes in three editions: CVAT Community, CVAT Online, and CVAT Enterprise.
- CVAT Community is the free, self-hosted version with core functionality.
- CVAT Online is the SaaS edition with three pricing tiers (Free, Solo, Team).
- CVAT Enterprise is a self-hosted, premium version with enhanced security.
Tools and formats
CVAT stands as a comprehensive tool for image and video annotation, essential for various computer vision tasks.
It emphasizes user-friendliness, adaptability, and compatibility with a range of formats and tools.
Supported formats
CVAT’s supports the following formats:
- 3D:
.pcd,.bin - Image: everything supported by the Python
Pillow library,
including formats like
JPEG,PNG,BMP,GIF,PPMandTIFF. - Video: all formats, supported by ffmpeg, including
MP4,AVI, andMOV.
For annotation export and import formats, see Export annotations and data from CVAT
Annotation tools
CVAT offers a wide range of annotation tools, each catering to different aspects of image and video labeling:
| Annotation Tool | Use Cases |
|---|---|
| 3D Object Annotation | Ideal for projects that require depth perception and volume estimation, like autonomous vehicle training. |
| Attribute Annotation Mode | Useful for adding detailed information to objects, like color, size, or other specific characteristics. |
| Annotation with Rectangles | Best for simple object detection where objects have a box-like shape, such as detecting windows in a building. |
| Annotation with Polygons | Suited for complex shapes in images, like outlining geographical features in maps or detailed product shapes. |
| Annotation with Polylines | Great for annotating linear objects like roads, pathways, or limbs in pose estimation. |
| Annotation with Ellipses | Ideal for objects like plates, balls, or eyes, where a circular or oval annotation is needed. |
| Annotation with Cuboids | Useful for 3D objects in 2D images, like boxes or furniture in room layouts. |
| Annotation with Skeletons | Ideal for human pose estimation, animation, and movement analysis in sports or medical fields. |
| Annotation with Brush Tool | Perfect for intricate and detailed annotations where precision is key, such as in medical imaging. |
| Annotation with Tags | Useful for image and video classification tasks, like identifying scenes or themes in a dataset. |
These tools make CVAT a versatile platform for a range of annotation needs, from basic labeling to complex, multidimensional tasks in advanced computer vision projects.
Automated labeling
CVAT has an automated labeling features, enhancing the annotation process significantly, potentially speeding it up by up to 10 times.
Note
For more information, see OpenCV and AI ToolsBelow is a detailed table of the supported algorithms and the platforms they operate on:
| Algorithm Name | Category | Framework | CPU Support | GPU Support |
|---|---|---|---|---|
| Segment Anything | Interactor | PyTorch | ✔️ | ✔️ |
| Deep Extreme Cut | Interactor | OpenVINO | ✔️ | |
| Faster RCNN | Detector | OpenVINO | ✔️ | |
| Mask RCNN | Detector | OpenVINO | ✔️ | |
| YOLO v3 | Detector | OpenVINO | ✔️ | |
| YOLO v7 | Detector | ONNX | ✔️ | ✔️ |
| Object Reidentification | ReID | OpenVINO | ✔️ | |
| Semantic Segmentation for ADAS | Detector | OpenVINO | ✔️ | |
| Text Detection v4 | Detector | OpenVINO | ✔️ | |
| SiamMask | Tracker | PyTorch | ✔️ | ✔️ |
| TransT | Tracker | PyTorch | ✔️ | ✔️ |
| Inside-Outside Guidance | Interactor | PyTorch | ✔️ | |
| Faster RCNN | Detector | TensorFlow | ✔️ | ✔️ |
| RetinaNet | Detector | PyTorch | ✔️ | ✔️ |
| Face Detection | Detector | OpenVINO | ✔️ |
Useful links
Start here if you’re unsure where to begin with CVAT.
CVAT Online
| Name | Description |
|---|---|
| Annotation tools | This comprehensive guide covers all CVAT tools available for work. It includes descriptions of all available tools, quality control methods, and procedures for importing and exporting data. This manual is relevant for both CVAT Online and Self-Hosted versions. |
| CVAT Complete Workflow Guide for Organizations | This guide provides a comprehensive overview of using CVAT for collaboration in organizations. |
| Subscription Management | Learn how to choose a plan, subscribe, and manage your subscription effectively. |
| XML Annotation Format | Detailed documentation on the XML format used for annotations in CVAT essential for understanding data structure and compatibility. |
CVAT Community and Enterprise
| Name | Description |
|---|---|
| Self-hosted Installation Guide | Start here to install self-hosted solution on your premises. |
| Dataset Management Framework | Specifically for the Self-Hosted version, this framework and CLI tool are essential for building, transforming, and analyzing datasets. |
| Server API | The CVAT server offers a HTTP REST API for interactions. This section explains how client applications, whether they are command line tools, browsers, or scripts, interact with CVAT through HTTP requests and responses. |
| Python SDK | The CVAT SDK is a Python library providing access to server interactions and additional functionalities like data validation and serialization. |
| Command Line Tool | This tool offers a straightforward command line interface for managing CVAT tasks. Currently featuring basic functionalities, it has the potential to develop into a more advanced administration tool for CVAT. |
| XML Annotation Format | Detailed documentation on the XML format used for annotations in CVAT essential for understanding data structure and compatibility. |
| AWS Deployment Guide | A step-by-step guide for deploying CVAT on Amazon Web Services, covering all necessary procedures and tips. |
| Frequently Asked Questions | This section addresses common queries and provides helpful answers and insights about using CVAT. |
Integrations
CVAT is a global tool, trusted and utilized by teams worldwide. Below is a list of key companies that contribute significantly to our product support or are an integral part of our ecosystem.
Note
If you want to integrate CVAT with other MLOps tools, we’d love to hear from you at contact@cvat.ai.| Integrated Service | Available In | Description |
|---|---|---|
| Human Protocol | Online and Self-hosted | Incorporates CVAT to augment annotation services within the Human Protocol framework, enhancing its capabilities in data labeling. |
| FiftyOne | Online and Self-hosted | An open-source tool for dataset management and model analysis in computer vision, FiftyOne is closely integrated with CVAT to enhance annotation capabilities and label refinement. |
| Hugging Face & Roboflow | Online | In CVAT Online, models from Hugging Face and Roboflow can be added to enhance computer vision tasks. For more information, see Integration with Hugging Face and Roboflow |
License Information
CVAT includes the following licenses:
| License Type | Applicable To | Description |
|---|---|---|
| MIT License | Self-hosted | This code is distributed under the MIT License, a permissive free software license that allows for broad use, modification, and distribution. |
| LGPL License (FFmpeg) | Online and Self-hosted | Incorporates LGPL-licensed components from the FFmpeg project. Users should verify if their use of FFmpeg requires additional licenses. CVAT.ai Corporation does not provide these licenses and is not liable for any related licensing fees. |
| Commercial License | Self-hosted Enterprise | For commercial use of the Enterprise solution of CVAT, a separate commercial license is applicable. This is tailored for businesses and commercial entities. |
| Terms of Use | Online and Self-hosted | Outlines the terms of use and confidential information handling for CVAT. Important for understanding the legal framework of using the platform. |
| Privacy Policy | Online | Our Privacy Policy governs your visit to https://cvat.ai and your use of https://app.cvat.ai, and explains how we collect, safeguard and disclose information that results from your use of our Service. |
Get in touch
To get in touch, use one of the following channels:
| Type of inquiry | Applicable to | Description |
|---|---|---|
| Commercial Inquiries | CVAT Online, CVAT Enterprise, Labeling Services | Request a quote for CVAT Enterprise, CVAT Online Team subscription or order our labeling services. |
| General Inquiries | All products and services | Reach out to discuss partnership, co-marketing or investment opportunities with CVAT team. |
| CVAT Online Customer Support | CVAT Online (Pro and Team plans) | Chat with us about product support, resolve billing questions, or provide feedback. |
| CVAT Community Customer Support | CVAT Community | Report a bug or submit a feature request in out GitHub repository. |