Labeling quality assessment
Features
Monitoring the performance of labelers
Real time results analysis
Task management
Results management
Exporting the labeling results in convenient machine-readable formats:
Data Types
Task
Define the main sentiment of the text and choose the appropriate option
Task
Select one from the proposed options and click confirm
Task
Read the text. Click on one of the NER options, then select a portion of the
text
Task
Select one of the two statements and press confirm
Task
Read the text. Select one or several points from the offered options and
press confirm
Task
Select one from the proposed options and click confirm
Task
Select one or more of the suggested options and click confirm
Task
Select one from the proposed options and click confirm
Task
Select a marker and mark key points on the image, define borders with
polygons
Task
Select a marker and mark key points on the image
Task
Select a marker and mark the desired object on the image with a rectangle
Task
Listen to the audio, select one from the proposed options and press confirm
Task
Click on the player button, listen to the audio and enter a description in
the ‘Description’ field
Task
Listen to the audio, mark the checkbox, and then mark an area on the track
field.
Markup on a turn-key
Random people working for pennies with low quality
scores
VS
Experienced professionals
+
Official work under contract
+
Compliance with privacy requirements
Do not entrust your data to random people
Labeling pipeline
Prepare your
data in JSON
data in JSON
Select a task type
Set a title and
description for the task
description for the task
Download labeled
data in json /csv/xls
format
data in json /csv/xls
format
Activate task
Create guidelines
for labelers and set
up automated
quality control
for labelers and set
up automated
quality control
Don’t trust your data to anyone?
Organize the labelling process with your team
Create a personal account for each curator and users
who report to them
Label data and enjoy automatic quality control
You can install a standalone studio module on the
company’s servers under a license agreement
Pricing
Purchase a license
- On premise per server – 2 mln rubles
- Cloud solution – 1 ruble per task
By installing Machinist studio on your server, you get the ability to label data without time
limit and the number of tasks
Turn-key labelling
- Single choice – 7 rubles per task
- Multiple choice – 12 rubles per task
Experts recommend labelling at least 1000 tasks per dataset, but no more than 50,000 tasks for one
type of object
type of object
Model Training Services
Dataset collection
Model training
Model Integration