Remote Data Labeling Jobs in Warsaw

About The Role

Rex.zone is hiring for full-time, fully remote data labeling and evaluation roles supporting AI/ML development. You will create and validate labeled datasets used in NLP, computer vision annotation, content safety labeling, and LLM training pipelines, with a strong emphasis on training data quality and annotation guidelines compliance.

What You Will Do

• Execute text annotation tasks (classification, named entity recognition) and multimodal labeling (image/video/audio)
• Perform rubric-based large language model evaluation, including prompt evaluation and response grading
• Complete RLHF-style preference tasks (pairwise ranking, rationale capture) aligned to evaluation rubrics
• Run QA evaluation workflows (spot checks, gold set validation, sampling audits, disagreement analysis)
• Document edge cases, flag policy/privacy issues, and support content safety labeling escalations
• Collaborate asynchronously with project leads to clarify guidelines and improve dataset consistency

Requirements

• Mid-senior experience in data annotation, data labeling, or evaluation work with measurable quality targets
• Strong attention to detail and ability to interpret and follow annotation guidelines
• Familiarity with QA evaluation concepts (gold data, audits, disagreement analysis)
• Comfort working full-time remote with reliable connectivity and secure work practices

Compensation

$30--$50 per hour (USD), HOURLY , base salary, depending on skills alignment and evaluation complexity.

How To Apply

Apply via Rex.zone and highlight experience with data labeling, RLHF, prompt evaluation, QA evaluation, and training data quality.