Remote Data Annotator Jobs in Warsaw

Remote Data Annotator Jobs in Warsaw (Remote) Rex.zone is hiring for full-time remote data annotation roles focused on training-data creation and evaluation for AI/ML systems, including large language model (LLM) training pipelines and multimodal projects. You will produce high-quality labeled datasets by following detailed guidelines, auditing outputs, and surfacing edge cases that impact model performance.

What You Will Do

• Annotate and review text, images, and conversational data according to annotation guidelines
• Perform RLHF preference ranking and rubric-based comparative judgments
• Execute prompt evaluation and large language model evaluation to identify failure modes and quality issues
• Run QA evaluation checks for consistency, inter-annotator agreement, and training data quality
• Support named entity recognition (NER) and information extraction labeling
• Contribute to computer vision annotation (bounding boxes, polygons, keypoints, segmentation)
• Label content safety categories (policy violations, sensitive attributes, harmful content)
• Document edge cases, propose guideline clarifications, and communicate issues to project leads
• Follow secure data handling practices for privacy and restricted content

Required Qualifications

• Mid-Senior experience in data annotation, data labeling, QA evaluation, or AI data operations
• Comfort with rubric-based judgments, preference comparisons, and consistent decision-making
• Familiarity with RLHF evaluation, prompt evaluation, and LLM evaluation concepts
• Ability to work independently in a remote environment with reliable internet
• Clear written communication for documenting rationales and feedback

Compensation

Hourly base pay range: $30--$50 per hour (USD), depending on project scope, evaluation complexity, and QA responsibilities.