Data Annotator (Arabic) – Remote, $11/hr

About the role

We are looking for an Arabic‑speaking Data Annotator to support the evaluation of large‑language‑model (LLM) outputs. The role is fully remote and paid at $11 per hour on a short‑term contract.

Key responsibilities

• Design multi‑turn conversational prompts that incorporate personal context.
• Evaluate AI‑generated responses for relevance, grounding, helpfulness and correct use of personal data.
• Perform side‑by‑side comparisons and rank AI responses.
• Identify grounding errors, poor inferences and forced personalization.
• Write clear, structured rationales referencing specific conversation turns.
• Extract and verify model debug information and data source usage.
• Maintain data hygiene by deleting evaluation conversations after review.

Required profile

• Fluent in Arabic (reading and writing).
• Experience in data annotation, AI quality evaluation, content moderation or a related analytical role.
• Strong analytical thinking and attention to detail.
• Ability to assess nuanced and ambiguous AI responses.
• BS/BA degree or equivalent experience in an analytical field.
• Excellent written communication and structured feedback skills.
• Self‑motivated, able to work independently with full‑time availability and a 4‑hour overlap with Pacific Standard Time.
• Reliable computer and stable internet connection.

Required skills

• Arabic language proficiency.

What we offer

• Short‑term (2‑month) contract with immediate start.
• Fully remote work with flexible schedule.
• Compensation at $11 per hour.