AI Evaluation & Annotation Specialist (Entry-Mid Level) – Japanese (USA)

Job role overview

  • Date posted

    May 6, 2026

  • Hiring location

    Salt Lake City

Description

Are you curious, detail-oriented, and excited about shaping the future of artificial intelligence?

We're looking for AI Evaluation & Annotation Specialists to help train and improve Large Language Models (LLMs). In this role, you'll review AI-generated responses, provide corrections, evaluate quality, and follow structured guidelines to ensure accuracy and consistency.

No engineering background required — if you enjoy problem-solving, analyzing language, and following structured tasks, this role is a great fit.

This is a hands-on, production-based role where accuracy, focus, and consistency matter.

What You'll Do

Review AI-generated responses and rate them for clarity, correctness, and relevance

Annotate and label content based on project-specific guidelines

Follow detailed written instructions and apply them consistently

Generate or evaluate prompts depending on assignment type

Work with QA Leads to apply feedback and continuously improve task quality

Report completed work daily and meet productivity and quality standards

What Makes You a Strong Fit

detail-oriented and enjoy accuracy-based work

You can follow instructions carefully and apply them consistently

You are comfortable working independently with minimal supervision

You have strong reading comprehension and critical thinking skills

You communicate clearly and respond to feedback professionally

Experience with annotation, evaluation, translation, linguistics, or QA is helpful, but not required — training and guidance is provided.

Schedule & Work Expectations
This role is aligned with specific QA and project schedules. You must be available during one of the below time windows depending on your language team:

Language
Shift Window (IST)
06:30–15:30 IST or 19:30–03:30 IST

Standard expectation: One consecutive 8-hour shift

Alternative: Two 4-hour shifts (both must fall fully within the allowed schedule)

Only logged, approved hours are paid

no paid holidays / no paid time off model.

Why Join

Work with a global team

Entry point into the growing AI and language technology industry

Exposure to real-world AI model training

Skill development in annotation, QA/evaluation, and structured AI tasks

This is a strong opportunity for those looking to grow within AI data work, linguistic evaluation, QA, or model training roles.

Compensation Range
Rates vary by language and experience level (L1/L2). Below are current approved ranges in USD:

$12.00 USD to $16.00 USD per hour

Requirements
All applicants are required to complete a short skills-based assessment as part of the selection process. This assessment is unpaid and is used solely to confirm eligibility and alignment with project quality standards. Completing the assessment does not guarantee selection; however, it is mandatory in order to be considered for this role.

Assessment Requirement

Fluency in Japanese, with strong written and verbal communication skills

Bachelor's degree in Linguistics, Computer Science, or a related field; or equivalent experience

Experience or interest in AI, Machine Learning, or data annotation preferred

Strong attention to detail and ability to work with complex data sets

Familiarity with translation and localization processes is an advantage

Ability to work independently and collaboratively in a fast-paced environment

Proficient in using Artificial Intelligence and data annotation tools, with a willingness to learn new technologies

#J-18808-Ljbffr

work mode

On-site

Interested in this job?

22 days left to apply

Apply now

Call employer
Apply now
Send message
Cancel