Jobs/Data Engineer - AI Model Evaluator
M

Data Engineer - AI Model Evaluator

mercor Verified
Compensation TransparencyStated CTC: Competitive Global Remote Compensation (Official)
Disclosed on Official ATS Application

Exact salary band and monthly in-hand breakdown will be confirmed during the ATS technical evaluation.

Stipend / SalaryCompetitive Global Remote Compensation (Official)
Work ModeREMOTE
Experience2+ yrs
Posted3d ago
Verified Direct Role: Clicking "Apply on Official Site" opens mercor's official careers portal directly without middleman aggregators.
Share opening:
Job Snapshot & Verified Telemetry
  • Target Role:Data Engineer - AI Model Evaluator
  • Employer:mercor
  • Work Mode:REMOTE
  • Location:India
  • Compensation:Competitive Global Remote Compensation (Official)
  • Experience:2+ Years
  • Recruiter SLA:7-Day Truth Teller Guarantee
  • Candidate Fee:₹0 (Zero Placement Fee Guarantee)
Required Competencies:Software EngineeringProblem SolvingSystem Architecture
Apply on mercor

Privacy-First ATS Fit Score

Instant ATS MatcherDPDP Act 2023

Local in-browser ATS scoring with 0ms latency and zero data leakage. 1-click tailored STAR bullets.

Ready to Match
Click AI Match

About the Role

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data Engineer (Coding Agent Experience) Type: Contract Compensation: $80/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review model-generated implementations involving ETL pipelines , data warehouses , analytics platforms , and distributed data systems . Identify bugs, edge cases, scalability issues, and failure modes in model outputs. Compare outputs from multiple frontier models and assess their strengths and weaknesses. Apply professional engineering judgment to realistic data engineering scenarios. Qualifications Must-Have 2+ years of professional data engineering experience. Experience building ETL pipelines , data warehouses , analytics platforms , or distributed data systems . Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools. Ability to evaluate model-generated data infrastructure and pipeline implementations. Preferred Experience operating large-scale data platforms . Compensation & Legal $400 per accepted task . Compensation is tied to accepted work. Application Process (Takes 20–30 mins to complete) Upload resume AI interview based on your resume Submit form Resources & Support For details about the interview process and platform information, please check: For any help or support, reach out to: PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity. Originally posted on Himalayas

Requirements & Qualifications

  • Strong problem solving foundations, knowledge of modern engineering practices, and interest in technology systems.

Perks & Benefits

  • Official mentor support
  • verified hiring timeline
  • and career progression.
Required Tech Stack3 Skills

The employer seeks candidates proficient in the following core technologies:

Software EngineeringProblem SolvingSystem Architecture
Free Learning Guides:

AI Interview Prep

Practice 5 targeted questions tailored to Data Engineer - AI Model Evaluator and the required tech stack before you apply.

Generate Interview Questions
25-APPLICANT RULEEarly Bird Review

Enterprise ATS telemetry shows 80% of interview callbacks go to the first 25 verified candidates before candidate volume overflows.

Want 0-delay Telegram alerts when fresh roles drop?

Invite 2 batchmates via /bounties (unlocks 14 Days Free Pro) to activate real-time Telegram pings via @rolenest_job_bot.

Corporate Ghosting & Transparency Index

Authentic recruiter turnaround and OA difficulty metrics activate once ≥5 verified reports are logged.

Telemetry Calibrating
Telemetry Calibrating (n < 5)

RoleNest requires at least 5 verified candidate applications before publishing median response turnaround and ghosting rates for mercor.

• Verified Submissions: 0 / 5• 7-Day Ghosting SLA Active• Direct ATS Verified
Expected Assessment Topics:Crowdsourced
LeetCode Medium (Graph Traversal, Matrix Math, Optimizations)Vector Search Pipeline & Batch Inference Architecture

Applied to mercor? Share your timeline to earn +50 XP and keep Indian tech hiring transparent.

Verified Direct Application Link

Official position sourced directly from mercor's verified career portal.

Application SourceOfficial EXTERNAL Portal
Company VerificationVerified Employer
Middleman TrapsNone (Direct Employer ATS)
Candidate Fees₹0 (Zero Placement Fee Guarantee)
Dashboard Tracking1-Click Submission & Reminders
Truth Teller Candidate Tracking

Apply directly on mercor's portal using the link above. Use "Track with Truth Teller" to log your submission timestamp and automated 7-day follow-up countdown in your dashboard.

Frequently Asked Questions & Verified Hiring Insights

Clear, transparent answers for applicants & AI answer engines

How do I apply for Data Engineer - AI Model Evaluator at mercor?▼

Click "Apply on Official Site" on this page to be routed directly to mercor's official applicant tracking system (EXTERNAL). RoleNest connects you directly with ₹0 candidate fees and activates automated 7-day follow-up telemetry in your dashboard.

What is the compensation or stipend for this role?▼

The verified package for this role is Competitive Global Remote Compensation (Official) (REMOTE). RoleNest enforces transparent compensation benchmarking to eliminate guessing before candidates invest time in assessments.

Who is eligible to apply for this opening?▼

Engineers with 2+ years of experience proficient in Software Engineering, Problem Solving, System Architecture are encouraged to apply.

How does RoleNest Truth Teller protect applicants from ghosting?▼

Truth Teller tracks candidate application timestamps and recruiter response telemetry. If mercor does not update your application status within 7 business days, RoleNest provides polite, ATS-tailored follow-up email templates and highlights active matching roles to keep your momentum high.

Similar Tech OpportunitiesVerified Matches

Explore more remote roles matching your skills and experience level

Browse all jobs
Pragmatike logo
☀️ 9 AM DropPragmatikeVerifiedOfficial Career Portal

Research Engineer Privacy and Anonymization

REMOTECompetitive Global Remote Compensation (Official) Remote (Worldwide)
Software EngineeringProblem SolvingSystem Architecture
Match your resume against this role to unlock instant ATS score & stack gap analysis.
Upload Resume for Instant Browser ATS Match ⚡
🟢 20 / 25 Early Recruiter Review Slots Remaining — Apply before 11:00 AM5/25 Slots
Posted 5h ago•Official Career Link
Highstreet logo
☀️ 9 AM DropHighstreetVerifiedOfficial Career Portal

Oracle Cloud Solution Architect

REMOTECompetitive Global Remote Compensation (Official) India
Software EngineeringProblem SolvingSystem Architecture
Match your resume against this role to unlock instant ATS score & stack gap analysis.
Upload Resume for Instant Browser ATS Match ⚡
🟢 19 / 25 Early Recruiter Review Slots Remaining — Apply before 11:00 AM6/25 Slots
Posted 5h ago•Official Career Link
NVIDIA logo
☀️ 9 AM DropNVIDIAVerifiedOfficial Career Portal

Senior Network Infrastructure Engineer

REMOTECompetitive Global Remote Compensation (Official) India
Software EngineeringProblem SolvingSystem Architecture
Match your resume against this role to unlock instant ATS score & stack gap analysis.
Upload Resume for Instant Browser ATS Match ⚡
🟢 21 / 25 Early Recruiter Review Slots Remaining — Apply before 11:00 AM4/25 Slots
Posted 5h ago•Official Career Link
Nagarro logo
☀️ 9 AM DropNagarroVerifiedOfficial Career Portal

Associate Principal Engineer, Service Now(CMDB,ITOM,ITSM)

REMOTECompetitive Global Remote Compensation (Official) India
Software EngineeringProblem SolvingSystem Architecture
Match your resume against this role to unlock instant ATS score & stack gap analysis.
Upload Resume for Instant Browser ATS Match ⚡
🟢 19 / 25 Early Recruiter Review Slots Remaining — Apply before 11:00 AM6/25 Slots
Posted 5h ago•Official Career Link
⚡ 1-Tap Telegram Job Alerts0 Email Delay9 AM Digest + POTD Streaks

Tech hiring moves in minutes. Receive verified ATS job drops and daily coding streak reminders directly on your phone.

RoleNest Engineering Career Index

Explore Tech Jobs, Hubs & Authority Playbooks

Discover verified tech positions organized by engineering discipline, Indian tech park, and early-career criteria with direct company ATS links.

mercor
Data Engineer - AI Model Evaluator
mercor•Competitive Global Remote Compensation (Official)