Engineering

AI Trainer (SWE) - Remote

YO AI Labs

  • United States
  • Contractor
  • 4 days ago
Apply for this role

About the role

Job Description: Machine Learning Engineer – AI Training & Model Evaluation

Role Type: Contractor
Location: Global (Fully Remote)
Time Commitment: 15+ Hours per Week
Schedule: Flexible

About the Role

We are seeking experienced Machine Learning Engineers with prior professional AI training or model evaluation experience to contribute to a project focused on improving advanced AI systems.

In this role, you will apply your machine learning expertise to develop challenging technical tasks, evaluate AI-generated outputs, identify model failures, and establish objective standards for technical accuracy. This opportunity is intended for professionals who have already completed substantial AI training, benchmarking, or model evaluation work.

Key Responsibilities

  • Create realistic machine learning engineering tasks that challenge advanced AI models.
  • Develop detailed task instructions, reproducible environments, reference solutions, and evaluation criteria.
  • Evaluate AI-generated code, experiments, analyses, and technical deliverables.
  • Identify technical issues involving data leakage, incorrect validation, unstable training, performance limitations, and reproducibility.
  • Assess model-generated solutions for correctness, reliability, and technical quality.
  • Provide actionable feedback to improve AI model performance and evaluation standards.

Required Skills and Qualifications

  • Prior paid professional experience in training, evaluating, benchmarking, or improving AI systems.
  • Strong practical proficiency in Python.
  • Hands-on experience with machine learning frameworks and tools such as PyTorch, JAX, TensorFlow, scikit-learn, XGBoost, LightGBM, or equivalent technologies.
  • Strong understanding of machine learning workflows, model validation, training methodologies, and performance evaluation.

Public Proof of Technical Expertise

Strong applicants should provide publicly verifiable evidence of their technical expertise, such as:

  • GitHub repositories or public machine learning implementations.
  • Kaggle, DrivenData, AIcrowd, or similar competition results.
  • Hugging Face models or datasets.
  • Research publications or technical reports.
  • Open-source machine learning contributions.
  • Public benchmarks, experiments, or technical projects.

Preferred Qualifications

  • Experience creating AI training tasks, reference answers, evaluation rubrics, graders, or benchmark problems.
  • Experience reviewing technical submissions from other AI trainers.
  • Kaggle Expert, Master, or Grandmaster status, or strong results in other technical competitions.
  • Publications or open-source contributions in machine learning.
  • Experience with long-horizon or agentic AI evaluations.
  • Availability to begin immediately.

Application Process

  1. Submit your application, including details of your AI training experience and publicly verifiable technical contributions.
  2. Complete an AI interview involving technical and integrity checks.
  3. Undergo a Hiring Manager review.
  4. If selected, complete project onboarding and begin your first assigned task.

Originally posted on Himalayas

Before you start

Sorted before day one

Some links here earn us a commission. It costs you nothing and does not affect what we recommend.

Job alerts

New remote roles, weekly

Once a week, the new remote roles on the board. Tell us where you live and what you do so we can send the ones that fit.

One email a week, on Tuesdays: your jobs, plus a city guide, a new coworking space and one clearly marked sponsored item. Unsubscribe any time. Privacy

Same employer

More at YO AI Labs

All roles at YO AI Labs

Keep looking

Similar engineering roles

All engineering roles
For employers

Hiring remotely?

Every role on Work From Anywhere shows the countries it can be done from, so the people who apply are the people you can actually hire.

  • $49 per job, and your first one is free
  • Unlimited jobs for $99 a month
  • Matched to job seekers by country and role
Post a job