Engineering

Machine Learning Engineer (Egocentric 3D Human Pose)

Glint Tech Solutions LLC

  • United States
  • Fulltime
  • 2 days ago
Apply for this role

About the role

About the Role

We are looking for a Machine Learning Engineer to join our core research and development team focused on recovering accurate 3D human body and hand motion from egocentric (first-person) video.

Human demonstration data is the foundation of robot learning, and its quality depends on accurately reconstructing human motion. In this role, you will develop models and production pipelines that transform head-mounted and body-mounted camera streams—including wide-FOV, stereo, motion-blurred, and heavily self-occluded video—into metrically accurate, temporally consistent 3D pose representations for robot policy training and human-to-robot motion retargeting.

You will work across the entire perception stack, including camera calibration, data annotation, model training, evaluation, and large-scale deployment. This role is ideal for engineers with strong expertise in both computer vision and deep learning who enjoy solving challenging real-world perception problems.

Responsibilities

  • Develop state-of-the-art 3D body and hand pose estimation models for egocentric video using monocular and stereo camera systems.
  • Build models for 2D/3D keypoint estimation, SMPL/SMPL-X, MANO, and full-body motion reconstruction.
  • Address challenging egocentric vision problems, including severe self-occlusion, motion blur, rolling shutter artifacts, truncated limbs, extreme viewpoints, and hand-object interaction.
  • Design and maintain camera geometry and calibration pipelines, including fisheye and wide-FOV camera models, stereo calibration, triangulation, and coordinate frame alignment.
  • Improve temporal consistency and physical plausibility using filtering, kinematic constraints, multi-view fusion, and multi-modal sensor integration.
  • Build scalable annotation, evaluation, and quality assurance pipelines for large-scale human motion datasets.
  • Optimize large-scale model training and high-throughput inference pipelines for production environments.
  • Collaborate closely with robotics engineers to convert reconstructed human motion into high-quality robot training data.
  • Contribute to system architecture, engineering best practices, and the long-term evolution of the perception platform.

Minimum Qualifications

  • Bachelor's, Master's, or PhD in Computer Science, Machine Learning, Computer Vision, Robotics, or a related field.
  • 3+ years of experience building and deploying machine learning systems.
  • Hands-on experience with 3D human pose estimation, hand pose estimation, or human motion tracking from video.
  • Strong understanding of multi-view geometry, camera calibration, triangulation, coordinate transformations, and projection models.
  • Strong Python programming skills and proficiency with PyTorch or TensorFlow.
  • Solid knowledge of modern deep learning techniques, model training, evaluation, and production ML workflows.
  • Strong analytical and problem-solving skills with the ability to thrive in a fast-paced collaborative environment.

Preferred Qualifications

  • Experience with egocentric perception systems, AR/VR headsets, smart glasses, or wearable capture rigs.
  • Expertise with SMPL, SMPL-X, MANO, inverse kinematics, markerless motion capture, or hand-object pose estimation.
  • Familiarity with egocentric vision datasets and benchmarks.
  • Experience with modern video and 3D learning architectures, including Video Transformers, diffusion-based motion models, or 3D CNNs.
  • Experience building multi-camera capture systems, synchronization, and calibration infrastructure.
  • Experience with human-to-robot motion retargeting, teleoperation, imitation learning, or dexterous manipulation.
  • Experience developing annotation tools, active learning pipelines, or large-scale data quality systems.
  • Publications at leading conferences such as CVPR, ICCV, ECCV, NeurIPS, SIGGRAPH, or 3DV, open-source contributions, or demonstrated impact in applied AI systems.

What We Offer

  • Competitive salary and equity package
  • Comprehensive medical, dental, and vision insurance
  • 401(k) retirement plan
  • Generous paid time off and company holidays
  • Paid sick leave
  • Opportunity to work alongside leading researchers and engineers in robotics, computer vision, and AI
  • High-impact role building cutting-edge perception systems for next-generation robotics

Originally posted on Himalayas

Before you start

Sorted before day one

Some links here earn us a commission. It costs you nothing and does not affect what we recommend.

Job alerts

New remote roles, weekly

Once a week, the new remote roles on the board. Tell us where you live and what you do so we can send the ones that fit.

One email a week, on Tuesdays: your jobs, plus a city guide, a new coworking space and one clearly marked sponsored item. Unsubscribe any time. Privacy

Keep looking

Similar engineering roles

All engineering roles
For employers

Hiring remotely?

Every role on Work From Anywhere shows the countries it can be done from, so the people who apply are the people you can actually hire.

  • $49 per job, and your first one is free
  • Unlimited jobs for $99 a month
  • Matched to job seekers by country and role
Post a job