Engineering

Senior GPU Infrastructure Engineer, Deployment

Polargrid

  • 175,000 – 215,000
  • Canada
  • Fulltime
  • 2 days ago
Apply for this role

About the role

About PolarGrid

PolarGrid is an early-stage Canadian company that runs managed AI inference. Customers bring their own models, and we run them as fast, reliable production endpoints on GPU servers across many sites. We are a small team of about five engineers.

The role

You will own how new GPU servers become ready for customers: from racks at a datacenter to tested, production-ready nodes. You will define when a node is ready, build the automation that gets it there, and keep the fleet healthy once it is running.

This is a hands-on senior role on a small team. You will work with datacenter partners and their on-site staff, and closely with the engineers who own routing and the network.

The work

We bring up large GPU servers at datacenters we don't own. Each node has to be provisioned, tested hard and proven healthy before customers use it. Between customers it has to be wiped clean. Once in service, failing hardware has to be caught early and taken out of rotation. The hard part is doing this the same way, every time, across many sites, with a small team.

What you bring

  • You have brought up multi-GPU servers or clusters for production workloads, including acceptance testing and burn-in.

  • Experience with high-speed GPU networking such as InfiniBand or RoCE.

  • You have automated bare-metal provisioning and kept firmware and images consistent across a fleet.

  • You can diagnose GPU and server hardware faults and decide when to repair or replace.

  • You have run GPUs inside virtual machines or otherwise isolated customers on shared hardware.

  • You have worked with remote datacenter staff and been on call for a fleet.

  • You write scripts and tools in a language such as Python, Go or Bash.

  • You use AI tools well and check their work.

You do not need ML model experience. What matters is that you have put real GPU hardware into service for other people's workloads and kept it running.

Originally posted on Himalayas

Before you start

Sorted before day one

Some links here earn us a commission. It costs you nothing and does not affect what we recommend.

Job alerts

New remote roles, weekly

Once a week, the new remote roles on the board. Tell us where you live and what you do so we can send the ones that fit.

One email a week, on Tuesdays: your jobs, plus a city guide, a new coworking space and one clearly marked sponsored item. Unsubscribe any time. Privacy

Same employer

More at Polargrid

All roles at Polargrid

Keep looking

Similar engineering roles

All engineering roles
For employers

Hiring remotely?

Every role on Work From Anywhere shows the countries it can be done from, so the people who apply are the people you can actually hire.

  • $49 per job, and your first one is free
  • Unlimited jobs for $99 a month
  • Matched to job seekers by country and role
Post a job