Engineering

Spark Developer

InfraCloud

  • India
  • Fulltime
  • 4 days ago
Apply for this role

About the role

About the Role

We are looking for a Senior Software Engineer with strong expertise in Apache Spark and distributed systems. The role involves working on Spark internals, contributing to the Apache Spark open-source community, and building scalable data processing solutions aligned with the platform requirements.

Key Responsibilities

  • Contribute fixes and enhancements to the Apache Spark open-source project.
  • Upgrade and maintain compatibility with newer Spark releases.
  • Optimize Spark internals for performance, scalability, and reliability.
  • Design and develop distributed data processing solutions.
  • Debug complex Spark-related performance and stability issues.
  • Collaborate with product and platform teams on architecture and technical initiatives.

Required Skills

  • Strong experience with Apache Spark internals and distributed systems.
  • Hands-on experience contributing to open-source projects.
  • Strong Java and/or Scala programming skills.
  • Expertise in query execution, distributed processing, and performance optimization.
  • Strong debugging and problem-solving abilities.
  • Ability to work independently and drive technical initiatives.

Good to Have

  • Experience with Kubernetes and cloud-native environments.
  • Knowledge of JVM tuning and system optimization.
  • Contributions to Apache or other open-source communities.
  • Experience with large-scale analytics or data platforms.

Originally posted on Himalayas

Before you start

Sorted before day one

Some links here earn us a commission. It costs you nothing and does not affect what we recommend.

Job alerts

New remote roles, weekly

Once a week, the new remote roles on the board. Tell us where you live and what you do so we can send the ones that fit.

One email a week, on Tuesdays: your jobs, plus a city guide, a new coworking space and one clearly marked sponsored item. Unsubscribe any time. Privacy

Same employer

More at InfraCloud

All roles at InfraCloud

Keep looking

Similar engineering roles

All engineering roles
For employers

Hiring remotely?

Every role on Work From Anywhere shows the countries it can be done from, so the people who apply are the people you can actually hire.

  • $49 per job, and your first one is free
  • Unlimited jobs for $99 a month
  • Matched to job seekers by country and role
Post a job