About the role
Senior Spark QA Engineer – Functional & Performance Testing
Location: Remote
Experience: 5+ Years
Job Description -
We are looking for a Senior Spark QA Engineer with strong expertise in functional and performance testing of Apache Spark applications and distributed data platforms.
Key Responsibilities -
Location: Remote
Experience: 5+ Years
Job Description -
We are looking for a Senior Spark QA Engineer with strong expertise in functional and performance testing of Apache Spark applications and distributed data platforms.
Key Responsibilities -
- Perform manual and automated testing of Spark jobs, Spark SQL queries, and ETL pipelines.
- Execute functional, scalability, and performance testing for Spark workloads.
- Set up and manage Spark clusters on Standalone, YARN, Kubernetes, Mesos, Databricks, EMR, and Dataproc.
- Conduct benchmarking, validation, and performance analysis of Spark applications.
- Identify bottlenecks and troubleshoot distributed system issues.
- Lead QA initiatives and mentor team members.
Required Skills -
- 5+ years of QA/testing experience with strong hands-on expertise in Apache Spark.
- Experience in functional and performance testing of distributed systems.
- Strong understanding of Spark architecture and optimization techniques.
- Experience with Kubernetes and cloud-based Spark environments.
- Proficiency in Python or Java.
- Experience with automation frameworks and CI/CD pipelines.
Originally posted on Himalayas
Before you start
Sorted before day one
Some links here earn us a commission. It costs you nothing and does not affect what we recommend.
- Health cover
An employer's health plan may not cover you abroad. Check you are covered where you will actually be.See details for SafetyWing Nomad InsuranceAffiliate link (opens in a new tab)
- Staying connected
A data plan for the countries you will work from, set up before you land.See details for AiraloAffiliate link (opens in a new tab)
- Working securely
Working on cafe or coworking Wi-Fi? A VPN keeps company logins private.See details for Proton VPNAffiliate link (opens in a new tab)