Skill
Apache Spark
Data Science, Analytics and AI/ML
Apache Spark is an open-source, distributed data processing engine designed for fast, large-scale analytics, machine learning, and streaming workloads across clusters. Developed at UC Berkeley's AMPLab, it improves on Hadoop's MapReduce by processing data in-memory, making it dramatically faster for iterative algorithms. Data engineers and data scientists widely use it (via APIs in Python, Scala, Java, and SQL) for ETL, big data analytics, and machine learning pipelines.
Apache Spark in the job market
Last checked September 14, 2026
- Open roles
- 36
- Employers
- 21
- Median pay
- —
- Disclose pay
- —
on Career App right now
hiring for it
not enough disclosed
of these roles
Open roles requiring Apache Spark (36)
Senior / Principal Data Scientist, GenAI
American International Group
Atlanta, GA
Join AIG's new generative AI team to design and deploy large-scale LLM and machine learning solutions that transform how the insurance industry manages risk. This role suits experienced data scientists who want to lead technically complex projects from architecture through production with significant business impact.
Listed on American International Group’s careers site · Apply there ↗
Senior Platform Engineer - SAP Big Data Fabric Services
SAP
Full-time · São Leopoldo, BR, 93022-718
A senior backend engineer role building cloud-native platform services that enable big data processing and storage at scale, using Apache Spark and Kubernetes. This suits experienced developers who can drive technical architecture decisions and mentor others while working on distributed systems for enterprise customers.
Listed on SAP’s careers site · Apply there ↗
Staff Data Engineer
Visa Inc.
Full-time · US - Foster City, CA · $146,200 – $233,700
This role leads the design and development of large-scale data pipelines and platforms within Visa's payments technology infrastructure, supporting analytics, reporting, and machine learning across the organization. It suits experienced engineers who can architect distributed systems, mentor junior staff, and drive adoption of big data technologies in a fast-paced environment.
Listed on Visa Inc.’s careers site · Apply there ↗
S&C Global Network - AI - Retail - AI/Gen AI Retail Manager
Accenture
Accenture is hiring a manager to lead AI and generative AI initiatives across retail operations, designing machine learning solutions for merchandising, pricing, and customer engagement. The role suits experienced AI practitioners with retail domain knowledge who can translate technical capabilities into business strategy and lead cross-functional teams.
Listed on Accenture’s careers site · Apply there ↗
Senior Staff Data Engineer (Ad Tech Team - AWS experience required)
Warner Bros. Discovery
Silver Spring, MD · $161,070 – $299,130
This role leads the design and operation of massive-scale data pipelines processing billions of ad events daily across WBD's streaming and advertising infrastructure. It suits experienced data engineers who can architect cloud-native systems, mentor teams, and drive modernization of legacy ad-tech platforms.
Listed on Warner Bros. Discovery’s careers site · Apply there ↗
Sr. Site Reliability Engineer (US Federal)
Workday
Full-time · Reston, VA · $151,500 – $227,300
A Site Reliability Engineer supporting Workday's federal government cloud platform, focusing on building scalable infrastructure, CI/CD automation, and Kubernetes systems that enable analytics services in secure GovCloud environments. This role suits engineers with strong cloud and infrastructure expertise who want to apply their skills to mission-critical federal systems.
Listed on Workday’s careers site · Apply there ↗
Director, Data Engineering - Business Data
Zillow
Full-time · Remote-USA · $178,100 – $299,500
Lead a growing data engineering team at Zillow building scalable data platforms and pipelines that power the company's real estate products and industry strategy. This role suits an experienced engineering leader with strong technical depth in data systems who wants to shape infrastructure at a critical scale.
Listed on Zillow’s careers site · Apply there ↗
Senior Manager, Analytics Engineering
Supercast
Los Angeles, CA · $160,000 – $187,000
Lead a data engineering team supporting FOX Sports, modernizing how behavioral data flows through the organization's platforms. This role suits experienced data leaders who combine technical depth in analytics engineering with strong people management and the ability to translate business needs into scalable data solutions.
Listed on Supercast’s careers site · Apply there ↗
Data Platform Administrator
LSEG
This role manages and optimizes cloud-based data platforms like Databricks, handling cluster administration, security configuration, and CI/CD automation for data teams. It suits experienced platform operators comfortable with Apache Spark, cloud infrastructure, and supporting data scientists and engineers at scale.
Listed on LSEG’s careers site · Apply there ↗
Sr. Software Engineer - Cloud (Hybrid)
CrowdStrike
Full-time · Sunnyvale, CA · $140,000 – $215,000
CrowdStrike's Risk Analytics team seeks a senior engineer to build the backend platform that powers their exposure management and attack path analysis capabilities. You'll design scalable microservices in Golang that process massive security data streams and drive the technical vision for next-generation risk intelligence systems.
Listed on CrowdStrike’s careers site · Apply there ↗
Asked for alongside Apache Spark
Measured from the 36 open roles that name Apache Spark — not from a curated list.
- Python27 roles75.0%
- Amazon Web Services (AWS)20 roles55.6%
- Kubernetes17 roles47.2%
- SQL15 roles41.7%
- Databricks13 roles36.1%
- Microsoft Azure11 roles30.6%
- Java10 roles27.8%
- Apache Kafka9 roles25.0%
Who employers are hiring
- Mid9%
- Senior74%
- Lead / Staff / Principal9%
- Management9%
From 34 roles whose posting states a level.
Roles that use Apache Spark
Employers hiring for Apache Spark
21 in total, most open roles first.
- SSAP5 roles
- CCohere4 roles
- AAccenture3 roles
- Comcast3 roles
- American International Group2 roles
- CCrowdStrike2 roles
Related skills
Curated neighbors in the taxonomy, whether or not employers ask for them together.