Skill
PySpark
Data Science, Analytics and AI/ML
PySpark is the Python API for Apache Spark, a distributed computing framework used for large-scale data processing and analytics across clusters of machines. Data engineers and data scientists use PySpark to perform big data ETL, machine learning, and real-time stream processing using familiar Python syntax.
PySpark in the job market
Last checked September 13, 2026
- Open roles
- 38
- Employers
- 23
- Median pay
- —
- Disclose pay
- —
on Career App right now
hiring for it
not enough disclosed
of these roles
Open roles requiring PySpark (38)
Principal Data Engineer
Hims and Hers
Full-time · US Remote · $220,000 – $260,000
Lead the technical architecture and strategic direction of Hims & Hers' data platform as the most senior individual contributor, owning decisions across ingestion, streaming, orchestration, and infrastructure while mentoring senior engineers and ensuring platform reliability for millions of patients. This role suits someone with deep experience building cloud-native data platforms at scale who can define standards, drive cross-team alignment, and balance architectural vision with hands-on technical leadership.
Listed on Hims and Hers’s careers site · Apply there ↗
Software Engineering Advisors- Hybrid
Cigna
Full-time · Plano, TX
This role involves designing and maintaining data pipelines in Databricks to process large-scale healthcare data for analytics and reporting. It suits experienced data engineers who are comfortable with cloud platforms, big data tools, and healthcare compliance requirements.
Listed on Cigna’s careers site · Apply there ↗
Senior Data Engineer
Century Theatres
Plano, TX
This role involves designing and building large-scale data platforms on Microsoft Azure and Fabric, with a focus on enterprise ETL/ELT pipelines, data modeling, and distributed processing. It suits experienced engineers who excel at independent technical leadership while collaborating across teams.
Listed on Century Theatres’s careers site · Apply there ↗
Senior / Principal Data Scientist, GenAI
American International Group
Atlanta, GA
Join AIG's new generative AI team to design and deploy large-scale LLM and machine learning solutions that transform how the insurance industry manages risk. This role suits experienced data scientists who want to lead technically complex projects from architecture through production with significant business impact.
Listed on American International Group’s careers site · Apply there ↗
Data Scientist
AeroVironment
Full-time · Annapolis Junction, MD · $107,000 – $212,000
A Data Scientist will build statistical and machine learning models on large government datasets to extract insights and support decision-making for a defense contractor. The role suits someone with strong Python and data engineering skills who can communicate technical findings to diverse audiences and holds or can obtain security clearance.
Listed on AeroVironment’s careers site · Apply there ↗
Sr Data Scientist
The Hershey Company
Dallas, TX
A senior data scientist role at Hershey's where you'll own end-to-end machine learning and optimization projects, developing production-ready models that directly influence consumer products and business strategy. This is for an experienced individual contributor who can translate business problems into rigorous scientific solutions while working across engineering, product, and business teams.
Listed on The Hershey Company’s careers site · Apply there ↗
Manager, Analytics & Agentic Platform Operations
Visa Inc.
Full-time · $169,100 – $270,800
This role leads the end-to-end operation and development of a Microsoft Fabric and Azure data platform, combining hands-on pipeline engineering with AI-driven infrastructure automation. The manager will build secure, scalable data systems while orchestrating AI agents to continuously monitor, validate, and self-heal the platform, making this ideal for someone who enjoys bridging infrastructure operations with emerging AI-first technologies.
Listed on Visa Inc.’s careers site · Apply there ↗
Data Engineer, Clinical Operations
Bristol Myers Squibb
Full-time · Princeton, NJ · $87,810 – $106,399
This role supports Bristol Myers Squibb's clinical data infrastructure by designing and operating scalable data pipelines, ETL workflows, and GenAI applications for cross-study operations and specimen management. It suits experienced data engineers who combine cloud platform expertise with machine learning knowledge and want to apply their skills to life sciences and clinical trial workflows.
Listed on Bristol Myers Squibb’s careers site · Apply there ↗
S&C Global Network - AI - Resources - Manager Data Science
Accenture
This role leads data science strategy and execution for a global consulting firm, architecting and deploying advanced analytics solutions for enterprise clients in utilities, energy, and natural resources. It suits experienced practitioners who thrive on translating complex business problems into statistical models and mentoring technical teams at an enterprise scale.
Listed on Accenture’s careers site · Apply there ↗
Senior Machine Learning Engineer - AI Platform
Workday
Full-time · $163,000 – $288,000
This role involves developing machine learning systems and AI-powered services at scale, working with large language models, retrieval-augmented generation, and agentic reasoning to build features across Workday's product suite. It suits experienced ML engineers who can design and ship production systems, lead technically, and stay current with advances in AI.
Listed on Workday’s careers site · Apply there ↗
Asked for alongside PySpark
Measured from the 38 open roles that name PySpark — not from a curated list.
- Python35 roles92.1%
- SQL26 roles68.4%
- Databricks17 roles44.7%
- Amazon Web Services (AWS)16 roles42.1%
- Apache Airflow12 roles31.6%
- Terraform10 roles26.3%
- Microsoft Azure8 roles21.1%
- SPARK8 roles21.1%
Who employers are hiring
- Entry3%
- Mid17%
- Senior56%
- Lead / Staff / Principal19%
- Management6%
From 36 roles whose posting states a level.
Roles that use PySpark
Employers hiring for PySpark
23 in total, most open roles first.
- AAccenture3 roles
- BPBlumberg Portfolio3 roles
- Bristol Myers Squibb3 roles
- TTatari3 roles
- The Home Depot3 roles
- American International Group2 roles
Related skills
Curated neighbors in the taxonomy, whether or not employers ask for them together.