# Data Pipelines

Skill · Data Science, Analytics and AI/ML

Canonical page: https://career.thegoodapps.co/skills/data-pipelines

A data pipeline is a series of automated processes that move data from one or more sources to a destination, typically involving steps like extraction, transformation, and loading (ETL or ELT). Data engineers build and maintain pipelines using tools like Apache Airflow, Spark, or cloud-native services to ensure data flows reliably and efficiently for analytics, reporting, or machine learning. Well-designed pipelines handle scheduling, error handling, and scaling as data volume grows.

## Data Pipelines in the job market

- Open roles: 69
- Employers hiring: 46
- Median stated pay: $218,000 (middle half $170,000 – $275,000), from 52 of 69 open roles — the 75% that publish a range, annualized to USD. Only some employers state pay, and the ones that do skew to California and New York, where the law requires it.
- Last checked: September 13, 2026

## Asked for alongside Data Pipelines

Measured from the 69 open roles that name Data Pipelines, not from a curated list.

- [Python](https://career.thegoodapps.co/skills/python) — 38 roles (55.1%)
- [Machine Learning](https://career.thegoodapps.co/skills/machine-learning) — 21 roles (30.4%)
- [Amazon Web Services (AWS)](https://career.thegoodapps.co/skills/amazon-web-services-aws) — 18 roles (26.1%)
- [SQL](https://career.thegoodapps.co/skills/sql) — 16 roles (23.2%)
- [Microsoft Azure](https://career.thegoodapps.co/skills/microsoft-azure) — 9 roles (13.0%)
- [CI/CD](https://career.thegoodapps.co/skills/ci-cd) — 8 roles (11.6%)
- [JavaScript](https://career.thegoodapps.co/skills/javascript) — 7 roles (10.1%)
- [Kubernetes](https://career.thegoodapps.co/skills/kubernetes) — 7 roles (10.1%)

## Seniority of these roles

- Entry: 1 (2%)
- Mid: 11 (18%)
- Senior: 35 (56%)
- Lead / Staff / Principal: 11 (18%)
- Management: 4 (6%)

From 62 roles whose posting states a level.

## Where Data Pipelines roles are

- [New York, NY](https://career.thegoodapps.co/jobs/in/new-york-ny) — 15
- [San Francisco, CA](https://career.thegoodapps.co/jobs/in/san-francisco-ca) — 11
- [Atlanta, GA](https://career.thegoodapps.co/jobs/in/atlanta-ga) — 4
- [Washington, DC](https://career.thegoodapps.co/jobs/in/washington-dc) — 3
- [Santa Clara, CA](https://career.thegoodapps.co/jobs/in/santa-clara-ca) — 2
- [Berkeley, CA](https://career.thegoodapps.co/jobs/in/berkeley-ca) — 1

Among the 43 of 69 open roles we could place on a map.

## Roles that use Data Pipelines

- [Software Engineer](https://career.thegoodapps.co/occupations/software-engineer) — 28
- [Machine Learning Engineer](https://career.thegoodapps.co/occupations/machine-learning-engineer) — 6
- [Engineering Manager](https://career.thegoodapps.co/occupations/engineering-manager) — 5
- [Data Scientist](https://career.thegoodapps.co/occupations/data-scientist) — 4
- [Product Manager](https://career.thegoodapps.co/occupations/product-manager) — 4
- [Account Executive](https://career.thegoodapps.co/occupations/account-executive) — 1

## Employers hiring for Data Pipelines

- [Menlo Ventures Portfolio](https://career.thegoodapps.co/organizations/menlo-ventures-portfolio) — 6 open roles
- [Accenture](https://career.thegoodapps.co/organizations/accenture) — 4 open roles
- [Deepgram](https://career.thegoodapps.co/organizations/deepgram) — 4 open roles
- [Confido](https://career.thegoodapps.co/organizations/confido) — 3 open roles
- [Shield AI](https://career.thegoodapps.co/organizations/shield-ai) — 3 open roles
- [Blackstone Group](https://career.thegoodapps.co/organizations/blackstone-group) — 2 open roles

Related skills: [ETL](https://career.thegoodapps.co/skills/etl), [Apache Airflow](https://career.thegoodapps.co/skills/apache-airflow), [Apache Spark](https://career.thegoodapps.co/skills/apache-spark), [Data Engineering](https://career.thegoodapps.co/skills/data-engineering), [Data Transformation](https://career.thegoodapps.co/skills/data-transformation), [Data Integration](https://career.thegoodapps.co/skills/data-integration), [Oracle Data Integrator](https://career.thegoodapps.co/skills/oracle-data-integrator), [Extract, Transform, Load](https://career.thegoodapps.co/skills/extract-transform-load), [Azure Data Factory](https://career.thegoodapps.co/skills/azure-data-factory), [ML Orchestration](https://career.thegoodapps.co/skills/ml-orchestration), [Data Processing](https://career.thegoodapps.co/skills/data-processing), [TIBCO](https://career.thegoodapps.co/skills/tibco)

## Open roles requiring Data Pipelines (69)

- [Research Staff, Data Science](https://career.thegoodapps.co/jobs/1f9ca8b7-09b3-4349-8bb1-e78af08e3617/research-staff-data-science-at-deepgram) at [Deepgram](https://career.thegoodapps.co/organizations/deepgram) — San Francisco, CA · Remote, $150,000 – $220,000
- [AI Observability Engineer](https://career.thegoodapps.co/jobs/2698628c-cc0c-4155-a679-7edd3bd76f85/ai-observability-engineer-at-american-international-group) at [American International Group](https://career.thegoodapps.co/organizations/american-international-group) — Atlanta, GA
- [Sr. Technology Manager, Legal & Compliance](https://career.thegoodapps.co/jobs/dec2e46e-603c-40a7-b865-0d4e66b40dd0/sr-technology-manager-legal-compliance-at-alliancebernstein) at [AllianceBernstein](https://career.thegoodapps.co/organizations/alliancebernstein) — Nashville, TN
- [AI Engineer, Sr](https://career.thegoodapps.co/jobs/a3163207-0554-496e-9a24-681454598cfb/ai-engineer-sr-at-a-dec) at [A-dec](https://career.thegoodapps.co/organizations/a-dec) — Newberg, OR
- [Application Engineering Lead - Data Transformation - SAP Signavio](https://career.thegoodapps.co/jobs/93e05d15-4b3c-4536-9362-8cccba6a3189/application-engineering-lead-data-transformation-sap-signavio-at-sap) at [SAP](https://career.thegoodapps.co/organizations/sap) — Full-time, Brno, CZ, 63900
- [Sr Principal IT Enterprise Architect - Digital Health & Product Innovation](https://career.thegoodapps.co/jobs/c9937f7a-6a3d-4ab2-8c85-09472ca8246d/sr-principal-it-enterprise-architect-digital-health-product-innovation-at) at [Medtronic](https://career.thegoodapps.co/organizations/medtronic)
- [Senior Manager, Real World Data Strategy](https://career.thegoodapps.co/jobs/7d4836f0-695e-4e0d-a1e8-83464c8f198c/senior-manager-real-world-data-strategy-at-bristol-myers-squibb) at [Bristol Myers Squibb](https://career.thegoodapps.co/organizations/bristol-myers-squibb) — Full-time, Field - United States, $139,200 – $168,683
- [Director, R&D Information Systems](https://career.thegoodapps.co/jobs/801e5c9c-3204-4353-aa9c-b5b7586850a4/director-r-d-information-systems-at-gilead-sciences) at [Gilead Sciences](https://career.thegoodapps.co/organizations/gilead-sciences) — Full-time, United States - California - Foster City, $210,375 – $272,250
- [AI Solution Architect](https://career.thegoodapps.co/jobs/5fe5f2c7-aa5a-4695-88f3-1336801938d0/ai-solution-architect-at-accenture) at [Accenture](https://career.thegoodapps.co/organizations/accenture)
- [Principal Architect, Consumer Data Platform, Measurement & Attribution](https://career.thegoodapps.co/jobs/5cd7ea87-d17f-495f-8137-5d26eb86ee50/principal-architect-consumer-data-platform-measurement-attribution-at-warner) at [Warner Bros. Discovery](https://career.thegoodapps.co/organizations/warner-bros-discovery) — Atlanta, GA, $154,070 – $286,130

All 69 open roles: https://career.thegoodapps.co/jobs?skills=b7689d90-9217-4f36-8830-6866254089d4