Front page / By role / Engineering / Software engineer / Data engineer
Engineering
Data engineer
Builds the pipelines that move and clean data so analysts and models can trust it.
Under Software engineer. Also under it: Frontend engineer, Backend engineer, Full stack engineer, Mobile engineer, Machine learning engineer, Solutions architect, Game developer
Workflows for this work
The job in 4 areas. Each part is a workflow: open it for its steps and the tools that do each one. Built from occupational data and the field's own body of knowledge; sources at the end.
Data engineer85 skill packs · 43 MCP servers · 4 pluginsEach part is a workflow. The number beside it is how many tools help with it
1Design the data platform
Decide where data lives and how it is modeled.
2Build pipelines
Move data in, transform it and run it on a schedule.
3Keep data trustworthy
Test data, document it and show where it came from.
4Run and govern
Keep pipelines healthy, costs down and access controlled.
Sources for this tree, 7
- PractitionerWhat is Airflow (Airflow 3.3.2 documentation)Apache Software Foundation
- Body of knowledgeDAMA Data Management Body of Knowledge (DAMA-DMBOK)DAMA International
- Body of knowledgeDAMA-DMBOK Framework (the eleven knowledge areas)DAMA-DMBOK (damadmbok.org)
- VendorHow we structure our dbt projectsdbt Labs
- Occupational dataDatabase Architects (15-1243.00)O*NET OnLine, U.S. Department of Labor
- Occupational dataData Warehousing Specialists (15-1243.01), summary report: tasks and detailed work activitiesO*NET OnLine, U.S. Department of Labor
- Body of knowledgeSite Reliability Engineering (book), table of contentsGoogle
O*NET occupations consulted: 15-1243.01, 15-1243.00. Read on 2026-10-04.
Everything suggested for this role
Each pick says which of the role's tools or work it matched. Auto-listed means automated checks only.
Skill packs235
MCP servers16
Plugins and agents7
Sign in to see which tools these are. It is free.