Data Engineer
Summary
| Title: | Data Engineer |
|---|---|
| ID: | 10206 |
| Department: | Information Technology |
| Location : | Washington, D.C. |
Description
Clearance: Minimum Active Secret Clearance
Responsibilities:
Responsibilities:
- Design, build, migrate, monitor and maintain customer's data pipelines in Azure Data Factory (ADF)
- Cleanup and transform data as necessary
- Support integration with other systems
- Migrate existing on-premise datasets and data workflows to ADF
- Support customer's data needs to further their Analytics and AI efforts
- Day-to-day, manage ADF, SQL Servers, Notebooks etc.
- Improve, innovate data ingestion and data pipelines
- Other ETL/ELT duties as assigned
- ADF, SQL, Databricks/Jupyter notebooks, Python and other data engineering tools
- Optionally, Spark/PySpark
- Understanding of data security and governance
- Requirements gathering
- Understanding of Agile methods
- Software engineering best practices
- Write production quality code
- Good verbal and written communication
- Collaborate across functional teams
- Interact with and manage customer expectations
