Data Engineer – Azure, Spark & Python

About the role

EPAM is looking for a Data Engineer with strong Azure expertise to design, build, and operate scalable data pipelines and platforms. You will work hands‑on with Azure Data Factory, Azure Databricks, and Azure SQL while ensuring reliable, governed data products for internal teams.

Key responsibilities

• Design and implement batch and streaming pipelines using Azure Data Factory and Azure Databricks.
• Develop and optimise data models and workloads in Azure SQL and other cloud data stores.
• Implement event‑driven processing with Azure Event Hubs and Kafka.
• Automate deployments via Azure DevOps pipelines and Infrastructure‑as‑Code tools.
• Containerise services with Docker and run workloads on Azure Kubernetes Service (AKS).
• Apply data governance and lineage using Microsoft Purview.
• Monitor platform health, cost and performance with Azure Monitor and logging.
• Collaborate with engineering and product teams to deliver end‑to‑end data solutions.

Required profile

• Proven experience building data pipelines on Azure Data Factory.
• Hands‑on expertise with Azure Databricks for data processing and orchestration.
• Strong knowledge of Azure SQL, Python and SQL for transformation and automation.
• Familiarity with streaming patterns using Azure Event Hubs and/or Kafka.
• Experience with Azure Data Lake Storage, Azure Cosmos DB and modern data platforms.
• Comfort with Azure DevOps and Infrastructure‑as‑Code (Bicep, Terraform, ARM templates).
• Ability to implement governance and monitoring with Microsoft Purview and Azure Monitor.

Required skills

• Azure Data Factory
• Azure Databricks
• Azure SQL
• Python
• SQL
• Azure Event Hubs
• Kafka
• Azure Data Lake Storage
• Azure Cosmos DB
• Azure DevOps
• Bicep
• Terraform
• Azure Resource Manager templates
• Microsoft Purview
• Azure Monitor
• Docker
• Azure Kubernetes Service (AKS)
• Spark

What we offer

• Opportunity to work with cutting‑edge cloud and data technologies.
• Supportive environment with mentorship, online courses and certification grants.
• Transparent career path and individual development roadmap.
• Global collaboration with top talent across EPAM’s worldwide network.