We are seeking a Databricks Engineer to join our team in Delhi, India. The ideal candidate will have hands-on experience with Azure Data Factory and end-to-end pipeline development, as well as strong experience with Azure Databricks and Python.
Requirements
- Proven, hands-on experience with Azure Data Factory and end-to-end pipeline development
- Strong experience with Azure Databricks, building notebooks/jobs, and optimizing workloads
- Advanced Python skills for data processing, unit testing, and scripting automation
- Strong SQL skills: designing and writing mid-to-complex queries, stored procedures, functions, and optimizing query performance (T-SQL)
- Experience with SQL Server schema design, and working knowledge of SSIS packages (developing, debugging, maintaining)
- Familiarity with Azure DevOps for source control (Git), CI/CD pipelines, build/release automation, and infrastructure-as-code patterns
- Enforce data-quality checks, lineage, and monitoring (alerts, metrics, SLAs) across pipelines
- Experience implementing data quality frameworks, monitoring, and alerting
- Strong problem-solving skills and a track record of delivering production systems with SLAs
- Document architecture, data contracts, and operational procedures; conduct knowledge transfer to other engineers on the team