Senior Azure Data Engineer with Databricks

We are seeking an experienced and self-driven Data Engineer to design, build, and maintain the modern data infrastructure that supports our analytics, data science, and product teams. In this role, you will develop scalable data pipelines and manage large, complex datasets using Azure Databricks and the broader Azure data ecosystem.

Requirements

• curating structured, semi-structured, and unstructured data by creating efficient, cost effective and scalable pipelines leveraging Databricks and Azure Analytics stack
• creating and maintaining robust data pipeline architecture
• ensuring data quality, reliability, and scalability
• assembling and managing large, complex data sets to meet functional and non-functional business requirements
• identifying, designing, and implementing process improvements, including automation of manual processes and optimization of data delivery
• mentoring and coaching the team members to achieve engineering excellence
• working with architects to design robust, scalable and cost-effective data solutions