Senior Data Engineer

We're looking for a Senior Data Engineer to design and implement robust data architectures and pipelines, and drive data-driven decision making.

Requirements

• Lead the design, development, and implementation of high-performance, scalable, and reliable data pipelines and ETL/ELT processes using Azure Data Factory, Databricks, and other Azure data services.
• Architect and manage data solutions within the Azure ecosystem, including Azure Data Lake Storage, Databricks, Databricks DLT and Streaming and Event Based Architectures.
• Drive the adoption of best practices for data governance, data quality, data security, and data lineage.
• Collaborate closely with data scientists, analysts, and other engineering teams to understand data requirements and translate them into technical solutions.
• Optimise data processing performance and cost efficiency on Azure Databricks, leveraging Spark capabilities effectively.
• Develop and maintain robust monitoring, alerting, and logging for data pipelines.
• Mentor and provide technical guidance to junior and mid-level data engineers, fostering a culture of continuous learning and improvement.
• Evaluate and recommend new data technologies and tools to enhance our data platform capabilities.
• Contribute to the overall data strategy and roadmap, ensuring alignment with business objectives.
• Troubleshoot and resolve complex data-related issues in a timely manner.

Benefits

• Competitive Salary range of £65 - 75,000 per annum
• Flexible working
• Generous paid leave
• Enhance family leave
• Enjoy your Birthday off
• Mental Health Support through our Wellbeing partner, Calm
• Wellbeing leave and a Mental Health First Aider program
• Giving back days to help support causes close to your heart
• Unlimited professional & personal learning
• Total Rewards including retirement planning, healthcare and life assurance