We are looking for a data engineer with experience in developing and architecting scalable pipelines in cloud environments.
Requirements
- Design and develop scalable and robust data ingestion and transformation pipelines in Azure and Databricks.
- Build solutions based on Lakehouse architecture, organized in bronze, silver, and gold layers.
- Ensure pipeline performance and scalability through good practices of partitioning, caching, and parallelism.
- Automate processes with a focus on reusability, monitoring, and quality control.
- Act as a technical reference for the data engineering team, promoting good practices and standardizations.
Benefits
- 3 days a week hybrid work model