We're looking for a Technical Lead with strong technology and data understanding in big data engineering space, having proven delivery capability. The role involves developing and deploying Azure Databricks in a cloud environment using Azure Cloud services, configuring and replicating the Azure Databricks platform, and migrating Hadoop jobs and ETL workflows to Azure Databricks.
Requirements
- 3-7 years of Experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases, NoSQL, and data warehouse solutions
- Extensive hands-on experience implementing data migration and data processing using Azure services
- Hands on experience in programming like python/pyspark
- Good knowledge on DWH concepts and implementation knowledge in ACID transactions
- Well versed in DevOps and CI/CD deployments
- Must have hands on experience in SQL and procedural SQL languages
- Strong analytical skills and enjoys solving complex technical problems
- Proficiency in Software Development Best Practices
- Excellent debugging and optimization skills
- Experience in Enterprise grade solution implementations & in converting business problems/challenges to technical solutions considering security, performance, scalability etc
Benefits
- Support, coaching and feedback from colleagues
- Opportunities to develop new skills and progress career
- Freedom and flexibility to handle role in a way that's right for you