Databricks is seeking highly skilled Databricks Data Engineers to join their data modernization team. The role involves designing, developing, and maintaining robust data solutions on the Databricks platform. Experience in data engineering with a deep understanding of Databricks is crucial for building solutions that drive data-driven decision-making.
Requirements
- Design, develop, and optimize data workflows and notebooks using Databricks
- Build and maintain scalable and efficient data processing workflows using Spark
- Collaborate with technical and business stakeholders to understand data requirements
- Develop data models and schemas to support reporting and analytics needs
- Ensure data quality, integrity, and security
- Monitor and optimize data processing performance
- Stay up-to-date with the latest advancements in data engineering
- Experience with at least one of the popular cloud platforms - Azure, AWS or GCP
- Experience with ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes
- Knowledge of data warehousing and data modelling concepts
- Experience with Python or SQL
- Experience with Delta Lake
- Understanding of DevOps principles and practices
- Excellent problem-solving and troubleshooting skills
- Strong communication and teamwork skills
Benefits
- Work with one of the Big 4 in India
- Healthy work Environment
- Work Life Balance