Keyrus is looking for a Senior Data Engineer AWS to design, implement, and maintain data pipelines using Databricks, Spark, and native AWS services. The ideal candidate has proven experience as a Data Engineer, strong knowledge of AWS, and mastery of Databricks, PySpark, and SQL.
Requirements
- Design, implement and maintain data pipelines (ETL/ELT) using Databricks, Spark and native AWS services.
- Manage and optimize data lakes and data warehouses (e.g. S3, Redshift, Delta Lake).
- Collaborate with Data Science, Analytics and business teams to ensure data quality and availability.
- Implement data governance, security and monitoring practices.
- Automate and orchestrate workflows with Airflow, Step Functions or similar tools.
- Monitor performance and propose continuous improvements in processes and architecture.