Senior Data Engineer

Join OAG as a Senior Data Engineer and modernize Flight Status data ingestion, processing, and aggregation mechanisms. Work on designing, building, and optimizing scalable ETL and Structured Streaming pipelines in Azure Databricks.

Requirements

• Design, build, and optimize scalable ETL and Structured Streaming pipelines in Azure Databricks
• Design and implement data ingestion and processing pipelines that consolidate heterogeneous data sources
• Implement and monitor data quality using automated validation, alerting, and observability practices
• Develop and maintain orchestration workflows in Apache Airflow
• Build reusable frameworks for schema evolution, error handling, deduplication, and auditing
• Collaborate with data platform, analytics, and product teams to define SLAs, data contracts, and performance targets
• Optimize Spark and Delta Lake performance for scalability, latency, and cost efficiency
• Implement CI/CD pipelines and automation for data workflows using Azure DevOps or equivalent tools
• Mentor engineers, review code, contribute to platform design discussions and planning, and help grow data engineering competencies in the team and across OAG

Benefits

• Company-provided free lunch every day
• Modern office with flexible working arrangements
• Remote work from anywhere in the world for 1 month each year
• Private health insurance
• Company bonus scheme
• Voluntary participation in a company-supported retirement scheme
• Generous annual leave policy with additional days off on your birthday month
• Participation in team-building activities, team workshops, and group learning sessions