Lead Data Engineer – Python & GCP

We are seeking a skilled Lead Data Engineer with strong Python and GCP skills to join our data engineering team. The role involves designing, developing, and maintaining scalable ETL and ELT data pipelines, working directly with customers, and ensuring data quality and consistency across systems. The position requires collaboration with data scientists, analysts, and other engineering teams.

Requirements

• Design, develop, test, and maintain scalable ETL data pipelines using Python.
• Architect the enterprise solutions with various technologies like Kafka, multi-cloud services, auto-scaling using GKE, Load balancers, APIGEE proxy API management, DBT, using LLMs as needed in the solution.
• Work extensively on Google Cloud Platform (GCP) services such as: Dataflow, Cloud Functions, BigQuery, Cloud Composer, Google Cloud Storage, IAM, Cloud Run.
• Experience in deployments in GKE, Cloud Run.