Talworx is seeking a Lead Data Engineer to join the Cognitive Engineering team. The role focuses on building, maintaining data pipelines and deployment solutions, utilizing AWS and a hands-on global team. The position offers an engaging work environment and opportunities for impactful contributions.
Requirements
- 2-6 years of relevant experience in data engineering, automation, or ML deployment
- Expert proficiency in Python, including building extraction libraries and RESTful APIs
- Hands-on experience with task queues and orchestration: Celery, Redis, Airflow
- Strong AWS expertise: EKS/ECS, Lambda, S3, RDS/DynamoDB
- Containerization and orchestration experience: Docker (mandatory), basic Kubernetes (preferred)
- Proven experience deploying ML models to production
- Solid understanding of CI/CD practices and hands-on experience with Azure DevOps
- Familiarity with SQL and NoSQL stores (e.g., PostgreSQL, MongoDB)