Data Engineer
TechBiz GlobalWarmian-Masurian Voivodeship, Poland
Posted May 24, 2025
Full Time
About the Company
TechBiz Global is a leading recruitment and software development company offering IT outstaffing, outsourcing, and customized consulting services to help clients achieve their recruitment goals. With expertise in diverse technologies and frameworks, the company serves international clients across 22 countries. TechBiz Global celebrates diversity and promotes an inclusive environment, making it a distinctive player in the industry.
Job Description
We are seeking a Data Engineer to join one of our clients' teams at TechBiz Global. The role involves designing, developing, and maintaining ETL/ELT pipelines, building robust data architectures, and collaborating with cross-functional teams.
Requirements
- Design, develop, and maintain ETL/ELT pipelines using Apache Airflow and AWS Glue.
- Build robust and scalable data architectures leveraging AWS services such as S3, Lambda, CloudWatch, Kinesis, and Redshift.
- Integrate real-time and batch data pipelines using Kafka and AWS streaming solutions.
- Ensure data quality, reliability, and performance through effective monitoring, debugging, and optimization.
- Collaborate with cross-functional teams to understand data requirements and deliver efficient solutions.
- Manage version control and collaborative workflows using Git.
- Implement infrastructure as code solutions with Terraform and Ansible to automate deployments.
- Establish CI/CD pipelines to streamline testing, deployment, and versioning processes.
- Document data models, workflows, and architecture to support transparency and scalability.
