We are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure and systems. This position requires a solid background in data engineering or data infrastructure roles, along with expertise in various technologies and tools.
Requirements
- Bachelor's or master's degree in Business Intelligence, Machine Learning, Business Management, Computer or Data Sciences, or Statistics.
- Strong experience working with cloud-based data warehouses and implementing ELT processes.
- Proficiency in Spark for data processing and analysis.
- Experience with ELT/ETL processes, including moving and transforming data.
- Familiarity with Rest API and ability to integrate data from various platforms.
- Possess advanced Python skills, including PySpark, Pandas, Scikit Learn, Numpy, Boto3, Glue + Spark Context.
- Strong understanding of data modeling techniques, such as Star schemas, Snowflake schemas, and aggregation tables.
- Experience with Amazon Glue, S3, AppFlow, Athena, EC2/ECS, Code Commit/Code Pipeline.
- Excellent problem-solving skills and ability to work in a collaborative team environment.