We are looking for a Data Engineer to assess, analyze and work with data concepts, use-cases & complex new data sources to provide business insights to customers and support the implementation & integration of the data sources into the platform.
Requirements
- Bachelor's degree in computer engineering, Computer Science, or Electrical Engineering and Computer Sciences.
- 3+ years of programming experience, solid coding skills in Python, Shell, and Java
- Good corporate capacity, good communication skills.
- Experience with Web crawling, cleaning.
- Experience with solution architecture, data ingestion, query optimization, data segregation, ETL, ELT, AWS, EC2, S3, SQS, lambda, Elastic Search, Redshift, CI/CD frameworks and workflows.
- Working knowledge of data platform concepts - data lake, data warehouse, ETL, big data processing (designing and supporting variety/velocity/volume), real time processing architecture for data platforms, scheduling and monitoring of ETL/ELT jobs
- PostgreSQL and programming (preferably Java, Python), proficiency in understanding data, entity relationships, structured & unstructured data, SQL and NoSQL databases
- Knowledge of best practice in optimizing columnar and distributed data processing system and infrastructure
- Experienced in designing and implementing dimensional modelling
- Knowledge of machine learning and data mining techniques in one or more areas of statistical modelling, text mining and information retrieval.
Benefits
- Competitive salary
- Class A Medical Insurance
