Principal Engineer (Big Data Engineer)

We are looking for a Principal Engineer (Big Data Engineer) with 12-15 years of experience to join our team. The ideal candidate will have a strong technical background in Big Data, Spark, Python, Scala, Java, and experience working with MS SQL and NoSQL databases. The candidate should be able to design and develop complex data pipelines, lead technical teams, and troubleshoot complex bugs.

Requirements

• Strong technical background in Big Data, Spark, Python, Scala, Java
• Experience working with MS SQL and NoSQL databases (Hbase, Cassandra)
• Ability to build Data Pipelines (from ETL to consumption) using Apache Stack Tools, GCP, AWS, and Azure
• Design and develop complex mappings, performance tuning of mappings, Process Flows
• Hands-on experience in System designing, Event sourcing, and message broker architecture
• Requirement gathering and analysis
• Lead the technical team
• Compare technologies to find the best fit for project requirements
• Troubleshoot complex or unusual bugs