Big Data Engineer

Orion Innovation is seeking a skilled Big Data Engineer to deliver game-changing business transformation and product development through digital strategy, experience design, and engineering. The role involves analyzing requirements, building data pipelines, developing solutions, and interacting with clients. They emphasize agility, scale, and maturity in a global business services firm.

Requirements

• Requirement analysis, requirement gathering, design, business impact analysis, gap analysis, estimation, development, testing, coding, code review, unit testing and deployment of the application.
• Design, build, install, configure, and support Hadoop (Big Data).
• Design and implement big data pipelines to ingest and process data in real-time and monitor for data miss or error in progress to ensure that data reaches the end system.
• Measure the performance of various APIs and implement optimization on slow services to enhance the responsiveness of the system.
• Interact with clients to elicit architectural and non-functional requirements such as performance, scalability, reliability, availability, maintainability.
• Develop Hadoop batch jobs for data extraction from multiple unstructured and structured data sources for populating into various repositories.