Big Data Engineer

iSoftTek Solutions Inc. is seeking a talented Big Data Engineer to join their team. The role involves developing and maintaining big data solutions utilizing Hadoop, Spark, and other big data technologies. Collaboration with cross-functional teams is essential for designing, implementing, and optimizing data processing and analytics systems.

Requirements

• Design, develop, and implement big data solutions using Hadoop and Spark
• Develop scalable data pipelines for data ingestion, transformation, and analysis
• Collaborate with data scientists and analysts to understand business requirements
• Optimize and tune big data applications for performance and scalability
• Monitor and troubleshoot issues in big data systems
• Ensure data quality and integrity
• Proficiency in Java or Python
• Experience with Spark or PySpark
• Strong understanding of SQL and SQL Query
• Experience with Shell or Unix Scripting
• Working Experience of Hive