Senior Data Engineer - Clearance Required

LMI is seeking a Senior Data Engineer supporting Special Operations Command (SOCOM) on-site in Crystal City. The position involves providing big data ETL support on classified data and systems to directly support client mission.

Requirements

• Design, develop, and implement scalable data pipelines and ETL processes using Apache Airflow
• Implement and optimize Python-based data processing solutions.
• Utilize Trino for distributed SQL query processing.
• Develop messaging solutions utilizing Kafka to support real-time data streaming and event-driven architectures.
• Build and maintain high-performance data retrieval solutions using ElasticSearch/OpenSearch.
• Integrate batch and streaming data processing techniques to enhance data availability and accessibility.
• Ensure adherence to security and compliance requirements when working with classified data
• Work closely with cross-functional teams to define data strategies and develop technical solutions aligned with mission objectives.
• Deploy and manage cloud-based infrastructure to support scalable and resilient data solutions, including AWS S3.
• Optimize data storage, retrieval, and processing efficiency, focusing on big data.

Benefits

• Generous Paid Time Off
• 401k Matching
• Retirement Plan