Senior Data Engineer-AWS, Python

Embark on an exciting journey into the realm of software development with 3Pillar! We extend an invitation for you to join our team and gear up for a thrilling adventure.

Requirements

• Automate data workflows such as data ingestion, aggregation, and ETL processing.
• Logging and instrumentation of pipelines and services.
• Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.
• Lead the monitoring and support of all scheduled and on-demand ETL jobs.
• Perform performance tuning to improve system efficiency and reliability.
• Design and develop new automation solutions to reduce the need for manual support.
• Oversee and execute complex data integrity tasks.
• Implement AWS Lambda functions to trigger external events.
• Make critical, autonomous decisions under pressure to resolve incidents and execute complex tasks.
• Mentor junior engineers and lead knowledge transfer sessions.

Benefits

• Health insurance
• Retirement plan
• Paid time off