We are seeking a talented Data Engineer to design, build, and maintain our data infrastructure supporting mission-critical energy operations. You'll work at the intersection of renewable energy and data technology, developing pipelines that process everything from real-time asset performance data to complex trading and risk analytics.
Requirements
- Design, deploy, and maintain scalable data infrastructure to support enterprise analytics and reporting needs
- Manage Snowflake instances, including performance tuning, security configuration, and capacity planning for growing data volumes
- Build and orchestrate complex ETL/ELT workflows using Dagster to ensure reliable, automated data processing for asset management and energy trading
- Develop robust data pipelines that handle high-volume, time-sensitive energy market data and asset generation and performance metrics
- Implement workflow automation and dependency management for critical business operations
- Develop and maintain dbt models to transform raw data into business-ready analytical datasets and dimensional models
- Create efficient SQL-based transformations for complex energy market calculations and asset performance metrics
- Support advanced analytics initiatives through proper data preparation and feature engineering
- Implement comprehensive data validation, testing, and monitoring frameworks to ensure accuracy and consistency across all energy and financial data assets
- Establish data lineage tracking and privacy controls to meet regulatory compliance requirements in the energy sector
- Develop alerting and monitoring systems for data pipelines, including error handling, SLA monitoring, and incident response
- Lead continuous integration and deployment initiatives for Dagster and dbt pipelines, and Streamlit/Gradio application deployments to Linux servers
- Implement automated testing and deployment automation for data pipelines and analytics applications
- Manage version control and infrastructure as code practices
- Partner with Analytics Engineers, Data Scientists, and business stakeholders to understand requirements and deliver solutions
- Work closely with asset management and trading groups to ensure real-time data availability for market operations and risk calculations
- Collaborate with credit risk teams to develop data models supporting financial analysis and regulatory reporting
- Translate business requirements into technical solutions and communicate data insights to stakeholders
- Create and maintain technical documentation, data dictionaries, and onboarding materials for data assets
- Implement role-based access controls, data encryption, and security best practices across the data stack
- Monitor and optimize cloud infrastructure costs, implement resource allocation strategies, and provide cost forecasting
Benefits
- Generous Paid Time Off
- Medical, dental & vision care
- HSAs with company contributions
- Health FSAs
- Dependent daycare FSAs
- Commuter benefits
- Relocation
- 401(k) plan with employer match
- A variety of life & accident insurances
- Fertility programs
- Adoption assistance
- Generous parental leave
- Tuition reimbursement
