Senior Data Engineer

Experian is a global data and technology company powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software.

Requirements

• Design, develop and support ETL data pipelines solutions primary in AWS environment
• Design, develop, and maintain scaled ETL process to deliver meaningful insights from large and complicated data sets
• Work as part of a team to build out and support data warehouse, implement solutions using PySpark to process structured and unstructured data
• Play key role in building out a semantic layer through development of ETLs and virtualized views
• Collaborate with Engineering teams to discovery and leverage new data being introduced into the environment
• Support existing ETL processes written in SQL, or leveraging third party APIs with Python, troubleshoot and resolve production issues
• Strong SQL and data to understand and troubleshoot existing complex SQL
• Hands-on experience with Apache Airflow or equivalent tools (AWS MWAA) for orchestration of data pipelines
• Create and maintain report specifications and process documentations as part of the required data deliverables
• Serve as liaison with business and technical teams to achieve project objectives, delivering cross functional reporting solutions
• Troubleshoot and resolve data, system, and performance issues
• Communicating with business partners, other technical teams and management to collect requirements, articulate data deliverables, and provide technical designs

Benefits

• Best family well-being benefits
• Enhanced medical benefits
• Paid time off