We are looking for a "full-stack" Data Engineer to build the backbone of our data infrastructure and own the end-to-end data lifecycle. You will architect enterprise-grade systems and build products that drive digitalisation, while tackling high-volume challenges such as processing half-hourly meter reads for our energy customers.
Your responsibilities will include:
- Pipeline Architecture: Design, build, and maintain robust ETL/ELT pipelines to ingest large-scale datasets and high-frequency streams.
- Enterprise Warehousing: Lead the design and evolution of our enterprise data warehouse, ensuring it is scalable and performant.
- Modern Transformation: Manage our data transformation layer using Dataform (preferred) or dbt to orchestrate complex, reliable workflows.
- Quality & Deployment: Implement automated testing frameworks and deploy scalable services using Docker and Kubernetes to ensure operational health.
- Stakeholder Partnership: Act as a strategic partner to Product and Engineering, facilitating data design sessions to optimise how data is ingested and utilised.
- Mentorship & Standards: Raise the bar for technical excellence within the squad through code reviews, design sessions, and documenting best practices.