Summary
We seek a skilled Data Engineer to join a data team supporting the rebuild of a core analytics platform. The project involves modernizing existing data processes and developing reliable data solutions using strong SQL, Python, Bash scripting, and AI-assisted development practices.
Responsibilities
- Develop, test, and maintain SQL, Python, and Bash solutions to support data engineering and migration activities.
- Analyze and reverse engineer existing Sybase IQ/Informatica data pipelines, ETL processes, SQL, and transformation logic to support migration to the target platform.
- Build and maintain data processing pipelines, transformations, and automated workflows within the modern data environment.
- Perform data validation, reconciliation, and quality checks between existing and newly developed processes to ensure accuracy and completeness.
- Automate routine engineering, data processing, and operational tasks using Python and Bash.
- Leverage AI tools for code development, debugging, testing, automation, and overall engineering productivity.
- Collaborate with senior engineers and cross-functional teams to troubleshoot issues, understand business use cases, document solutions, and ensure deliverables align with project objectives