Purpose
The senior data engineer develops, constructs, tests and maintains architectures, such as databases and large-scale processing systems, and ensures that architecture fully supports requirements of the business. Plays a collaborative role where he/she works closely with the business’s Data and Analytics teams, gathering technical requirements for exceptional data governance.
WHAT WILL YOU DO?
- Analyses complex data elements and systems, data flow, dependencies, and relationships in order to contribute to conceptual physical and logical data models.
- Designs, builds, implementation and maintain the database structures to support business needs including integration of vendor database solutions into data environment.
- Contributes to the development of the capacity planning function to properly identify needed hardware, software, database configuration / architecture to support application / business needs.
- Manages the life cycle of multiple database tools by enabling smooth upgrades and/or installation and support of new capabilities.
- Data munging, manipulation, cleansing and blending from multiple data sources and exposure to various data types and storage paradigms including data mining.
- Works with data to solve business problems and build and maintain the infrastructure to answer questions with data.
- Develops and manages scalable data processing platforms used for exploratory data analysis and real-time analytics.
- Oversees activities of the junior data engineers, ensuring proper execution of their duties and alignment with business vision and objectives.