POSITION: Senior Associate, reporting to Associate Director - Engineering, will play an essential role in designing, developing, and maintaining scalable data pipelines and data infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data systems are efficient, reliable, and capable of supporting complex analytical queries. Your role will involve a mix of hands-on technical work and strategic planning to support the organization's data needs. To be successful as a Senior Data Engineer at Eversana, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills include familiarity with several programming languages and learning machine methods.
RESPONSIBILITIES:
ā¢ Design, build, and maintain scalable data pipelines that facilitate the flow of data into machine learning models.
ā¢ Collaborate with data scientists to ensure the availability of high-quality, preprocessed data for model training.
ā¢ Deploy machine learning models to production using tools such as TensorFlow Serving, MLflow, or Seldon.
ā¢ Monitor and maintain the performance of machine learning models in production, identifying and addressing issues like data drift or concept drift.
ā¢ Work with large datasets, both batch and real-time, using frameworks like Apache Spark, Apache Kafka, and AWS Glue.
ā¢ Implement and manage data versioning and experiment tracking using tools like DVC and MLflow.
ā¢ Ensure data integrity and quality through validation and profiling techniques