Job Description

Design and implement data ingestion pipelines for batch and streaming data
Configure and maintain data orchestration workflows (Airflow, NiFi) and CI/CD automation for data processes
Design and organize data layers within Data Lake architecture (HDFS, Iceberg, S3)
Build and maintain secure and governed data environments using Apache Ranger, Atlas, and SDX
Develop SQL queries and optimize performance for analytical workloads in Hive/Impala
Collaborate on data modeling for analytics and BI, ensuring clean schemas and dimensional models
Support machine learning workflows using Spark MLlib or Cloudera Machine Learning (CML)

About Sigma Software

Sigma Software