Why This Role Matters
Azira is seeking a Senior Data Engineer to oversee all Data Engineering activities. In this role, you will utilize your extensive knowledge to design, define, develop, deploy, and manage secure, scalable data pipelines. Responsibilities include planning and executing the data engineering roadmap, as well as implementing improvements. You will work independently to tackle challenging problems and set the pace.
This position offers the opportunity to join Azira's Engineering team, providing exposure to large-scale data and cutting-edge technology stacks. Your role involves enhancing data techniques and collaborating with Data Scientists, Software Engineers, and UI Engineers to solve complex problems as part of a high-performance team.
What You’ll Do
● Develop and optimize scalable data processing pipelines for diverse data sources, formats, and content at a petabyte scale on the Azira Platform.
● Hands-on role involving coding, system architecture, and tackling complex technical challenges.
● Enhance product development, contributing to Azira’s Operational Intelligence & Marketing Intelligence solutions.
● Ensure high-quality product delivery by designing and executing comprehensive integration tests.
● Conduct code and design reviews to drive efficiency and innovation within Data Engineering modules.
● Plan and optimize system capacity, defining resource requirements for various deployment scenarios.
● Create clear and concise documentation, including deployment guides and technical references.
● Work in an agile environment, actively tracking and updating tasks/stories.
● Understand business needs, ensuring applications align with operational goals.
● Collaborate cross-functionally to develop creative solutions.
● Strong interpersonal and communication skills, effectively translating business requirements into data-driven solutions while working with diverse stakeholders.
What You Bring
● Experience: 6-9 years of overall experience, with at least 3 years in a data-driven company/platform.
● Big Data Expertise: Hands-on experience with at least one distributed big data processing framework such as Apache Spark, Apache NiFi, Hadoop, Airflow, Apache Kafka, Apache HBase, or Redshift.
● Programming Skills: Proficiency in Java is essential; Scala experience is a plus.
● Cloud & System Design: Experience with AWS cloud, along with a strong grasp of algorithms, data structures, and design patterns.
● Technical Proficiency: Expertise in frameworks, distributed systems, and NoSQL databases (Kafka, HBase, Spark, Cassandra, MongoDB).