We are seeking a Staff Software Engineer / Staff GenAI Engineer to provide technical leadership in the design, development, and deployment of AI-driven platforms and products. This role combines hands-on engineering expertise with architectural ownership and client-facing consulting responsibilities.
Key Responsibilities
Lead the architecture, design, and development of scalable backend systems integrating machine learning and Generative AI models into production-grade applications.
Drive end-to-end delivery of GenAI solutions, including LLM-based systems, RAG architectures, and agentic workflows, from experimentation to production.
Design and implement agentic AI systems enabling multi-step reasoning, tool calling, memory management, and orchestration.
Apply a strong understanding of machine learning techniques (regression, classification, clustering, decision trees, neural networks, probabilistic models) to solution design and implementation.
Collaborate closely with data scientists to train, fine-tune, evaluate, and deploy ML/AI models, ensuring reliability and performance at scale.
Work with structured and unstructured data sources, designing efficient data pipelines and storage strategies.
Lead development of backend microservices and APIs supporting AI-driven applications.
Ensure production readiness of AI systems, including performance optimization, monitoring, cost control, and security.
Define cloud-native deployment strategies for AI solutions on AWS, Azure, and GCP.
Establish containerized deployment standards using Docker and Kubernetes across development and production environments.
Oversee data architecture, performance, and integrity across SQL and NoSQL databases (PostgreSQL, MongoDB).
Implement monitoring and logging frameworks to ensure reliability, observability, and operational excellence of AI systems.
Lead the development of AI-powered SaaS products within the Heka.ai platforms.
Tactical & cross-team leadership
Be a DRI for major architectural initiatives and blueprints; own design docs and migration plans.
Maintain ownership of triage and incident prioritization; advocate severity/priority to stakeholders.
Serve as a maintainer/owner for multiple critical repositories, tech stacks, or services.
Mentor engineers formally; grow others via code reviews, pairing, and career coaching.
Break down large efforts into epics and MVCs; coordinate cross-team delivery.
Facilitate or lead working groups for cross-cutting initiatives (performance, APIs, security, standards).
Represent your group to leadership: engineering allocation, reliability status, and iteration health.
Participate in hiring: design interviews, assess candidates, and recommend bias-reduction improvements.
Participate in Diversity, Inclusion & Belonging initiatives and mentorship programs