Requirements

8+ years of experience developing APIs with Python.
2+ years of hands-on experience working with LLMs.
Strong expertise in Python and REST API development using FastAPI or Flask.
Deep knowledge of microservices architecture and containerization (Docker, Kubernetes).
Strong background in AI, machine learning, and natural language processing.
Experience working with LLM APIs (OpenAI, Anthropic) and frameworks (LangChain, LlamaIndex).
Solid understanding of RAG concepts, vector databases, and semantic search.
Experience implementing LLM guardrails, monitoring, and observability.
Strong knowledge of event-driven architectures and messaging systems.
Proven experience deploying AI/ML solutions in large, business-critical production environments.
Strong backend security knowledge (authentication, authorization, data protection).
US/Canada based (preferably Eastern Time Zone).

Responsibilities

Design, develop, and maintain scalable REST APIs using Python frameworks such as FastAPI or Flask.
Architect and deploy microservices in containerized environments (Docker, Kubernetes).
Build and productionize LLM-powered applications using APIs such as OpenAI and Anthropic.
Design and implement RAG systems integrating vector databases and semantic search.
Develop and manage AI workflows using frameworks like LangChain and LlamaIndex.
Implement Model Context Protocol (MCP) and multi-agent systems for complex AI use cases.
Develop and optimize prompt strategies for various generative AI applications.
Deploy generative AI solutions to production at scale beyond proof-of-concept stages.
Implement LLM guardrails, monitoring, and observability to ensure reliability and safety.
Build secure, event-driven backend systems with strong authentication and data protection practices.
Debug, optimize, and enhance backend system performance for business-critical AI applications.

Senior Staff Engineer (Fast API)

Job Description