We are seeking a talented individual to join our team at Marsh. This role will be based in Toronto, ON. This is a hybrid role that has a requirement of working at least three days a week in the office.
We are seeking an AI Developer to design, build, and maintain scalable backend services and APIs in Python, with a strong focus on Flask and FastAPI, including both synchronous and asynchronous patterns. The position also involves developing production-grade AI and LLM capabilities such as REST and WebSocket APIs, RAG pipelines, agent/tool-calling workflows, and model evaluation and optimization across GPT and open-source solutions.
We will count on you to:
Design, build, and maintain scalable backend services and APIs in Python, with a focus on Flask and FastAPI.
Write clean, efficient Python code with strong attention to performance, reliability, and security.
Develop production-ready AI and LLM APIs, including REST and WebSocket streaming, authentication, and access control.
Implement LLM solutions using GPT and open-source models, including prompt design, evaluation, versioning, and cost/performance optimization.
Build and maintain RAG pipelines, including ingestion, embeddings, vector search, and agent/tool-calling workflows.
Integrate external and internal tools and data sources for LLM-based agents, such as databases, APIs, file systems, and messaging platforms.
Work with SQL Server and PostgreSQL, including schema design, efficient queries, transaction handling, and ORM tools like SQLAlchemy.
Apply classical machine learning and statistical techniques when they offer a simpler or more cost-effective solution.
What you need to have:
3+ years of experience in a corporate IT environment.
1+ year of experience in AI, machine learning, Python, Flask, and FastAPI, or a combination of at least three of these areas, with AI required; strong software design, debugging, and performance profiling skills.
Solid knowledge of SQL Server and PostgreSQL, including schema design, indexing, optimization, and ORM experience.
Experience maintaining security, privacy, and compliance best practices, including secret management, data handling, and access control.
Strong commitment to writing secure, reliable, well-documented code that meets quality standards.
What makes you stand out:
Exposure to containerization and orchestration (Docker, Kubernetes) for deployment workflows.
CI/CD familiarity (e.g., GitHub Actions) for automated testing, build, and deployment pipelines.
Light JavaScript for integration or tooling.
Organized, self-directed, and deadline-focused in distributed team environments.
Fast learner, quality conscious and committed to deadlines
Why join our team:
We help you be your best through professional development opportunities, interesting work and supportive leaders.
We foster a vibrant and inclusive culture where you can work with talented colleagues to create new solutions and have an impact on colleagues, clients and communities.
Our scale enables us to provide a range of career opportunities, as well as benefits and rewards to enhance your well-being.