Design and configure enterprise-scale Azure Databricks workspaces optimized for high-severity insurance use cases.
Architect and implement Unity Catalog as the central governance layer, managing access controls, lineage, and data compliance.
Develop ingestion pipelines using Lakeflow Connect and Auto Loader to integrate data from Policy Administration Systems, Systems of Record (SOR), and legacy file servers.
Deploy and manage Mosaic AI Vector Search and Model Serving endpoints to support Retrieval Augmented Generation (RAG) workflows.
Establish and govern Databricks Agent Services frameworks to enable supervisor-worker AI architectures.
Standardize platform observability, including MLflow lifecycle management, model performance tracking, auditability, and system health monitoring.
Ensure secure Azure infrastructure integration using VNet injection, Private Link, and Entra ID (Azure AD).
Lead CI/CD integration and orchestration using Databricks Jobs for multi-task scheduling and automated deployments.
Ensure regulatory compliance and data privacy standards for sensitive insurance, litigation, and claimant data.