Senior Databricks Architect

Senior Databricks Architect

Key responsibilities

Presales, client facing andsolutioning

• Partner withlead consultantstoidentify, design and develophighvalue Databricks use cases.

• Design anddeploy best in classarchitectures for data, analytics, and AI platforms built on Databricks and cloud services (Azure, AWS, or GCP).

• Identifyopportunities to create IP and packageable solutions based on observed patterns and customer whitespaces

• Drive architectural discussions with Client SME’s and technical resources during design phase of engagements

• Address technicalobjections andbuild confidence with client architects and executives during the salesand deliverycycle.

​

Architecture and delivery leadership

• Lead the design anddevelopmentof secure, scalable Databricks Lakehouse architectures, including Delta Lake, Unity Catalog, and integration with upstream and downstream systems.

• Overseeandparticipateinthebuildof batch and streaming data pipelines, notebooks, and Databricks SQL assets using Spark, Python, and SQL, following medallion and other bestpractice patterns.

• Help define and enforce engineering standards, including code quality, testing, CI/CD, observability, and operational readiness for Databricks workloads.

• Collaborate with project managers and client stakeholders to plan releases, manage dependencies, mitigate risks, and ensure ontime,onbudgetdelivery.

• Provide handson technical leadership to data engineers and analysts,reviewdesignsand code, andunblockcomplex technical issues.

​

Governance, operations, and adoption

• Implement data governance and security practices using Unity Catalog and related tools, including access control, lineage, andcompliance alignedpolicies.

• Optimizeperformance, reliability, and cost of Databricks workloads through cluster tuning, storage strategies, and monitoring.

• Drive change management and enablement by creating documentation, runbooks, and training materials, andfacilitatingknowledge transfer to client teams.

• Supportproduction,golive stabilization, ensuring robust handover to client operations or managed services teams.

​

Required qualifications

• Excellent communication and presentation skills, with the ability to influence technical and nontechnical audiences.

• Demonstrated ability to gatherrequirements, andtranslate business needs into technical designs and phased roadmaps.

• Proven experiencedriving architecture and design indata or analytics projects in a consulting, professional services, or similar environment.

• Extensivehandsonexperience designing and delivering data platforms and pipelines on Databricks, including Delta Lake, Jobs/Workflows, and Databricks SQL.

• Strong programming skills in at least two of: Python,PySpark, and SQL, withdemonstratedability to buildperformantbatch and streaming solutions.

• Solid understanding of cloud services (Azure,AWS,or GCP) relevant to Databricks deployments, such as storage, networking, identity, and DevOps tooling.

• Experience implementing data governance, security, and access control in Lakehouse or data platform environments using Unity Catalog or similar tools.

​

Preferred qualifications

• Experience with largescale data platform migrations or modernizations (e.g., from legacy ETL/warehouse tools to Databricks).

• Exposure toenablingML/AI and GenAI workloads on Databricks, such as feature engineering pipelines,MLflow, or integration with LLM/GenAI services.

• Multi-industrybackground(e.g., financial services, healthcare, manufacturing, public sector) with an understanding of common data and analytics use cases.

• Priorresponsibility for mentoringengineers, or leadingmulti-workstream