Databricks Engineer

Databricks Engineer

The Opportunity:  

For an organization to transform in today’s digital world, it needs to properly collect, store, and organize its data. Effective data management can enable more efficient operations and better mission outcomes. As a Databricks engineer, you know how to apply a practical, analytical mindset to design and operate cloud data platforms that teams can trust. We’re looking for an experienced data architect like you to deliver leading-edge solutions.

As a Databricks engineer on our team, you’ll use your technical expertise to design, build, and operate Databricks Lakehouse solutions in the Azure ecosystem. You will develop and support Azure Data Factory pipelines that promote datasets from the client’s enterprise applications into the Databricks bronze, silver, and gold medallion architecture. You’ll resolve data platform issues in collaboration with architects, analysts, and engineering teams by analyzing pipeline and data-quality problems, recommending Lakehouse patterns, and helping the team decide how source data should land, be refined, and be published for analytics.

In this role, you’ll apply Databricks and Azure best practices and use tools such as Azure Data Factory, Azure storage and identity services, Apache Spark, PySpark, SQL, Delta Lake, and Unity Catalog to design data models, build reliable ETL/ELT pipelines, and deliver analytics-ready datasets. You’ll also develop and support analytics in Databricks, including dashboards, Genie agents, and data products consumed by external clients or downstream applications. You’ll help the team design, develop, and test cloud data components, and you’ll work with clients and developers, so requirements are met and solutions are delivered.

Join us. The world can’t wait. 

You Have:   

• 5+ years of experience building and operating production data platforms on Databricks
• Experience designing and implementing Lakehouse architectures using Delta Lake, Apache Spark such as PySpark or Spark SQL, and bronze, silver, and gold medallion patterns
• Experience developing and supporting Azure Data Factory pipelines that ingest and promote datasets from enterprise applications into Databricks
• Knowledge of the Azure data ecosystem, including Data Factory, Azure storage, identity and access, and how those services integrate with Databricks
• Knowledge of Unity Catalog, data governance, and access control on Databricks
• Ability to design, develop, troubleshoot, and optimize batch and incremental ETL/ELT pipelines that move data from source systems through bronze, silver, and gold layers
• Ability to develop and support Databricks analytics, including SQL and Spark datasets, dashboards, and Genie agents used by internal teams or external clients
• Ability to collaborate with architects, developers, and mission stakeholders and translate requirements into working Azure Databricks solutions
• Public Trust
• Bachelor’s degree in Computer Science, Information Systems, or Engineering

Nice If You Have:   

• Experience with Databricks Asset Bundles, workspace CI/CD, and Git-based promotion across dev, test, and production
• Experience integrating Databricks with enterprise source systems such as Azure SQL or SQL Server
• Experience building Databricks dashboards and configuring Genie spaces or agents for business-user analytics
• Knowledge of schema evolution, MERGE-based incremental loads, liquid clustering or Z-ordering, and performance tuning on large Delta tables
• Ability to define reusable pipeline patterns, coding standards, and operational practices for a multi-table Lakehouse
• Databricks Certified Data Engineer Associate, Databricks Certified Data Engineer Professional, or Databricks Certified Platform Administrator Certification

Vetting:

Applicants selected will be subject to a government investigation and may need to meet eligibility requirements of the U.S. government client; Public Trust determination is required.

Compensation

At Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen’s benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page.

Salary at Booz Allen is determined by various factors, including but not limited to location, the individual’s particular combination of education, knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The projected compensation range for this position is $86,800.00 to $198,000.00 (annualized USD). The estimate displayed represents the typical salary range for this position and is just one component of Booz Allen’s total compensation package for employees. This posting will close within 90 days from the Posting Date.

Identity Statement

As part of the hiring process, we will ask you to complete an identity verification process that leverages advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud. You are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.

Candidate AI Usage Policy

AI is a part of our daily work at Booz Allen, and we are committed to the responsible and ethical use of AI tools. However, we want to ensure a fair candidate process based on your own skills and knowledge. As part of this commitment, the use of artificial intelligence (AI) or other tools to assist with responses during interviews (whether in-person or virtual) is prohibited unless permission is explicitly provided.

Work Model
Our people-first culture prioritizes the benefits of collaboration. To support engagement and effective communication, employees working virtually are generally expected to have their cameras on during meetings.

• Remote: If this position is listed as remote, there may still be occasions when you are required to work in person at a Booz Allen or customer facility.
• Hybrid: If this position is listed as hybrid, you will be expected to work from a Booz Allen or customer facility, in alignment with your leadership's expectations and the needs of the role.
• Onsite: If this position is listed as onsite, work will primarily be performed full-time at a customer facility, where employees will collaborate directly with colleagues and customers as required by the role.

Commitment to Non-Discrimination

All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state, local, or international law.