Data Agility is an IT consulting company based in Melbourne. We help organisations get more value from their data. We’re looking for a hands-on Databricks Architect with strong technical business analysis skills to lead a data platform engagement for one of our public sector clients.
The opportunityThis is a Databricks Optimisation Proof of Value project. You’ll show how Azure Databricks can improve data processing, scalability, maintainability and operating efficiency across an enterprise data and analytics environment.You’ll use a real reporting workload to shape how processing and data models are rebuilt in Databricks. You’ll also design and test a future Common Data Layer, including reusable data and publishing patterns, governance, access, metadata and lineage. Your recommendations will directly inform the organisation’s broader platform modernisation and Databricks adoption.You’ll work closely with project managers, data architects, analysts and subject matter experts. You’ll be the person who connects the technical design with what the business needs.
What you’ll doAssess target-state Databricks and data layer architecture options, including performance and cost trade-offsDevelop a phased implementation roadmap with key dependenciesDefine platform requirements for processing, data quality, metadata, lineage, scalability, performance, monitoring and costDesign the data platform operating model: ownership, governance, onboarding, publishing and consumption, access management, support and change managementProduce system integration specifications covering data flows, interfaces and dependenciesRun technical and business workshops, and turn the outcomes into epics, features and user stories in Azure DevOpsSupport solution showcases and UAT, and lead handover and knowledge transferWhat you’ll bringStrong, hands-on experience architecting solutions on Azure Databricks and the broader Microsoft Azure data stack, such as Delta Lake, Unity Catalog, Data Factory and ADLSA track record of assessing data architecture options and delivering implementation roadmapsExperience defining platform requirements for data quality, metadata, lineage, performance, monitoring and cost optimisationExperience designing data platform operating models and governance frameworksAt least 3 years in reporting and/or data analytics project deliveryTechnical BA skills: requirements, user stories, process mapping and integration specifications in an Agile environmentStrong SQL skills, plus Python or PySparkConfidence leading workshops and working with technical teams, business stakeholders and product ownersDetailsContract role, starting late October 2026 and running until early March 2027Melbourne-based, hybrid role, with an expectation to be on-site with the client 2–3 days per week.