Data Operations Engineer

Job description

We are seeking a hands-on Data Operations Engineer (DataOps) to join our growing Data team and report to our Data Technical Lead. In this role, you will take ownership of the day-to-day health, reliability, and performance of our ETL/ELT data pipelines. You will ensure data flows accurately and efficiently across our platforms by monitoring pipeline performance, responding to issues, improving reliability, and creating greater visibility into how data moves through our environment. Working alongside data analysts, engineers, and IT teams, you will play a key role in supporting our Microsoft Fabric, Power BI, SQL, and PySpark environments. Your focus will be on operational excellence - ensuring issues are identified early, processes are well documented, and our data platform remains robust and scalable. As Abano continues to expand its use of AI-powered solutions, you will also contribute to supporting and improving AI services, copilots, and automation platforms built using Microsoft technologies. Key Responsibilities Monitor the health and performance of ETL/ELT pipelines across Azure SQL Data Warehouse and Microsoft Fabric environments. Investigate, troubleshoot, and resolve pipeline failures and data-quality issues to ensure reliable data delivery. Identify recurring issues, performance bottlenecks, and opportunities to optimise data processes. Develop and maintain monitoring, alerting, and notification frameworks to proactively identify issues. Improve visibility of data flows, including pipeline dependencies, schedules, and data lineage. Create and maintain clear documentation, operational runbooks, and data flow processes. Implement data validation and reconciliation checks to maintain data accuracy and integrity. Collaborate with the Data Technical Lead, data analysts, IT teams, and system owners to resolve data issues and support reporting requirements. Support downstream Power BI reporting datasets and business intelligence solutions. We are looking for someone with strong technical capability, a proactive mindset, and a passion for building reliable data solutions. Essential Skills & Experience Strong SQL skills with the ability to write, troubleshoot, and optimise complex queries. Experience operating, monitoring, and troubleshooting ETL/ELT data pipelines. Experience with Microsoft Fabric Data Factory and/or Azure Data Factory. Working knowledge of PySpark for data processing and transformation. Understanding of Microsoft Fabric ecosystem, including OneLake, Data Engineering, and Lakehouse concepts. Knowledge of modern Data Lakehouse and Medallion architecture principles. Experience with monitoring, logging, and alerting approaches for data pipelines. Strong documentation skills with the ability to make complex systems easy to understand. Understanding of how data feeds downstream Power BI datasets and reports. Strong analytical and troubleshooting skills with the ability to manage incidents calmly and effectively. Excellent communication skills, with the ability to explain technical issues to both technical and non-technical stakeholders. Desirable Experience Experience building AI agents, copilots, or automation solutions using Microsoft Copilot Studio, Azure AI Foundry, Azure OpenAI, or Power Platform. Experience implementing Retrieval-Augmented Generation (RAG) solutions using enterprise data sources. Knowledge of AI governance, responsible AI practices, and model evaluation. Exposure to DataOps or DevOps practices, including CI/CD, version control, and deployment pipelines. Experience with data cataloguing and lineage tools. Previous experience supporting data platforms within a regulated or healthcare environment. At Abano Healthcare, you’ll have the opportunity to play a key role in supporting a next-generation data platform that directly impacts how our organisation operates and delivers exceptional patient care. You’ll join a collaborative and forward-thinking team where your expertise will help shape the future of our data environment. What we offer: A full-time role within Australasia’s largest dental support organisation. Flexible hybrid working environment. The opportunity to work with modern Microsoft data technologies. A collaborative team culture where innovation and continuous improvement are encouraged. The chance to make a visible impact by improving how our business uses data every day. If you are passionate about data reliability, operational excellence, and using technology to make a difference, we’d love to hear from you. At Abano Healthcare, we are Australasia’s largest dental support organisation, supporting clinical excellence and exceptional patient care across our network of dental practices. We are undergoing an exciting technology transformation, modernising our data infrastructure to better support our clinics and business operations. As part of this journey, we are transitioning from a legacy Azure SQL Data Warehouse to a modern Microsoft Fabric environment, creating smarter, more connected, and more efficient ways of working with data. Our Data team plays a critical role in enabling better decision-making across the business, and we are looking for talented individuals who want to be part of shaping the future of healthcare technology.