Principal Data Engineer (AWS)

Job description

Principal Data Platform Engineer (AWS) You are passionate about solving complex problem with the latest tech We're the largest and most advanced Data Engineering teams in the country. Together we build tomorrow’s bank with world class engineering Do work that matters The Capital Provisioning Modelling Crew builds and runs the platforms that support how credit risk models are developed, validated, implemented, and monitored aligning to the Model Development Lifecycle Methodology (MDLC), processes, and procedures. The outcomes produced by these models are used in managing the Group Risk Management functions including front line business processes as well as for regulatory reporting including loss provisioning, portfolio analysis, and reporting. These are critical, model-driven systems operating under regulatory scrutiny, where accuracy, control and reliability are essential. As a Principal Engineer, you will shape the engineering direction for platforms that enable data consumption, model execution and deployment at scale, while meeting strong governance and control requirements. See yourself in the team You’ll be part of the Capital Provisioning Modelling Crew, working across credit risk modelling, data and platform engineering. The crew focuses on: Consuming trusted data from enterprise data marketplace Enabling model execution and orchestration at scale Supporting SageMaker-based model deployment and ML workloads Driving modernisation and decommissioning of legacy and sandpit environments Delivering efficiencies into the framework and tools that can help deliver the models in a safe, sound, and secure way Embedding controls, lineage and auditability by design As a Principal Engineer, you will Define and drive platform strategy for capital provisioning modelling Architect and build cloud-native platforms (AWS) supporting model and data workloads Provide thought leadership and contributes to the design of technical solutions and consumption patterns, including data security and data management. Design solutions that consume and operationalise enterprise data marketplace assets Lead engineering patterns for model and ML deployment, orchestration and monitoring Drive migration from legacy platforms to strategic, governed environments Ensure alignment with Model Risk Management, regulatory and audit requirements, including: Data lineage and traceability Reproducibility of model outputs Strong controls and validation Partner with modelling teams to productionise models and improve reliability and performance Influence architecture and engineering decisions across crews and domains Set and uplift engineering standards and practices Mentor engineers and contribute to a high-performing engineering culture We’re interested in hearing from people who Have strong experience building cloud-native data and model platforms at scale Have experience productionising models or ML workloads Have experience in building frameworks and tools that can significantly improve engineering productivity Understand data integrity, reconciliation, and accuracy in financial systems Can influence across teams and align stakeholders on technical direction Have a natural drive to educate, communicate, and coordinate with different internal stakeholders and consultants. Are comfortable balancing technical debt with long-term platform strategy Technical experience We use a broad range of tools, languages, and frameworks. We do not expect you to know them all but experience or exposure with some of these, or a willing to learn these skillsets (or equivalents) will set you up for success in this team! AWS (S3, EMR, Glue, Lambda, Redshift, SageMaker or similar) Snowflake or enterprise data platforms / data marketplace patterns Python, PySpark and distributed data processing Batch and streaming data pipelines (e.g. Airflow, Spark, Glue) CI/CD, automated testing and infrastructure-as-code Observability, monitoring and reliability practices Strong SQL and relational database experience Working with us Our people bring their diverse backgrounds and unique perspectives to build a respectful, inclusive, and flexible workplace with flexible work locations. One where we’re driven by our values, and supported to share ideas, initiatives, and energy. One where making a positive impact for customers, communities and each other is part of our every day. Here, you’ll thrive. You’ll be supported when faced with challenges and empowered to tackle new opportunities. We’re hiring engineers from across all of Australia and have opened technology hubs in Melbourne and Perth. We really love working here, and we think you will too. We support our people with the flexibility to balance where work is done with at least half their time each month connecting in office. We also have many other flexible working options available including changing start and finish times, part-time arrangements and job share to name a few. Talk to us about how these arrangements might work in the role you’re interested in. If this sounds like the role for you then we would love to hear from you. Apply today! If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career. We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696. Advertising End Date: 30/08/2026