Databricks Engineer

Job description

This is your opportunity to join AXIS Capital – a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our outstanding client service, intelligent risk taking and superior risk adjusted returns for our shareholders. We also proudly maintain an entrepreneurial, disciplined and ethical corporate culture. As a member of AXIS, you join a team that is among the best in the industry. At AXIS, we believe that we are only as strong as our people. We strive to create an inclusive and welcoming culture where employees of all backgrounds and from all walks of life feel comfortable and empowered to be themselves. This means that we bring our whole selves to work. All qualified applicants will receive consideration for employment without regard to race, color, religion or creed, sex, pregnancy, sexual orientation, gender identity or expression, national origin or ancestry, citizenship, physical or mental disability, age, marital status, civil union status, family or parental status, or any other characteristic protected by law. Accommodation is available upon request for candidates taking part in the selection process. How does this role contribute to our collective success? The Data & Analytics organization empowers AXIS to make informed, data‑driven decisions by delivering trusted, scalable, and well‑governed data platforms. As a Data Engineer, you will work closely with the Solution Engineer and Data Architecture teams to design, build, and operate data integration and analytics solutions. You will play a key role in translating architectural designs and solution patterns into high‑quality, production‑ready implementations. This role contributes to AXIS’s success by strengthening delivery capacity, improving platform reliability, and ensuring data engineering best practices are consistently applied across squads — while being supported by senior architectural leadership. What will you do in this role? As a Data Engineer, you will be a hands‑on contributor and technical partner, supporting solution design and architecture initiatives led by the Solution Engineer, while owning implementation quality and operational excellence. Key Responsibilities: Data Integration & Ingestion Design and implement data integration solutions in collaboration with the Solution Engineer and data architects. Support ingestion, transformation, and orchestration using ADF, Synapse pipelines, Databricks Workflows, and event‑based patterns. Implement batch, incremental, and event‑driven ingestion using agreed reference architectures. Maintain and extend data integration frameworks. Data Modeling & Consumption Contribute to data modeling standards (Dimensional, Data Vault, Lakehouse). Implement analytics‑ready models and semantic layers for BI and ML. Apply agreed data contracts and integration patterns. Governance, Security & Compliance Implement data cataloging, lineage, and data quality controls. Apply RBAC, ABAC, encryption, and auditability controls. Performance & Operational Excellence Optimize Databricks performance, cost, and storage layout. Monitor and troubleshoot pipelines and workloads. Platform Evolution & Collaboration Support platform modernization, POCs, and migrations. Contribute to engineering standards and participate in design reviews. Partner with offshore teams, architects, and business stakeholders. You may also be required to take on additional duties, responsibilities and activities appropriate to the nature of this role. About You You are an experienced data engineer who enjoys working on complex platforms, delivering high‑quality implementations while leveraging guidance from senior architectural leadership. Role Factors: The position is full-time with work-from-home options, requiring in-office presence three (3) days per week Required Skills & Experience Bachelor’s degree in Computer Science, Information Technology, or a numerate discipline. At least 5 years of experience in data engineering roles. At least 3 years of hands‑on Databricks and Delta Lake experience. Strong Azure data platform expertise (Databricks, ADF, Synapse, Event Hubs, Functions, ADLS Gen2, Key Vault, DevOps). Proficiency in Spark, PySpark, and SQL. Experience implementing Medallion / Lakehouse architectures. Familiarity with data governance, Unity Catalog, and DQ frameworks. Understanding of security, compliance, CI/CD, and IaC (Bicep/Terraform). MLOps and AI platform knowledge: MLflow, feature stores, model lifecycle and deployment patterns. Strong communication and collaboration skills. Preferred Qualifications: Azure certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect). Experience with Terraform, ARM templates, or Bicep for infrastructure automation. Experience with GenAI, and using AI agents, use of Copilot, Claude, or similar models for automation or process optimization to reduce day to day manual work. Experience integrating Azure Data Services with Power BI and AI/ML workflows. What We Offer: For this position, we currently expect to offer a base salary in the range of $80,000 - $100,000 CAD (Nova Scotia), $90,000 - $105,000 USD (Alpharetta). Your salary offer will be based on an assessment of a variety of factors including your specific experience and work location. You will be eligible for a comprehensive and competitive benefits package which includes medical plans for you and your family, health and wellness programs, retirement plans, tuition reimbursement, paid annual leave, and much more. Where this role is based in the United States of America, this role is Exempt for FLSA purposes.