Data Engineer

Job description

Do you live and breathe all things data related? We are looking for a data engineer to join our growing team. Are you passionate about the technical aspects of OUTs data landscape? See it as a challenge to build processes that are optimised to run as quick as possible, delivering quality data sets that can be reused by multiple teams. As a data engineer within our team, you will be responsible for developing best practices and patterns, maintain our current workloads, optimize our data warehouse builds, data pipelines, and data products. The data engineer will support multiple stakeholders, including software development, actuarial, payroll and finance analytical teams. Your Duties and responsibilities: Design, build and maintain scalable and reliable data pipelines to process large volumes of data from various sources. Develop and maintain data models, databases, and data warehouses to support the analytic teams reporting needs. Ensure data quality and accuracy by implementing data validation and monitoring processes. Collaborate with data scientists, analysts, and other stakeholders to understand their data needs and provide solutions to support their work. Excellent written and verbal communication skills; with the ability to explain complex problems in a simple and effective manner. Team Responsibilities: To design and build highly available, scalable, and fault-tolerant data infrastructure to support data processing. Develop and maintain infrastructure automation tools, deployment pipelines, and monitoring systems. Core to this is the team’s collaboration with other engineers, data scientists, and analysts to ensure the availability and performance of the data infrastructure. We evaluate new data technologies and tools that enhances the performance and reliability of the data infrastructure and drive adoption of these technologies within the bigger data community. Create best practise “formulas” that aligns with OUTs data strategy and assist the analytical teams in adopting them. Competencies Ability to apply industry best practices Ability to give input into innovative solutions Ability to work under pressure and tight deadlines Self-motivated and a self-starter Ability to work in a team environment Technologies used on-prem SQL Server SSRS SSAS Power BI Technologies used in cloud Apache Airflow Databricks Azure Datalake Storage Cosmos database Bachelor's degree in Computer Science, Engineering, or a related field. 3+ years of experience in data engineering or related fields. Proficiency in at least one programming language (Python, C#, etc.) and SQL. Proven experience with data modelling, ETL processes, and data warehousing. Experience with cloud platforms such as AWS, GCP, or Azure Understanding of data processing technologies and data management principles Familiarity with data technologies such as Synapse, Databricks, DeltaLake, and AirFlow An ideal candidate will be able to align their personal work values to the OUTsurance values of Awesome Service, Dynamic, Honest, Human, Passionate and Recognition. At OUTsurance our value of HUMAN is more than just a poster on the wall. It’s a key part of our culture, we are committed to fostering an inclusive and diverse workplace that reflects the communities we serve. We actively encourage applications from persons with disabilities. In support of our Employment Equity objectives, we strive to create equal opportunities for all and welcome candidates from designated groups who meet the role requirements. OUTsurance has been propelling the South African insurance industry forward for the last 28 years. As leaders in the field, we’re always looking for innovative ways to create digitally-advanced solutions, without losing sight of our human values. Our continued success can be attributed to outstanding employees who set the bar high with their energy and expertise. If you’re keen to grow your career in a vibrant environment with lots of ‘fun’, this could be the career opportunity you’ve been looking for.