Senior Data Engineer

Job description

Kick-start your career in the online gaming world and experience the very latest in technology and innovation. Who we are We’re part of Super Group, the NYSE-listed digital gaming company behind some of the world’s leading Sports and iGaming brands. At DigiOutsource, we bring passionate people and innovative tech together to create market-leading online gaming solutions. Our multidisciplinary teams are passionate about products, customer experience and security. We’re empowered to achieve the ultimate in high-performance gaming experiences using the best technology available. Who we’re looking for We’re on a thrilling journey of growth and innovation, and we need passionate, driven individuals to join us. At DigiOutsource, every day is action-packed, and we expect you to bring your A-game. In return, you’ll find a supportive environment where your skills can flourish, and your career can soar. Ready to become a game-changer? Supercharge your career with us and be part of something extraordinary. Why we need you We’re on a mission to create extraordinary experiences for our customers, and we believe that your unique skills, passion and superdrive will help us achieve our vision. As a Senior Data Engineer, you'll be a key driver in our transition from an on-premises data infrastructure to a modern, scalable cloud lake house architecture. Your expertise in SQL querying, query optimization, stored procedures, data modelling, and streaming will support current operations while enabling the transformation to a cloud-first strategy. You’ll play a critical role in designing and implementing a future-ready data platform, ensuring seamless integration of real-time and batch processing with the latest technologies. Additionally, you’ll mentor and train junior team members, fostering their development and ensuring the team’s success in this transformative journey. What you’ll be doing Designing, developing, and optimizing robust data pipelines for on-premises and hybrid cloud environments. Leading efforts to migrate data and systems from on-premises databases to a cloud lake house architecture. Developing scalable data models for cloud-based storage and processing. Implementing and managing streaming data solutions using platforms like Kafka or RabbitMQ. Collaborating with cross-functional teams to integrate data from multiple sources into a unified data platform. Optimizing query performance and database structures to meet evolving business needs. Building and maintaining robust ETL/ELT processes to support cloud-native architectures. Driving the adoption of modern data lake house technologies such as Delta Lake, Apache Iceberg, or Apache Hudi. Mentoring and training junior team members to build their expertise in cloud data engineering. Staying updated on emerging cloud and lake house technologies to guide the data architecture evolution. Essential skills you’ll bring to the table The necessary skills that we require for this role include: Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or a related field (Master’s preferred). 5+ years of experience in data engineering or related roles. Relevant certifications (e.g., AWS Certified Data Analytics Specialty, Microsoft Certified: Azure Data Engineer, or Databricks Certified Data Engineer). Strong expertise in SQL, including querying, optimization, and writing stored procedures. Proven experience in cloud-based data platforms such as AWS Redshift, Azure Synapse, or Google BigQuery. Knowledge of cloud lake house technologies (e.g., Delta Lake, Apache Iceberg, or Apache Hudi). Hands-on experience with streaming platforms such as Kafka or RabbitMQ. Expertise in data modelling for both on-premises and cloud-based systems. Proficiency in Python, Java, or Scala for data engineering tasks. Experience with CI/CD practices for data pipelines in a cloud environment. Familiarity with data governance and security best practices in cloud environments. Strong leadership and mentoring skills, with experience guiding junior team members. Desirable skills you’ve got up your sleeve It would be great if you also have some of the following skills: Experience with big data technologies such as Hadoop, Spark, or Flink, especially in a cloud context. Knowledge of containerization tools like Docker and orchestration platforms such as Kubernetes. Expertise in monitoring and observability tools for cloud data pipelines. Certification in cloud platforms or lake house technologies (e.g., AWS Data Analytics Specialty, Databricks Certified Data Engineer). Background in implementing real-time analytics and event-driven architectures in the cloud. Understanding of cost optimization strategies for cloud-based data infrastructure. Experience in managing hybrid environments during migration from on-prem to cloud. Hands-on experience with serverless computing in cloud such as Lambda Functions. Hands-on experience with cloud analytics platforms such as Big Query or Databricks Proficiency in C# for general engineering tasks. Hashicorp Terraform for IaC workloads Automation using shell scripts (Powershell, Bash etc) Our values are non-negotiables Our culture is underpinned by core values that are linked to key behavioural competencies. Along with the below behavioural competencies, these are essential for all employees in order for you to embed in and drive our culture forward. These competencies are: Adaptability Ownership and accountability Initiating action Resilience Team orientation Integrity Innovation What you’ll get back We offer a great variety of personal and professional benefits to help you thrive at DigiOutsource and Super Group. This includes: We’re dedicated to your supergrowth. Our comprehensive learning and development programmes give you a range of resources and opportunities to expand your skills and advance your career. Your hard work and achievements won’t go unnoticed. Our innovative Performance Tool ensures you receive regular, constructive feedback, helping you to continuously improve and reach your full potential. Our Employee Assistance programme offers a variety of benefits which you and your family can benefit from. Free Daily Meal Free Massages On-site Free On-Site Gym Group Life Cover Funeral Fund Benefit Financial Services Assistance Employee Assistance Programme Curro School Fees Benefit Income Continuation Benefit Leadership Training Referral Bonus Medical Aid Subsidy Free Sleep Coaching On-site Barista Retirement Annuity Subsidy Team socials Be part of that Superclass feeling. At Super Group, diversity is part of our DNA. With teams across 16 countries, 85 nationalities, and 27 languages, we take equal opportunities seriously, championing a supportive, inclusive, and empowering environment wherever you are in the Group. It’s all about putting your experience first and ensuring honesty and fairness in all we do. Here, your growth is supported and your contributions valued. Game on! *Please note we will apply relevance to our Talent Management and Talent Development Programme as part of our recruitment process. *Shortlisted candidates may need to complete an assessment. This position requires trust and honesty it has access to customers financial details - therefore a credit and criminal record check will be conducted. The qualifications identified herein are an inherent job requirement; therefore, a qualification verification check will be done. By applying for this role, and supplying the necessary details, you hereby grant us permission to apply for these checks. This will be done in a confidential manner, and solely for the purposes of verification. Should you not hear from us within 2 weeks, please deem your application as unsuccessful. The perfect place to work, play and grow!