Data Engineer - Real-Time

Job description

## **The Wow** This role sits at the heart of our real-time data platform, empowering teams to build, deploy, and scale data products that drive critical business decisions and customer experiences. You will design, develop, and operate the core platform capabilities that power streaming data pipelines, event-driven applications, and self-service data products. Working at the intersection of software engineering and data engineering, you will create scalable frameworks, tooling, and developer experiences that enable our teams to deliver reliable solutions with speed and confidence. ## **A taster of what you will be involved with:** - Design and build scalable, reusable frameworks and servicesfor data ingestion, transformation, and processing. - Develop and maintain the platform's core capabilities, such as orchestration, data quality validation, and schema management tools. - Evolve the platform's architecture to incorporate new technologies that improve scalability, reliability, and cost-effectiveness. - Collaborate with Data DevOps Engineers to ensure platform features are automated, observable, and deployed via CI/CD. - Act as a key contributor to the platform's roadmap, identifying and prioritizing features that unlock the most value for its users. ## **What we are looking for:** Must haves: - University Degree in Computer Science, Engineering or equivalent. - At least 3 years of hands-on experience building and operating real-time or event-driven data platforms and streaming applications. - Strong software engineering fundamentals, with experience in a language like Python, Scala or Java. - Experience building reusable frameworks, libraries, or internal tools. - Deep knowledge of SQLand data integration patterns. Experience in modern cloud database technologies such as Snowflake or Redshift are considered an asset. - Experience with data streaming technologies such as Kafka is a must. - Strong experience building distributed data processing workloads using Apache Spark (PySpark and/or Scala). - Hands-on experience designing and operating event-driven architectures on AWS, including services such as MSK, Kinesis Data Streams, EKS, EMR, Lambda, and EventBridge. - Experience in NoSQL databases such as HBase, Cassandra, and DynamoDB. - Excellent verbal and writing English communication skills. Nice to have: - Familiarity with real time reporting tools like Grafana or Datadog - Familiarity with Data Modelling Concepts like Inmon, Kimball and Data Vault - Knowledge AWS services like Glue, Lambda, Step Functions and S3 - Experience with orchestrating data pipelines using tools like Airflow. - Experience building or managing APIs and microservices. - Familiarity with infrastructure scripting like Terraformand CI/CD practices. ## **What we offer** Much like riding a rollercoaster, sometimes life at Betsson can be lightning fast with twists and turns but always FUN! Then again, what else would you expect from a business 75% millennial and 1700 strong, spread across 7 offices with 900 based out of our Malta HQ alone! We recognise it may not be for the faint-hearted, but if you’re a go-getter, initiator and adrenaline junkie, always striving to push the boundaries and challenge yourself, then you’ll fit right in. ## Challenge accepted? ***By submitting your application, you understand that your personal data will be processed as set out in our [Privacy Policy](https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.betssongroup.com%2Fprivacy-policy%2F&data=02%7C01%7C%7C3a20ee474bdc4c6e3c0708d7f25cecc8%7Cc514bc364b3348d2bbb1a3c97d4bf41d%7C0%7C0%7C637244353233614389&sdata=AU%2Fhd6%2BEo1YFOdJ4nv%2FfKCYpmRNmvuzPrTyiZlbgys4%3D&reserved=0)***