Senior Data Engineer

Job description

Job Description WHAT YOU’LL CHAMPION: As a Senior Data Engineer, your day-to-day duties will encompass the following areas: Operational Excellence: Provide essential operational support, including system troubleshooting and implementing technical fixes. Data Quality Assurance: Ensure absolute data integrity and data quality across environments. Process Optimization: Continuously improve internal processes through automation, pipeline optimization, and infrastructure re-design. Cross-Functional Collaboration: Support and collaborate closely with cross-functional and multidisciplinary teams in a fast-paced environment. Data Impact: Leverage data visualization tools and techniques to maximize the business impact and intrinsic value of data. Internal Stakeholder Management: Manage technical communication, alignment, and relationships with internal business units, product managers, and engineering teams to ensure data deliverables align with organizational goals. Governance & Compliance: Contribute to improving data governance policies and maintaining data compliance standards. Continuous Learning: Keep continuously current with the latest technical and industry developments. WHO YOU ARE: BS/MS/PhD in IT, Mathematics, Science or Engineering discipline Up to 4+ yrs relevant experience beyond first degree Experience with one of the following languages: Python, Spark Experience with DAG, airflow, terraform Familiar with data ETL from a wide variety of data sources. Experience with SQL and NoSQL databases. Experience with pipeline and workflow management tools. Experience with various messaging and stream processing. Experience with object-oriented/object function scripting languages. Familiar with containerisation and orchestration tools. Familiar with one of the following cloud-based services: GCP and its tools and services. Ability to work under pressure and change, and balance among speed, reliability, and interpretability. Good working knowledge of productivity tools such as G Suite, Git, Jira, Confluence. Experience with code versioning, code review and documentation. Proficient understanding of distributed computing principles. Able to select and integrate big data tools and frameworks. Familiar or prone to adopt design thinking methods. Openness to experimenting with new techniques and new ways of working. ​ WHAT YOU’LL ENJOY: Physical Wellbeing: Key medical and insurance benefits, maternity expenses, flexible work arrangement, and health and fitness amenities. Emotional Wellbeing: Paid time off, wellness programmes, and childcare amenities. Financial Wellbeing: Resources relating to financial, personal skills and career growth programmes. Allstars Specials: Free flights, unlimited discounted flights, and exclusive discounts with partners. A unique Allstar culture like no other OUR HIRING PROCESS: Application received Candidate screening Interview(s) and assessment(s) Background check and/or other assessments Offer and negotiation