Senior Data Engineer

Job description

About Planet Planet is a global provider of integrated technology and payments solutions for retail and hospitality customers. We create great experiences for the millions of people who use our payments, software, and tax-free solutions every minute of every day. Planet empowers its customers to deliver great customer experiences by combining payments and software in ways that drive greater loyalty, increase revenue and save time. Founded over 35 years ago and with our headquarters in London, today we have more than 2,500 employees located across six continents serving our customers in more than 120 markets. Role Overview: As a Senior Data Engineer, you will play a key role in building and maintaining our data infrastructure, with a focus on Snowflake and data ingestion tools. You will be responsible for designing, developing, and optimizing data pipelines that power our analytics and predictive models. The role requires you to collaborate with data analytics engineers, data analysts, data scientists, and business stakeholders to ensure data is accurate, reliable, and readily available. What You Will Do: Design and develop data pipelines: Build efficient and scalable data pipelines using ELT tools, such as Fivetran and event-based sources, for data ingestion, ensuring smooth integration of multiple data sources into Snowflake. Manage Data Platform: Oversee the administration, maintenance, and optimisation of our Snowflake data platform, ensuring data is structured for efficient querying and analysis. Automate ETL processes: Develop and optimise ETL/ELT processes to ensure timely and accurate data ingestion and transformation, with a focus on automation and efficiency. Define ingestion patterns for incremental loads, CDC, and full refresh scenarios. Design and operate reverse ETL pipelines to operational systems and APIs. Monitor data quality and performance: Implement monitoring and testing frameworks to ensure data quality, reliability, and pipeline performance. Implement data governance frameworks, including data contracts and schema evolution. Collaborate with teams: Work closely with analytics engineers, data analysts, data scientists, and business stakeholders to understand their data needs and deliver solutions that support business objectives. Troubleshoot and resolve Issues: Proactively identify and resolve data pipeline or infrastructure issues to ensure minimal downtime and data integrity. Ensure data governance: Implement data governance frameworks, including data ownership and stewardship, and drive documentation, lineage, and discoverability standards. Explore new tools: Continuously evaluate and recommend new tools, frameworks, and best practices to improve data pipeline efficiency and support future growth. Ensure data security: Ensure all data processes comply with data security and privacy regulations. Who You Are: Proficient with Snowflake: Demonstrated experience in managing and optimizing Snowflake as a data platform. ETL/ELT mastery: Solid understanding of ETL/ELT frameworks, with experience building and automating data pipelines. Expert in Fivetran: Hands-on experience using Fivetran for data ingestion, integrating multiple data sources seamlessly. Familiarity with real-time data processing tools (mainly Kafka). SQL Expert: Advanced SQL skills for querying, transforming, and analyzing data across databases and data warehouses. Problem-solver: Strong analytical skills to troubleshoot data pipeline issues and optimize workflows for performance and reliability. Collaboration skills: Excellent communication skills and experience working cross-functionally with technical and non-technical teams. Documentation focused: Ability to document data processes clearly to ensure knowledge sharing and continuity. Experience with cloud data platforms (Snowflake, Databricks, Redshift, etc) and their data services. Knowledge of data governance and security best practices. Why Planet: Planet is an equal opportunity employer where diversity is valued, and all employment is decided based on qualifications, merit, and business need. Come and grow your career in the most exciting, fast paced technology market, with a business that delivers feel-good connected commerce. We would love to hear from you – Apply now . At Planet, we embrace a hybrid work model, with three days a week in the office. Reasonable accommodations may be made in order to allow for an individual to perform the essential functions of this role successfully.