Senior Data Engineer - Core systems

Job description

The company Small businesses move fast. Opportunities often don’t wait, and cash flow pressures can appear overnight. To keep going, and growing, SMEs need finance that’s as flexible and responsive as they are. That's why we built iwoca. Our smart technology, data science and five-star customer service ensures business owners can act with the speed, confidence and control they need, exactly when it's needed. We’ve already cleared the way for 100,000 businesses with more than £4 billion in funding. Our passionate team is driven to help even more SMEs succeed, through access to better finance and other services that make running a business easier. Our ultimate mission is to support one million SMEs in their defining moments, creating lasting impact for the communities and economies they drive. The team You’ll join the Core Systems team, who are responsible for driving innovation across the business by optimising development, building data systems, and continuously improving iwoca products. We follow Agile-inspired processes, using continuous integration and delivery, so that features go live in days or weeks, not months or years. The role We are in the process of transitioning our entire analytics warehouse to Snowflake, from a federated SQL system to improve reliability and speed of accessing our wide data ecosystem. We run a variety of time consuming ETL tasks using libraries such as (NumPy, Scikit-learn, Pandas), and view/tables from a variety of relational databases. The aim is to integrate and transition all to a single data warehouse using Snowflake and dbt. We are looking for someone who has a solid amount of experience in analytics engineering, who can advise and implement high quality and reliable ETL/ELT processes to bridge the gap between data engineering and analytics. You will collaborate with analysts, data scientists and engineers to deliver and improve our data warehouse and processes. You will have the opportunity to learn lots and develop rapidly, with the ability to influence critical data infrastructure. We are embarking on a transition to a data mesh operating model and are looking for a proactive, self-motivated individual to help drive this change. The successful candidate will identify opportunities to improve data processes, enable self-service access across the organisation, and design the governance frameworks and guardrails required to ensure data quality, security, and consistency. The responsibilities - Develop, construct, test and maintain ETL/ELT infrastructure. - Implement robust data testing frameworks in dbt to monitor and ensure data quality and integrity. - Enable product teams to self-serve data more effectively, empowering them to make faster, more informed decisions. - Influence and shape the monitoring, observability, and reliability strategy for the data warehouse, ensuring high availability, performance, and data quality. - Partner with analysts, data scientists, and business stakeholders to understand data requirements and deliver actionable solutions. - Troubleshoot emerging data and operational problems, and be a source of knowledge for end-users on the most appropriate way of using data for their purposes - Support your teammates by learning and sharing your knowledge - Drive knowledge sharing and capability building through mentoring, coaching, and the creation of educational resources and best practices. The requirements Essential: - Experience in implementing reliable and performant ETL/ELT pipelines - Experience with version control systems (e.g., Git) for dbt project management. - Knowledge of CI/CD pipelines for analytics workflows. - Experience with programming languages such as Python - Familiarity with data governance practices and frameworks. - Professional experience in analytics engineering / data analytics. - Solid understanding of SQL with hands on experience with dbt and Snowflake - Comfortable implementing custom (in-house) data solutions where off-the-shelf products are unavailable or unsuitable. Bonus: - Advanced LookML knowledge. - Experience using Pandas (TensorFlow, Scikit-learn, Matplotlib) - DevOps practices Docker and Kubernetes. - Understanding of data science concepts. - Professional experience or a degree in a quantitative field, such as Mathematics, Physics, Engineering, or Computer Sciences The salary We expect to pay from £70,000 - £100,000 for this role. But, we’re open-minded, so definitely include your salary goals with your application. We routinely benchmark salaries against market rates, and run quarterly performance and salary reviews. The culture At iwoca, the best idea wins. We model our culture on independent thinking, challenging untested logic, and evidence-based decisions. We prioritise learning and growth, and give people the autonomy to develop in the direction that makes them most effective. We're a tech company and believe in the power of AI to help us work faster and better. We provide the infrastructure where every iwocan always has access to the best models and where those models have access to all of our data. We will help our people to learn how to use and grow with the new tools available to them. The offices We put a lot of effort into making iwoca a great place to work: - Offices in London, Leeds, Berlin, and Frankfurt with plenty of drinks and snacks. - Events and community-led groups, including running groups, padel, and monthly ping-pong and pool competitions. The benefits - Flexible working hours. - Medical insurance from Vitality, including discounted gym membership. - A private GP service (separate from Vitality) for you, your partner, and your dependents. - 25 days’ holiday per year, an extra day off for your birthday, the option to buy or sell an additional five days of annual leave, and unlimited unpaid leave. - A one-month, fully paid sabbatical after four years. - Instant access to external counselling and therapy sessions for team members that need emotional or mental health support. - 3% Pension contributions on total earnings. - An employee equity incentive scheme. - Generous parental leave and a nursery tax benefit scheme to help you save money. - Electric car scheme and cycle to work scheme. - Two company retreats a year: we’ve been to France, Italy, Spain, and further afield. And to make sure we all keep learning, we offer: - A learning and development budget for everyone. - Company-wide talks with internal and external speakers. - Access to learning platforms like Treehouse. Useful links: - iwoca benefits & policies https://coda.io/@iwocauk/iwoca-benefits-policies-uk