Consultant Data Engineer

Job description

At Data Intellect, we solve some of the most complex data engineering challenges in global financial markets. For over two decades, we've partnered with many of the world's leading investment banks, hedge funds and exchanges, helping them build high-performance data platforms that power trading, analytics and market surveillance. We're recognised as one of the world's leading consultancies specialising in time series data and capital markets technology. As our clients continue to adopt modern data platforms, we're investing in a new capability centred around ClickHouse. This is an exciting opportunity to join at the beginning of that journey, helping us build a new consulting practice while working on challenging projects with some of the biggest names in financial services. The Opportunity We're looking for experienced Consultants / Data Engineers who are passionate about building scalable, high-performance data platforms. Previous ClickHouse experience is desired. We’re looking for people with strong data engineering fundamentals, excellent Python and SQL skills, and experience working with large-scale financial or time series datasets. As part of a growing specialist team, you'll have the opportunity to shape our ClickHouse capability from the ground up, influence technical direction and work closely with both clients and internal engineering teams. Because we're a consultancy, no two projects are the same. You'll work directly with our clients, helping solve complex engineering challenges across market data, trading systems, analytics platforms and cloud-native architectures. What You'll Be Doing As a consultant, you'll be involved in the full lifecycle of delivering modern data platforms, including: · Designing and implementing scalable data engineering solutions · Building high-performance data pipelines using Python and SQL · Working with large-scale financial and time series datasets · Designing efficient data models and optimising analytical workloads · Implementing ClickHouse across client environments · Collaborating directly with client engineering teams to understand technical challenges and deliver solutions · Supporting cloud-based data platforms and distributed architectures · Contributing to technical design discussions and engineering best practice · Helping grow Data Intellect's ClickHouse capability What We're Looking For We're interested in experienced engineers who can demonstrate the following: · Previous experience using ClickHouse in production · Hands on experience with Go and/or Python · Strong knowledge of cloud computing platforms such as AWS, Azure, or Google Cloud Platform · Excellent understanding of distributed databases and SQL · Hands on experience with container orchestration tools such as Kubernetes or Docker Swarm · Strong experience with automation and configuration management tools such as Ansible, Terraform, or Puppet · Strong commercial Data Engineering experience · Experience designing and maintaining large-scale data pipelines · Experience working with high-volume or high-performance data platforms · Experience within Capital Markets or Financial Services · Strong understanding of modern data engineering principles · Excellent problem-solving and analytical skills · Strong communication skills and experience working with technical stakeholders A little background on DI Simply put – we turn big data problems into smart data solutions At our core, Data Intellect is a data and technology consultancy firm. Our key area of expertise is financial and capital markets technology solutions. However, the utility of these solutions allow us to apply fintech data expertise to other industries such as smart energy and healthcare. This proprietary offering is complemented by a wealth of experience in data engineering, electronic trading systems, data capture applications, regulatory and compliance systems and middle and back-office enterprise web solutions. Fair employment and equal opportunities Data Intellect is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. Accommodations are available on request throughout the assessment and selection process. Welcome to Data Intellect. #ChallengeAccepted At Data Intellect it has never been just about data or technology, they are our tools. It’s about human intellect, collaboration and providing solutions for the most complex of challenges. We do this by living the [DI] code: We are Problem Solvers who are Humble , possess a Can-do Attitude with a focus on Togetherness . “We are not big on egos, but we’re not for the faint-hearted either” – Steve Turner, CEO