Senior Data Engineer

Job description

Senior Data Engineer Are you passionate about building scalable, high-performance data-driven applications? Do you enjoy turning complex datasets into robust, reliable systems that deliver real business impact? About the team: The Search and AI Platform supports core products such as Scopus, ScienceDirect, and AI‑driven research solutions. As a Senior Data Engineer, you will help design, build, and run reliable data pipelines and services that support large‑scale search and analytics use cases. You will work hands‑on while also supporting and guiding other engineers. About the role: The Search and AI Platform is Elsevier’s agentic data platform, which powers products such as Scopus, ScienceDirect, and our next-generation LLM-powered research systems. The platform utilises agentic services to interrogate our rich knowledge graphs, search and recommendation systems, and our unparalleled collection of research data, delivering insights to the scientific community that enable them to collaborate more effectively, work smarter, and produce high-quality research more efficiently. Key responsibilities: Design, build, and maintain scalable data pipelines and services Develop batch and ELT/ETL data workflows for ingesting and processing large datasets Work with technologies such as Python, Java, Spark, SQL, and Airflow Apply good software engineering practices, including testing, documentation, and CI/CD Contribute to cloud‑based systems (AWS), focusing on reliability, monitoring, and automation Collaborate with product, platform, and data science partners to deliver meaningful outcomes Support team learning through code reviews and knowledge sharing. Requirements: Experience working as a data or software engineer on production systems Strong skills in Python and experience with at least one backend language (such as Java) Understanding of data engineering concepts such as data lakes, batch processing, and distributed systems Experience building or operating data pipelines using tools like Spark and Airflow Familiarity with cloud platforms (AWS preferred) and production monitoring Clear communication skills and a collaborative approach to problem‑solving. Why join us? Join our team and contribute to a culture of innovation, collaboration, and excellence. If you are ready to advance your career and make a significant impact, we encourage you to apply. Work in a way that works for you We promote a healthy work/life balance across the organization. We offer an appealing working prospect for our people. With numerous wellbeing initiatives and shared parental leave, we will help you meet your immediate responsibilities and your long-term goals. Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive. Working for you We know that your well-being and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer: Comprehensive Pension Plan Generous vacation entitlement and option for sabbatical leave Maternity, Paternity, Adoption, and Family Care leave Flexible working hours Personal Choice budget Internal communities and networks Various employee discounts Recruitment introduction reward Employee Assistance Program (global) About the business – A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education, and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world’s grand challenges and a more sustainable future. We harness innovative technologies to support science and healthcare to partner for a better world. We know your well-being and happiness are key to a long and successful career. We are delighted to offer country specific benefits. Click here to access benefits specific to your location. We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1-855-833-5120. Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here . Please read our Candidate Privacy Policy . We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law. USA Job Seekers: EEO Know Your Rights .