Senior Data engineer

Job description

Company Description Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to accomplish their financial goals and help them save time and money. We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments. We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com. Job Description We are looking for an experienced Senior Data Engineer with expertise in AI‑powered tools, workflow automation, and modern data platform engineering . You will develop data software applications, data platforms, and data products. It partners with application engineers, data engineers, data scientists, and CRM teams to develop scalable solutions. The Engineer will contribute both independently and collaboratively. The Engineer's responsibilities will include defining engineering standards, performing data analysis and modeling, writing high‑quality code, conducting testing and code reviews, preparing deployments, ensuring operational readiness, and supporting Agile development practices. Additionally, the Engineer will keep Security first in mind. You will report to the Development and Operations Manager. Lead the implementation of AI and LLM‑based tooling to automate data engineering workflows (e.g., code generation, data quality monitoring, schema drift detection). Build automated frameworks for data ingestion, transformation, orchestration, and deployment using AI‑powered accelerators. Integrate AI/ML capabilities into pipelines, including anomaly detection, metadata enrichment, and pattern recognition. Develop automated data validation frameworks and implement AI‑assisted data quality checks. Take technical ownership of all stages and iterations of assigned software components. Design technology solutions meet all functional and non‑functional our requirements. Provide ongoing production support by overseeing critical data pipelines, resolving incidents, ensuring system stability, and driving root‑cause analysis for continuous improvement. Produce clear documentation of designs, architectural decisions, and code artifacts; participate in knowledge sharing. Provide regular updates and communications to project partners. Ensure solution adoption through training, documentation, and readiness planning. Work across multiple projects and departments, supporting engineering tasks and cross‑functional programs. Apply industry best practices, engineering standards, and governance principles. Be a important contributor to deliver high‑value, on‑time, on‑budget complex projects. Qualifications Bachelor's degree in Computer Science or equivalent experience. 5+ years in commercial software development environments. 5 + years of hands‑on experience in data engineering or similar roles. Demonstrated experience using AI/LLM tools for code generation, testing, monitoring, and automation. Hands‑on experience with: PySpark, Python, SQL (expert‑level) Data engineering pipelines, frameworks, and automation Knowledge of data platform paradigms and modern software architecture. Cloud experience with AWS, including services such as API Gateway, Lambda, EC2, ECS, SQS, SNS, DynamoDB, Redshift, and Aurora. Understand detailed technical specifications and adapt quickly to new technologies Experience making any architectural tradeoffs required to provide software solutions. Experience building scalable, resilient, and observable distributed systems and problem‑solving skills across a range of complexities. Experience troubleshooting issues with users. Familiarity with MLOps, ML orchestration, and model deployment workflows. Additional Information This is a permanent remote home-based role in Costa Rica. No relocation available. Our benefits include: Medical, life and dental insurance, Asociacion Solidarista, International Share Save Plan, Flex Work/Work from home, Paid time off, Annual Performance Bonus, Education Reimbursement, Family Bonding, Bereavement Leave, Referral Program, and more. Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is a critical part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, colour, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity. #LI-ML2 #LI-Remote This is a remote position.