Senior Data Engineer

Job description

We are looking for an experienced Senior Data Engineer to serve as a Hands-On Tech Lead & Individual Contributor. In this role, you will spend roughly 70% of your time in the code, designing, building, and optimizing our core data platform, and 30% mentoring and guiding junior-to-mid-level engineers. You will set technical standards, lead code reviews, break down complex architectural requirements into actionable tasks for junior team members, and ensure the team delivers scalable, high-quality data pipelines. Core Responsibilities Technical Leadership & Mentorship (Lead IC) Guide & Mentor: Serve as the technical point of contact for junior and mid-level data engineers, conducting thorough code reviews, pair programming, and guiding them on best engineering practices. Architectural Oversight : Drive technical decisions across data sub-systems, translating high-level product requirements into clean, scalable, and maintainable engineering tasks for the team. Agile Execution : Work closely with Engineering Managers and Product Managers to prioritize technical backlog items, estimate effort, and break down complex epics into digestible work items for junior developers. Hands-On Engineering & Execution (IC) Data Pipeline Development: Design, build, and maintain scalable ETL/ELT data pipelines, APIs, and microservices for high-volume regulatory and health agency datasets. Data Reliability & Integrity: Identify root causes of data quality issues and implement automated testing, monitoring, and validation frameworks to ensure data accuracy. System Integration & ML: Integrate data processing pipelines with downstream NLP/ML services and search engines (ELK stack). Production Operations: Ensure reliable system deployments to production and assist operations teams in resolving complex escalated pipeline or database incidents. About you Tech Savvy : Effectively anticipates and adopts innovations in business-building technology solutions, staying up-to-date with data advancements and incorporating them into work processes Manages Complexity : Actively synthesizes solutions from complex information by identifying patterns and developing effective problem-solving strategies to solve data-related problems effectively Decision Quality : Consistently makes good and timely decisions that propel organizational progress and maintain data integrity Collaborates : Actively engages in collaborative problem-solving by leveraging diverse perspectives and finding innovative solutions to achieve shared goals and data engineering initiatives Optimizes Work Processes : Actively seeks opportunities to enhance and streamline current work processes for managing data pipelines, ETL (Extract, Transform, Load) processes, and data warehousing Drives Results : Strives to continuously improve performance and exceed expectations to contribute to overall success and meet data-related deliverables Strategic Mindset : Consistently demonstrates a strategic mindset by envisioning future possibilities and successfully translating them into breakthrough data strategies, contributing to the organization's long-term success Engaged : Not only shares our values but also possesses the essential competencies needed to thrive at Redica, as outlined here 5+ years of senior or lead developer experience with an emphasis on technical mentorship, code/system architecture, and quality output Extensive experience designing and building data pipelines, data APIs, and ETL/ELT processes Deep, hands-on experience in Python Hands-on experience setting up, configuring, and maintaining SQL and no-SQL databases (MySQL/MariaDB, PostgreSQL, MongoDB) Computer Science, Computer Engineering, or similar technical degree Bonus Points Experience with the data engineering stack within AWS is a major plus (S3, Lake Formation, Lambda, Fargate, Kinesis Data Streams/Data Firehose, DynamoDB, Neptune DB) Experience with event-driven data architectures Experience with the ELK stack is a major plus (Elasticsearch, Logstash, Kibana) If you are a motivated individual with a passion for software development and leadership, we encourage you to apply for this exciting opportunity. We offer competitive salaries, comprehensive benefits packages, and a dynamic work environment where you can grow and develop your skills. Top Pharma Companies, Food Manufacturers, MedTech Companies, and Service firms from around the globe rely on Redica Systems to mine and process government inspection, enforcement, and registration data in order to quantify risk signals about their suppliers, identify market opportunities, benchmark against their peers, and prepare for the latest inspection trends. Our data and analytics have been cited by major media outlets such as MSNBC, WSJ, and the Boston Globe. We are committed to creating a diverse and inclusive workplace where everyone feels welcomed and valued. We believe that diversity of perspectives, backgrounds, and experiences is essential to our success. We are always looking for talented individuals who can bring unique skills and perspectives to our team. All your information will be kept confidential according to EEO guidelines. Redica Systems is a SaaS start-up serving more than 200 customers within the life science sector, with a specific focus on Pharmaceuticals and MedTech. Embracing a hybrid model, our workforce is distributed globally, with headquarters in Pleasanton, CA. Redica's data analytics platform empowers companies to improve product quality and navigate evolving regulations. Using proprietary processes, we harness one of the industry's most comprehensive datasets, sourced from hundreds of health agencies and the Freedom of Information Act. Our customers use Redica Systems to more effectively and efficiently manage their inspection preparation, monitor their supplier quality, and perform regulatory surveillance. More information is available at .