Data Ingestion Engineer (ADF+Dbt+Snowflake)

Job description

About the Role: We are seeking a highly skilled and motivated Data Ingestion Engineer to join our data platform team. This role involves building and maintaining scalable, reliable, and secure data pipelines that power analytics, reporting, and decision-making across the organization. You will work with Snowflake, SQL, dbt, Azure Data Factory (ADF), Python, and PostgreSQL o integrate and transform data from a variety of cloud and on-premises sources. Key Responsibilities: Design, develop, and maintain Snowflake-native data ingestion pipelines using Snowpipe, Snowpipe Streaming, Snow Tasks, and Snow Streams . Build automated, scalable ingestion processes to load batch and near-real-time data into Snowflake . Design and implement ELT workflows using Snowflake and dbt . Integrate Azure Data Factory (ADF) with Snowflake for data movement and orchestration where appropriate. Develop Python scripts and utilities for data ingestion, validation, automation, and integration. Ingest data from APIs, databases, files, cloud storage, and other internal and external systems into Snowflake. Monitor and optimize performance of pipelines and troubleshoot ingestion issues Implement data quality checks, logging, alerting, and governance processes Maintain technical documentation of data pipelines and workflows. Required Skills & Experience: 4+ years of experience in data engineering, ETL development, or data integration Strong hands-on experience with Snowflake data warehousing and data ingestion . Hands-on experience with Snowpipe and/or Snowpipe Streaming . Experience with Azure Data Factory (ADF) for orchestration and pipeline automation Proficiency with Python for scripting, automation, and data manipulation Experience building ETL/ELT pipelines and working with large data volumes. Experience with dbt , preferably with Snowflake. Solid working knowledge of Snowflake and PostgreSQL Experience using dbt for SQL-based transformation, version control, and documentation Strong SQL skills and familiarity with data modeling concepts (e.g., star/snowflake schemas) Familiarity with Git and version-controlled development environments Preferred Qualifications: Experience with API integration and handling large data files (CSV, JSON, XML) Familiarity with Azure Blob Storage, Azure Data Lake, or similar Exposure to cloud data platforms (Azure, AWS, or GCP) Understanding of data governance, lineage, and cataloging tools All your information will be kept confidential according to EEO guidelines. Our team is aware of recent fraudulent job offers in the market, misrepresenting EVERSANA. Recruitment fraud is a sophisticated scam commonly perpetrated through online services using fake websites, unsolicited e-mails, or even text messages claiming to be a legitimate company. Some of these scams request personal information and even payment for training or job application fees. Please know EVERSANA would never require personal information nor payment of any kind during the employment process. We respect the personal rights of all candidates looking to explore careers at EVERSANA. From EVERSANA’s inception, Diversity, Equity & Inclusion have always been key to our success. We are an Equal Opportunity Employer, and our employees are people with different strengths, experiences, and backgrounds who share a passion for improving the lives of patients and leading innovation within the healthcare industry. Diversity not only includes race and gender identity, but also age, disability status, veteran status, sexual orientation, religion, and many other parts of one’s identity. All of our employees’ points of view are key to our success, and inclusion is everyone's responsibility. Follow us on LinkedIn | Twitter Company Description At EVERSANA, we are proud to be certified as a Great Place to Work across the globe. We’re fueled by our vision to create a healthier world. How? Our global team of more than 7,000 employees is committed to creating and delivering next-generation commercialization services to the life sciences industry. We are grounded in our cultural beliefs and serve more than 650 clients ranging from innovative biotech start-ups to established pharmaceutical companies. Our products, services and solutions help bring innovative therapies to market and support the patients who depend on them. Our jobs, skills and talents are unique, but together we make an impact every day. Join us! Across our growing organization, we embrace diversity in backgrounds and experiences. Improving patient lives around the world is a priority, and we need people from all backgrounds and swaths of life to help build the future of the healthcare and the life sciences industry. We believe our people make all the difference in cultivating an inclusive culture that embraces our cultural beliefs. We are deliberate and self-reflective about the kind of team and culture we are building. We look for team members that are not only strong in their own aptitudes but also who care deeply about EVERSANA, our people, clients and most importantly, the patients we serve. We are EVERSANA.