Senior Data Engineer

Job description

The Senior Data Engineer is responsible for complex design, development, deployment, operational support, technical communication, mentoring, and continuous improvement across Mom’s Meals data and integration platforms. This role works independently on complex assignments and provides guidance to junior and mid-level engineers. The Senior Data Engineer may operate broadly across Databricks, dbt Cloud, Power BI, Azure Data Factory, Lakeflow, Azure DevOps, and related Azure services, or may serve as a senior specialist within a specific platform area. This role bridges hands-on engineering delivery with solution design, platform reliability, compliance-aware implementation, stakeholder communication, and team leadership. The successful candidate must be able to communicate with technical teams, business stakeholders, external partners, infrastructure, information security, network teams, and leadership. ***Remote hires will be required to travel to our headquarters in Ankeny, IA (company paid) their first few days for new hire orientation, training, and onboarding.*** ***At this time, we are NOT considering applicants that require immigration sponsorship (additional work authorization or permanent work authorization) now or in the future to work in the United States. This includes, but IS NOT LIMITED TO: F1-OPT, F1-CPT, H-1B, TN, L-1, J-1, etc.*** Salary range: $120,000-130,000 plus 10% annual bonus target Benefits Our employees enjoy a generous package of benefits that we are thrilled to provide, and feel is part of what makes us different as an employer. We value our team members, and this is one way we can show it. Benefits include: -PTO, holiday pay and holiday of choice -401(k) match -Life insurance -Short-term disability -Health, dental and vision insurance -Maternity/paternity leave -Health savings account (HSA) -Flex spending accounts (FSA) – health and dependent ### Position Responsibilities may include, but not limited to Platform and Operational Leadership - Lead operational support for assigned pipelines, integrations, APIs, reports, jobs, models, datasets, and platform services - Improve monitoring, alerting, logging, notifications, reconciliation, runbooks, and support procedures - Drive root-cause analysis and permanent remediation for recurring production issues - Advocate for automation-driven administration, monitoring, and notification services - Support production readiness, release planning, deployment coordination, and operational handoff Solution Design and Senior Engineering Delivery - Design and deliver complex platform solutions across data engineering, integration, analytics, reporting, and platform operations - Lead technical design for data pipelines, API integrations, file-based exchanges, sFTP flows, EDI-related interactions, dbt models, semantic structures, Databricks workflows, Power BI data assets, and analytics delivery processes - Apply architecture standards, platform patterns, naming conventions, testing expectations, documentation practices, and operational requirements - Identify technical risks, performance concerns, supportability gaps, and design tradeoffs - Review designs, code, models, integration flows, test plans, and deployment plans created by other engineers Azure DevOps, CI/CD, and Delivery Coordination - Help improve CI/CD practices across platforms - Coordinate technical delivery, testing, deployment readiness, release notes, and production validation - Lead assigned Azure DevOps features, user stories, tasks, bugs, requirements, and documentation - Ensure ADO work items include accurate progress, decisions, blockers, risks, and testing evidence - Support sprint planning, backlog refinement, work estimation, and stakeholder reporting Cross-Platform Data and Integration Enablement - Ensure upstream integrations and downstream data products are aligned, reliable, traceable, and supportable - Support medallion architecture design and implementation across source-to-bronze, bronze-to-silver, and silver-to-gold patterns - Lead assigned work across Databricks, dbt, Power BI, ADF, Lakeflow, Azure DevOps, or related services - Support healthcare-focused data domains and partner reporting needs - Guide semantic consistency across dbt, Databricks, Power BI, and analytics engine outputs Communication, Mentoring, and Collaboration - Communicate complex technical topics clearly to business and technology audiences - Prepare design summaries, technical documentation, decision records, diagrams, implementation plans, and operational updates - Mentor Junior Data Engineers and Data Engineers - Coordinate work with onshore and offshore resources as assigned - Collaborate with infrastructure, information security, network, application, integration, reporting, and business teams Security and Compliance - Ensure assigned solutions align with HIPAA, HITRUST, privacy, security, and internal compliance expectations - Support secure data movement, access control, encryption, logging controls, auditability, and sensitive data handling - Participate in security reviews, control documentation, audit support, and remediation activities as needed - Promote compliance-aware engineering practices within the team ### Required Skills and Experience - Significant experience building and supporting data pipelines, integrations, analytics platforms, reporting data assets, or cloud data solutions - Strong experience with several relevant technologies such as Databricks, dbt, Power BI, ADF, Lakeflow, Azure DevOps, SQL, Python, Spark, APIs, sFTP, or EDI-related data exchanges - Experience designing production-ready solutions and supporting operational environments - Experience with CI/CD, source control, testing, deployment, and release practices - Ability to guide other engineers and lead technical work - Strong communication, documentation, troubleshooting, and stakeholder management skills - Understanding of HIPAA, HITRUST, PHI handling, privacy, and healthcare compliance expectations Performance Expectations - Deliver complex, secure, scalable, and supportable platform solutions - Lead design, deployment, and operational improvement activities - Improve platform reliability through automation, monitoring, and documentation - Provide clear communication to technical and non-technical audiences - Mentor other engineers and improve team execution - Maintain strong Azure DevOps documentation and delivery tracking - Demonstrate strong judgment, ownership, and collaboration ### Physical Requirements - Repetitive motions that include the wrists, hands and/or fingers - Sedentary work that primarily involves sitting, remaining in a stationary position for prolonged periods - Visual perception to perform job including peripheral vision, depth perception, and the ability to adjust focus