Mid Level Data Engineer

Job description

**About the Organization** Now is a great time to join Redhorse Corporation. We are a solution-driven company delivering data insights and technology solutions to customers with missions critical to U.S. national interests. We’re looking for thoughtful, skilled professionals who thrive as trusted partners building technology-agnostic solutions and want to apply their talents supporting customers with difficult and important mission sets. #### About the Role Redhorse is transforming how the Department of Defense (DoD) utilizes data and technology. We are seeking a proactive Mid-Level Data Engineer to join our team supporting the Office of the Under Secretary of Defense for Acquisition & Sustainment (OUSD(A&S)). In this role, you will play a key part in advancing data-driven decision-making across the DoD by developing and optimizing robust data pipelines and analytics solutions that support critical national security initiatives. This position offers exceptional visibility and hands-on growth working within enterprise defense data environments. ### Key Responsibilities - Ingest, configure, and transform structured, semi-structured, and unstructured datasets to meet mission partner and stakeholder requirements. - Build, automate, and maintain scalable ETL/ELT pipelines supporting DevOps and rapid analytics delivery. - Maintain data pipeline operations, monitor environment health, and implement automated performance optimization and cost-reduction practices. - Work under general guidance to prototype new data capabilities, evaluate emerging technologies, and deploy end-to-end data solutions. - Collaborate with cross-functional technical teams to troubleshoot pipeline bottlenecks, optimize database structures, and implement secure data retrieval methods. - Implement and automate DoD Security Technical Implementation Guides (STIGs) across data systems to ensure strict compliance and system security. ### Required Experience/Clearance - US citizenship with an active Department of War (DoW) Top Secret (TS) security clearance and access to Sensitive Compartmented Information (SCI). - Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or a related STEM field with 3+ years of data engineering experience (or Master’s degree with 2+ years of experience). - Demonstrated experience developing ETL/ELT pipelines and processing large-scale data using big data frameworks such as Apache Spark. - Practical experience working within cloud environments (e.g., AWS, Microsoft Azure, or MilCloud 2.0). - Proficiency in core data engineering programming and querying languages (e.g., Python, SQL, or Scala). - Familiarity with database architectures, data modeling, and automated configuration management. - Familiarity with applying and maintaining DoD Security Technical Implementation Guides (STIGs). ### Desired Experience We encourage all candidates who meet the basic requirements to apply, even if you do not have any of the following experience: - Hands-on experience developing data workflows using **Databricks** (e.g., Delta Lake, Lakehouse architecture, PySpark). - Experience integrating data pipelines with business intelligence and data visualization platforms, particularly **Qlik** (Qlik Sense or QlikView). - Experience working within the DoD **Advana** Data Environment. - Familiarity with deploying and engineering data pipelines across classified networks and multiple security domains. - Experience with CI/CD tools and version control systems such as GitLab, Jira, or Jenkins. - Active Top Secret (TS) clearance with Sensitive Compartmented Information (SCI) eligibility.