Sr. Big Data Engineer

Job description

**This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Sr. Big Data Engineer based in the United States.** We are seeking an experienced Big Data Engineer to design, develop, and optimize large-scale data solutions supporting a mission-critical government procurement and payment platform. In this role, you will contribute to the modernization and sustainment of complex enterprise applications within a secure defense technology environment. You will develop advanced data architectures, build high-performance algorithms, and transform complex datasets into actionable insights that support strategic and operational objectives. Working across big data technologies, machine learning, and responsible AI, you will help advance data engineering capabilities and improve system performance. You will also contribute to AI roadmaps, model validation, governance, and business value assessments. This remote consulting opportunity is suited to a technically accomplished professional with extensive data engineering experience and an active Secret security clearance. ### Accountabilities - Engineer and maintain large-scale big data solutions and multi-tier data environments supporting complex government and enterprise applications. - Lead initiatives that leverage big data technologies to generate actionable insights and address strategic and tactical mission objectives. - Design, develop, and maintain enterprise data models using data modeling tools such as ERwin and Microsoft Visio. - Build high-performance algorithms, prototypes, and data models using programming languages such as Python, C/C++, Java, Perl, and Scala. - Analyze and develop data processing workflows for data ingestion, modeling, mining, and transformation. - Contribute to machine learning, natural language processing (NLP), and MLOps initiatives that support advanced analytics and AI capabilities. - Develop and support AI roadmaps, prepare return-on-investment (ROI) business cases, and contribute to model validation and governance practices. - Work with Hadoop-based technologies and NoSQL data platforms to support large-scale data processing, storage, and analysis. - Integrate big data solutions with SAP technologies and enterprise data environments. - Contribute to the modernization and sustainment of mission-critical applications, supporting improvements in system performance, reliability, and data-driven capabilities. ### Requirements - A bachelor's or master's degree is required. - At least eight years of relevant professional experience. - An active Secret security clearance is mandatory. - Demonstrated experience engineering large-scale big data deployments in government and large commercial environments. - Experience with machine learning, natural language processing (NLP), MLOps, Python, data engineering, and responsible AI. - Hands-on experience with Hadoop-based technologies, including Cloudera, Hortonworks, MapReduce, Hive, and HDFS. - Experience working with NoSQL technologies such as MongoDB and Cassandra. - Proven ability to design enterprise data models using tools such as ERwin and Visio. - Experience integrating big data solutions with SAP technologies. - Strong analytical and problem-solving skills, with the ability to develop scalable data solutions for complex technical and mission requirements. - Ability to contribute to AI strategy, assess business value, and support model validation and governance. - Commitment to quality, collaboration, integrity, and continuous improvement in a security-sensitive environment. ### Benefits - Compensation: Determined based on experience and qualifications. - Work arrangement: Remote opportunity based on the United States job listing. - Employment type: Consultant Corp. - Mission-driven work: Contribute to the modernization and sustainment of a large-scale government procurement and payment platform. - Technical challenges: Work with big data technologies, machine learning, AI, and enterprise data architecture in a complex government technology environment. - Professional impact: Help develop data solutions that support important strategic and operational objectives. - Values-driven environment: Work within a culture emphasizing integrity, long-term commitment, courage, and technical excellence.