#627 Streaming Infra - Affirm (Replacement)

Job description

About the Role We are looking for a highly skilled Contract Engineer with strong infrastructure operations experience to support our Data and Storage Services organization. This role will involve hands-on work in maintaining and improving large-scale data infrastructure systems, ensuring operational excellence, and supporting internal teams that depend on our platforms for critical business functions. The ideal candidate will bring strong expertise in Python and modern cloud infrastructure, with a focus on system reliability, observability, and cross-team collaboration. What You’ll Do ● Support and operate large-scale data infrastructure systems across OLTP/OLAP, Streaming and Batch workloads ● Maintain and improve infrastructure reliability through automation, monitoring, and incident response. ● Develop and enhance tooling and services in Python to streamline operational workflows. ● Maintain and modernize Python ecosystem, ensuring services stay current with supported versions and libraries. ● Automate development workflows to improve communication, visibility, and efficiency across teams. ● Handle stakeholder (internal partner) questions and escalations, providing clear, timely, and technically sound responses. ● Create, maintain, and improve technical documentation, build dashboards for monitoring to ensure clarity, maintainability, and smooth onboarding for users of DSS platforms. Must-Have Qualifications ● Strong programming experience in at least one of the following languages: Python, Java ● Hands-on experience with infrastructure operations, including AWS and Kubernetes. ● Proven track record in maintaining large-scale distributed systems in production. ● Excellent communication skills, with the ability to collaborate effectively across engineering and product teams. ● Demonstrated technical writing ability, producing clear and effective documentation, runbooks, and user guides. Nice-to-Have Qualifications ● Experience with streaming systems, such as Flink, Kafka. ● Familiarity with data platform technologies such as Spark, Data Lake, MySQL, Snowflake ● Knowledge of data processing frameworks and pipelines for streaming near real-time data. ● Experience contributing to or managing shared infrastructure services used across multiple teams. ● Experience leveraging LLMs and AI to automate and scale support. Appendix: project lists: This contractor may contribute to several ongoing or upcoming initiatives, including but not limited to: 1. Upgrades: Support any system upgrades such as DT version upgrades, flink upgrades across all pipelines and systems supported by Streaming team 2. KTLO / Triage and Support: Handle routine operations, respond to basic user questions, and escalate complex issues to the appropriate engineering teams. 3. Documentation and Observability Improvements: Enhance and maintain internal documentation, including runbooks, FAQs, onboarding materials, monitoring dashboards and system guides to improve knowledge sharing and operational efficiency