Managing Engineer - Observability, Pipeline & Analytics (Hybrid)

Job description

At Allstate, great things happen when our people work together to protect families and their belongings from life’s uncertainties. And for more than 90 years, our innovative drive has kept us a step ahead of our customers’ evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection. Your role in the team Core Engineering & Platforms (CEP) group is seeking a highly skilled and hands-on Software Engineering Manager for Observability Pipeline & Analytics, who can lead the engineering strategy, architecture, delivery, and operational excellence of Allstate's enterprise telemetry and analytics platforms, including Cribl, Azure Data Explorer (ADX), and related observability data services. This leader will own the end-to-end observability pipeline ecosystem that enables scalable collection, transformation, routing, governance, enrichment, retention, and analytics of operational telemetry across various applications, infrastructure platforms, cloud services, and technology domains. The role combines deep technical expertise with people leadership, requiring a hands-on engineering leader who can shape enterprise-wide observability architecture while building and developing a high-performing engineering organization. This position is ideal for a technically strong leader who has personally implemented and operated large-scale telemetry pipelines, modern analytics platforms, cloud-native observability solutions, and engineering automation practices. The successful candidate will partner closely with Observability, SRE, Infrastructure, Security, Data, and Product Engineering organizations to deliver a unified telemetry strategy that improves reliability, accelerates troubleshooting, enables AI-driven operations, reduces operational risk, and optimizes enterprise logging costs. Responsibilities: Lead and develop a team of engineers responsible for enterprise observability pipelines, telemetry routing, and analytics platforms. Define and execute the strategic roadmap for Cribl, ADX, telemetry governance, logging strategy and observability data architecture. Lead organizational transformation from service-oriented operations to product-oriented engineering excellence practices, establishing outcome-based planning, customer engagement models and product performance measures. Own enterprise-scale ingestion, transformation, enrichment, routing, retention, and analytics capabilities supporting multiple of technology assets. Establish engineering standards, design patterns, and platform guardrails for telemetry collection and observability data management. Drive adoption of metadata-driven routing, schema normalization, data classification, and governance across enterprise logging ecosystems. Build highly resilient, scalable, and cost-efficient telemetry pipelines capable of handling large-scale operational and platform data. Lead architecture reviews and provide technical direction for onboarding applications, infrastructure platforms, cloud services, and emerging technologies. Partner with SRE, Platform Engineering, Security, Services, and Product teams to improve reliability, observability maturity, and operational insights. Implement automation-first self-service operational practices using Infrastructure as Code, CI/CD, APIs, and policy-driven platform management to reduce onboarding friction. Define and measure platform KPIs including ingestion reliability, data quality, latency, availability, scalability, platform adoption, and cost efficiency. Drive AI-enabled observability initiatives leveraging telemetry intelligence, anomaly detection, root cause analytics, automation, and operational insights. Manage vendor relationships and technical partnerships across observability, analytics, security, and cloud platform ecosystems. Provide executive-level communication, roadmap updates, and operational health reporting to senior leadership. Lead incident response efforts for critical telemetry services and ensure continuous improvement through post-incident learning and resiliency engineering. Establish telemetry cost transparency, chargeback / show back models and optimization strategies that maximize business value while controlling platform spend. Coach engineers and technical leads while fostering a culture of ownership, innovation, automation, engineering excellence, and customer focused approaches. Essential Skills: All applicants must demonstrate they have a legal right to work in the UK for employment at Allstate. Allstate is not providing sponsorship for this vacancy. A minimum of 3 years' experience with Cribl Stream, Cribl Edge, Azure Data Explorer (ADX), or equivalent large-scale telemetry platforms. A minimum of 2 years experience leading enterprise observability, telemetry, logging, or analytics platform engineering teams. Hands-on expertise designing and operating large-scale observability pipelines in complex enterprise environments and s trong knowledge of observability principles including logs, metrics, traces, events, monitoring, alerting, and distributed systems. Strong knowledge of observability principles including logs, metrics, traces, events, monitoring, alerting, and distributed systems. Experience with cloud-native architectures across Azure, AWS, GCP, and hybrid infrastructure environments. Strong understanding of engineering operational excellence including availability, resiliency, performance, security, and disaster recovery along with p roficiency with automation, Infrastructure as Code, API-driven engineering, and platform engineering practices. Experience working with the team in developing and consuming APIs, event-driven architectures, integration frameworks and proven ability to lead large-scale platform modernization, migration, and transformation initiatives. Desirable Skills: Experience implementing telemetry cost optimization and data reduction strategies at enterprise scale. Knowledge of Kusto Query Language (KQL) and large-scale analytics platforms. Experience with Cribl, ADX, Datadog Pipelines, Splunk, Sentinel, Kafka, Event Hubs, Open Telemetry, Elastic, Grafana, or similar observability ecosystems. Ability to leverage AI assisted development tools (e.g., Copilot, Cursor) responsibly to improve developer productivity and code quality. Supervisory Responsibilities: This role does have supervisory duties. Posting date: Friday 4th September 2026 [11.59pm] #LI-TR3 #LI-Hybrid Skills Continual Improvement Process, Engineering Practices, Enterprise Infrastructures, Infrastructure Architecture, Software Development, Software Development Life Cycle (SDLC), Software Lifecycle Management (SLM), Software Project Management, Technical Direction, Technical Leadership Shape the Future of Insurance with Cutting-Edge Tech and a People-First Culture Why join us? Allstate NI is proud to be Allstate’s European Digital Centre of Excellence, a hub for innovation and engineering excellence. We’re recent winners of Best Place to Work in IT (100+ employees) and Best Use of Cloud Services at the Belfast Telegraph IT Awards, and we’ve been recognised for our community and sustainability impact with Platinum in the Northern Ireland Environmental Benchmarking Survey. We’re a product-driven, cloud-first organisation delivering real outcomes through modern technology, a digital product-centric talent model, and a culture rooted in engineering excellence. Our teams work in cross-functional structures, guided by an outcome-based delivery approach that accelerates speed, agility, and value. We also invest in you. At Allstate NI, your career growth matters. You’ll have access to our Continuous Learning Hub, designed to support skills development and professional advancement through tailored learning paths, certifications, and mentoring opportunities. Whether you’re deepening technical expertise or exploring leadership roles, we provide the tools and support to help you thrive. What do you get in return? As well as receiving a competitive annual salary, our reward package includes: Corporate bonus scheme Pension scheme Annual performance-related pay reviews Life assurance and income protection Flexible working options Hybrid working Private medical and dental insurance Access to an employee assistance programme Discounted gym membership Two paid volunteering days each year Cycle to work scheme Be part of a high-performing, socially responsible organisation where your work has purpose, and your growth is supported every step of the way.