Site Reliability Engineer - Telemetry

Job description

BUILDING THE FUTURE OF OPEN FINANCE Payward - the parent company behind Kraken, NinjaTrader, Breakout, xStocks, Payward Services and CF Benchmarks - has spent the last 15 years building one of the most modern and globally accessible financial infrastructure platforms in the industry, built to advance an open, global financial system. Before you apply, we encourage you to explore our culture page https://www.kraken.com/culture to understand what drives us and how we work. THE TEAM Founded in 2011, Kraken is one of the world's longest-standing crypto platforms, trusted by over 10 million individuals and institutions across the globe. It offers spot trading, margin, futures, staking, and OTC services, with products built for both individual investors and institutional clients. Join our engineering team as a Site Reliability Engineer focused on the shared telemetry platform that helps teams understand, operate, and improve production services. You will work across metrics, logs, traces, alerting, dashboards, and profiling systems that make our platform observable at scale. As a member of the Telemetry team, you will help keep the systems that collect, store, query, and route operational data reliable and scalable. This is a hands-on role for an engineer who enjoys distributed systems, automation, observability, and solving production problems. You will work with Software Engineers, Platform teams, Security Engineers, and SREs to improve operational practices and support mission-critical services. The role includes incident response, on-call, platform improvements, and helping teams use telemetry effectively. THE OPPORTUNITY - Operate and improve the shared platform for metrics, logs, traces, alerting, dashboards, and profiling. - Maintain metrics collection, long-term storage, querying, dashboards, and alerting using Prometheus-compatible systems, VictoriaMetrics, Grafana, and modern alerting tools. - Operate log pipelines using Vector, Splunk, and Loki, including reliability, throughput, and troubleshooting. - Operate distributed tracing and profiling capabilities using Grafana Alloy, Tempo, OpenTelemetry, and Pyroscope. - Deploy and manage telemetry services using Terraform, Terragrunt, and container orchestration across multiple environments. - Troubleshoot missing data, slow queries, broken alerts, pipeline backpressure, and capacity issues. - Build reusable configuration and automation that helps teams manage dashboards, alerts, and telemetry integrations safely. - Participate in incident response and on-call, write runbooks, and improve the platform using what we learn from incidents. WHAT YOU BRING - 3+ years of experience as a Site Reliability Engineer, Platform/Infrastructure Engineer, Observability Engineer, or similar production engineering role. - Comfortable managing production systems at scale that collect, process, store, and serve telemetry such as metrics, logs, traces, or profiles. - Experience with Prometheus or a Prometheus-compatible monitoring stack, including metrics collection, querying, and alerting. - Experience troubleshooting distributed production systems, including availability, latency, data flow, and capacity issues. - Experience with Infrastructure as Code, particularly Terraform, and CI/CD. - Experience operating containerised workloads with Nomad, Kubernetes, or similar platforms. - Solid scripting/programming ability and comfort using AI tools and agents (e.g., Claude) to accelerate delivery. - Strong incident response, documentation, and collaboration skills. NICE TO HAVES - Experience with VictoriaMetrics, Grafana, Tempo, Loki, Vector, Splunk, Alertmanager, or OpenTelemetry. - Experience with PromQL or LogQL, dashboards or alerts as code. - Experience with maintaining operators and their related CRDs in Kubernetes. - Experience with Consul, Vault, AWS, and on-premises or datacentre infrastructure. - Experience operating high-volume logging, streaming, or data pipelines. - Experience making practical trade-offs between observability data volume, performance, and cost. - Background in highly regulated or financial services environments where change management and audit trails are critical. Unless a specific application deadline is stated in the job posting, applications are accepted on an ongoing basis. Please note, applicants are permitted to redact or remove information on their resume that identifies age, date of birth, or dates of attendance at or graduation from an educational institution. We consider qualified applicants with criminal histories for employment on our team, assessing candidates in a manner consistent with the requirements of the San Francisco Fair Chance Ordinance. OUR COMMITMENT Payward is powered by people from around the world and we celebrate the diverse talents, backgrounds, contributions, and unique perspectives that everyone brings to the table. We hire based on merit, seeking out people with the right abilities, knowledge, and skills for the job. We encourage you to apply for roles where you don't fully meet the listed requirements, especially if you're passionate or knowledgeable about crypto. We may ask candidates to complete job-related skills or work-style assessments as part of our hiring process. These assessments evaluate competencies relevant to the role and are applied consistently across candidates for similar positions. Results are considered alongside experience and interviews, and are not the sole basis for any employment decision. As an equal opportunity employer, we don't tolerate discrimination or harassment of any kind, whether based on race, ethnicity, age, gender identity, citizenship, religion, sexual orientation, disability, pregnancy, veteran status, or any other protected characteristic as outlined by federal, state, or local laws. Stay connected Follow us on Twitter https://twitter.com/krakenfx Learn on the Kraken Blog https://blog.kraken.com/#:~:text=Enter%20your%20email%20address Connect on LinkedIn https://www.linkedin.com/company/kraken-exchange/ Candidate Privacy Notice https://www.kraken.com/legal/candidate-privacy-notice