Senior SRE Engineer – Observability Focus

About the role

We are a leading trading platform expanding globally and seeking a senior engineer to own our observability practice end‑to‑end. This hands‑on role involves designing, operating, and scaling the telemetry stack that provides real‑time visibility across a hybrid AWS and on‑premise environment.

Key responsibilities

• Design, deploy, and manage the full observability stack: metrics (VictoriaMetrics), logs (OpenSearch), and traces (OpenTelemetry).
• Architect and operate VictoriaMetrics clusters, including vmstorage, vminsert, vmselect, vmagent scraping, remote write, vmalert rules, and cardinality control.
• Operate OpenSearch clusters with index lifecycle management, hot‑warm‑cold architecture, shard tuning, and Data Prepper ingest pipelines.
• Build and maintain OpenTelemetry Collector pipelines and instrument services in Java, Python, and JavaScript/TypeScript.
• Run Kafka as the telemetry transport layer, handling topic design, partition strategy, consumer‑group lag monitoring, and high‑volume throughput tuning.
• Manage log shipping using Fluent Bit, Vector, or Fluentd and define structured logging standards.
• Create Grafana dashboards and alerts that are clear, actionable, and widely adopted.
• Collaborate with platform and application teams to improve sampling, batching, and context propagation.
• Participate in incident response, post‑mortems, and reliability improvements driven by observability data.
• Mentor engineers on observability best practices and tooling.

Required profile

• 6+ years in DevOps, SRE, or platform engineering, with at least 2 years focused on observability at production scale.
• Deep hands‑on experience with VictoriaMetrics or Prometheus.
• Strong expertise in OpenSearch/Elasticsearch cluster operations.
• Production experience with OpenTelemetry Collector and multi‑language instrumentation.
• Advanced Kafka skills, including producer/consumer patterns and Kafka Connect.

Required skills

• VictoriaMetrics, MetricsQL, PromQL
• OpenSearch, Query DSL, ISM policies
• OpenTelemetry Collector, OTLP, instrumentation (Java, Python, JavaScript, TypeScript)
• Kafka, Kafka Connect, Schema Registry, Strimzi (optional)
• Fluent Bit, Vector, Fluentd
• Grafana
• Kubernetes, Helm