Staff Software Engineer – OpenTelemetry, Python instrumentation

Job not on LinkedIn

🔥 0 minutes ago

🌐 United Kingdom, Germany, +3 more countries – Remote

🇬🇧 United Kingdom – Remote 🇩🇪 Germany – Remote 🇮🇪 Ireland – Remote 🇪🇸 Spain – Remote 🇸🇪 Sweden – Remote

💵 £107k - £134k / year

⏰ Full Time

🔴 Lead

🧑‍💻 Full-stack Engineer

🇬🇧 UK Skilled Worker Visa Sponsor

This company has sponsored UK Skilled Worker visas in the past.

👻 Ghost score 2%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Grafana Labs

WebsiteLinkedInAll Job Openings

501 - 1000 employees

Founded 2014

🏢 Enterprise

☁️ SaaS

🤖 Artificial Intelligence

Enterprise • SaaS • Artificial Intelligence

Grafana Labs is a company that specializes in open-source observability technologies and solutions. It offers a comprehensive suite of tools for logging, metrics, tracing, and profile management with products like Grafana, Loki, Tempo, and Mimir. Their offerings are designed to help businesses visualize, monitor, and alert on data from various sources, providing capabilities such as anomaly detection, root cause analysis, and service level objective management using AI/ML insights. Grafana Labs provides both cloud-based and self-managed solutions, ideal for infrastructure, application, and frontend observability. Additionally, their platform supports integration with various data sources like Prometheus and OpenTelemetry, making them a key player in the observability and infrastructure monitoring space.

📋 Description

• Develop and maintain the OpenTelemetry Python SDK and instrumentation libraries • Collaborate with OpenTelemetry maintainers, SIGs, users, and other vendors on specifications, APIs, and implementation decisions • Build Python instrumentation connecting AI agent runs, model calls, and tool execution across asynchronous code • Contribute to OpenTelemetry conventions for generative AI, considering sensitive data and metric cardinality • Improve Python SDK performance using profiling and benchmarks • Evaluate tradeoffs involving runtime overhead, compatibility, and maintainability • Teach others and promote OpenTelemetry, semantic conventions, and technology/framework best practices • Support the team’s technical direction and Grafana Labs’ OpenTelemetry strategy • Own projects from ambiguous problem through design, implementation, testing, documentation, and release • Partner with GTM, Product, and Support teams • Join customer conversations, investigate instrumentation issues, and turn findings into fixes and practical guidance • Contribute to open-source communities and Grafana Labs products

🎯 Requirements

• 8+ years of experience in software development • Strong proficiency in Python • Experience debugging production software, language internals, libraries, and asynchronous code • Interest in AI applications and agent systems • Experience working in open-source communities • Familiarity with observability tooling such as Grafana, Prometheus, and OpenTelemetry • Experience with cloud-based software or systems engineering • Understanding of production environments and ability to assess operational risks • High agency and good communication skills • Experience in open source observability projects, ideally OpenTelemetry or Prometheus (bonus) • Experience in Python instrumentation techniques, profiling, runtime diagnostics, or asynchronous context propagation (bonus) • Experience in hands-on technical leadership, setting technical direction, and leading project teams (bonus) • Experience instrumenting AI frameworks or agent workflows, or working with OpenTelemetry semantic conventions for generative AI (bonus) • Experience contributing to or maintaining Open Source projects, with successful pull requests and community collaboration (bonus) • Rust experience (plus)

🏖️ Benefits

• Restricted Stock Units (RSUs) • 100% remote work and global remote culture • Career growth pathways • Transparent communication and regular company-wide updates • Autonomy and support to ship great work • Empowered, high-trust teams • Approachable and transparent leadership • In-person onboarding • 30 days annual leave per annum • 3 annual leave days reserved for Grafana Shutdown Days

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume