We're looking for experienced Grafana power users to design expert-level evaluation tasks that test whether AI agents can use Grafana the way a real professional does. Your domain expertise is what makes these tasks authentic. What You'll Do - Design realistic, multi-step Grafana workflows - dashboards, alerting rules, data source configuration, panel setup, cross-module operations - Perform each workflow yourself on a hosted Grafana instance to produce a reference trajectory - Write clear, specific task prompts with measurable outcomes that can be verified programmatically - Implement programmatic graders that check whether each instruction was completed correctly - Review AI agent attempts at your tasks, identify where and why they fail, and tag root causes - Calibrate task difficulty so tasks are challenging but solvable - iterating on prompts and constraints based on model performance Requirements - 2+ years of daily, professional Grafana experience (SRE, Platform Engineering, Observability, or similar) - Deep familiarity with PromQL, dashboard templating, alerting pipelines, and data source configuration (Prometheus, InfluxDB, etc.) - Ability to articulate workflows clearly enough for programmatic verification - Comfort writing basic grading scripts (Python; engineering support provided as needed) Nice to Have - Experience with Grafana API automation - Kubernetes / infrastructure monitoring background - Familiarity with AI evaluation or benchmarking Time Commitment - 10-15 hrs / week minimum during the project - Fast turnaround expected - responsiveness matters
Remote Grafana Expert (SWE) - AI Trainer ($90-$150 per hour) • Peoria, Illinois, US
Are you interested in working flexible hours, connecting with people one-on-one, and helping them re-engage with their health? At Signify Health, part of CVS Health®, our mission is to build truste...Show more
Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion.You will help influence brand decisions on se...Show more
Registered Nurse Career Opportunity -.Full-Time Nights, pro-rated for Part-Time.Maximise your chances of a successful application to this job by ensuring your CV and skills are a good match.Encompa...Show more
Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion.You will help influence brand decisions on se...Show more
We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...Show more
Embark on Your Compassionate LPN/LVN Journey at Encompass Health.Are you in search of a fulfilling healthcare career close to your heart and home? Encompass Health welcomes you warmly, offering a s...Show more
Earn While You Job Search — Become a Surrogate ✨.Searching for your next opportunity while supporting your family isn’t easy.What if you could earn meaningful income.Why This Opportunity Stands Out...Show more
We are looking for a passionate individual with a sense of responsibility and willingness to help create families to join us as a surrogate.In this role, you will be instrumental in supporting indi...Show more
We are looking for a passionate individual with a sense of responsibility and willingness to help create families to join us as a surrogate.In this role, you will be instrumental in supporting indi...Show more
We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...Show more
We are looking for a passionate individual with a sense of responsibility and willingness to help create families to join us as a surrogate.In this role, you will be instrumental in supporting indi...Show more
Nascency is a boutique surrogacy agency with one mission: making surrogacy a.Our mission-driven team is made up of parents by surrogacy and.We've heard it from our surrogates again and again: "Nasc...Show more
DataAnnotation is committed to creating high-quality AI.Join our team to help train the next generation of AI while enjoying the flexibility of remote work and the freedom to set your own schedule....Show more
At LifeStance Health, we believe in a truly healthy society where mental and physical healthcare are unified to make lives better.Our mission is to help people lead healthier, more fulfilling lives...Show more
We are looking for extraordinary women who feel called to help bring a family to life.As a gestational carrier with My Donor Connection, you will walk alongside intended parents who have prayed, ho...Show more
Real-world expertise is turned into training data, evaluations, and feedback loops that improve how models perform.AI labs and enterprises use micro1 to train models and build reliable AI agents th...Show more
Superprof is the leading tutoring platform in the USA, connecting passionate individuals with eager learners.We operate in over 41 countries, making education accessible to everyone, everywhere.Sup...Show more
Real-world expertise is turned into training data, evaluations, and feedback loops that improve how models perform.AI labs and enterprises use micro1 to train models and build reliable AI agents th...Show more
