We're looking for experienced Grafana power users to design expert-level evaluation tasks that test whether AI agents can use Grafana the way a real professional does. Your domain expertise is what makes these tasks authentic. What You'll Do - Design realistic, multi-step Grafana workflows - dashboards, alerting rules, data source configuration, panel setup, cross-module operations - Perform each workflow yourself on a hosted Grafana instance to produce a reference trajectory - Write clear, specific task prompts with measurable outcomes that can be verified programmatically - Implement programmatic graders that check whether each instruction was completed correctly - Review AI agent attempts at your tasks, identify where and why they fail, and tag root causes - Calibrate task difficulty so tasks are challenging but solvable - iterating on prompts and constraints based on model performance Requirements - 2+ years of daily, professional Grafana experience (SRE, Platform Engineering, Observability, or similar) - Deep familiarity with PromQL, dashboard templating, alerting pipelines, and data source configuration (Prometheus, InfluxDB, etc.) - Ability to articulate workflows clearly enough for programmatic verification - Comfort writing basic grading scripts (Python; engineering support provided as needed) Nice to Have - Experience with Grafana API automation - Kubernetes / infrastructure monitoring background - Familiarity with AI evaluation or benchmarking Time Commitment - 10-15 hrs / week minimum during the project - Fast turnaround expected - responsiveness matters
Remote Grafana Expert (SWE) - AI Trainer ($90-$150 per hour) • Nampa, Idaho, US
DataAnnotation is committed to creating high-quality AI.Join our team to help train the next generation of AI while enjoying the flexibility of remote work and the freedom to set your own schedule....Show more
DataAnnotation is committed to creating high-quality AI.Join our team to help train the next generation of AI while enjoying the flexibility of remote work and the freedom to set your own schedule....Show more
Registered Nurse (RN) | Intensive Care Unit (ICU) / Critical Care.TravelNurseSource is working with All Medical Personnel to find a qualified ICU/Critical Care RN in Southwestern Illinois, Illinois...Show more
Registered Nurse (RN) | Intensive Care Unit (ICU) / Critical Care.TravelNurseSource is working with All Medical Personnel to find a qualified ICU/Critical Care RN in Southwestern Illinois, Illinois...Show more
DataAnnotation is committed to creating high-quality AI.Join our team to help train the next generation of AI while enjoying the flexibility of remote work and the freedom to set your own schedule....Show more
DataAnnotation is committed to creating high-quality AI.Join our team to help train the next generation of AI while enjoying the flexibility of remote work and the freedom to set your own schedule....Show more
We are looking for a passionate individual with a sense of responsibility and willingness to help create families to join us as a surrogate.In this role, you will be instrumental in supporting indi...Show more
DataAnnotation is committed to creating high-quality AI.Join our team to help train the next generation of AI while enjoying the flexibility of remote work and the freedom to set your own schedule....Show more
DataAnnotation is committed to creating high-quality AI.Join our team to help train the next generation of AI while enjoying the flexibility of remote work and the freedom to set your own schedule....Show more
Registered Nurse (RN) | Medical-Surgical.TravelNurseSource is working with All Medical Personnel to find a qualified Med/Surg RN in Southwestern Illinois, Illinois, 62040!.Registered nurses in this...Show more
The Terraces of Boise in Boise, ID, a HumanGood community nationally rated as 2025-2026 Best Senior Living community for Assisted Living, Independent Living and Memory Care by U.S News & World Repo...Show more
DataAnnotation is committed to creating high-quality AI.Join our team to help train the next generation of AI while enjoying the flexibility of remote work and the freedom to set your own schedule....Show more
DataAnnotation is committed to creating high-quality AI.Join our team to help train the next generation of AI while enjoying the flexibility of remote work and the freedom to set your own schedule....Show more
DataAnnotation is committed to creating high-quality AI.Join our team to help train the next generation of AI while enjoying the flexibility of remote work and the freedom to set your own schedule....Show more
Registered Nurse (RN) | Medical-Surgical.TravelNurseSource is working with All Medical Personnel to find a qualified Med/Surg RN in Southwestern Illinois, Illinois, 62040!.Registered nurses in this...Show more
DataAnnotation is committed to creating high-quality AI.Join our team to help train the next generation of AI while enjoying the flexibility of remote work and the freedom to set your own schedule....Show more
Certified Registered Nurse Anesthetist | Anesthesiology - General/Other.Competitive weekly pay (inquire for details) .LocumJobsOnline is working with All Medical Personnel to find a qualified Anest...Show more
Registered Nurse (RN) | Emergency Room (ER) / Trauma.TravelNurseSource is working with All Medical Personnel to find a qualified ER/Trauma RN in Southwestern Illinois, Illinois, 62040!.RN-Emergency...Show more
