We're looking for experienced Grafana power users to design expert-level evaluation tasks that test whether AI agents can use Grafana the way a real professional does. Your domain expertise is what makes these tasks authentic. What You'll Do - Design realistic, multi-step Grafana workflows - dashboards, alerting rules, data source configuration, panel setup, cross-module operations - Perform each workflow yourself on a hosted Grafana instance to produce a reference trajectory - Write clear, specific task prompts with measurable outcomes that can be verified programmatically - Implement programmatic graders that check whether each instruction was completed correctly - Review AI agent attempts at your tasks, identify where and why they fail, and tag root causes - Calibrate task difficulty so tasks are challenging but solvable - iterating on prompts and constraints based on model performance Requirements - 2+ years of daily, professional Grafana experience (SRE, Platform Engineering, Observability, or similar) - Deep familiarity with PromQL, dashboard templating, alerting pipelines, and data source configuration (Prometheus, InfluxDB, etc.) - Ability to articulate workflows clearly enough for programmatic verification - Comfort writing basic grading scripts (Python; engineering support provided as needed) Nice to Have - Experience with Grafana API automation - Kubernetes / infrastructure monitoring background - Familiarity with AI evaluation or benchmarking Time Commitment - 10-15 hrs / week minimum during the project - Fast turnaround expected - responsiveness matters
Remote Grafana Expert (Software Engineer) - AI Trainer ($90-$150 per hour) • Holyoke, Massachusetts, US
Certified Registered Nurse Anesthetist | Anesthesiology - General/Other.LocumJobsOnline is working with CompHealth to find a qualified Anesthesiology CRNA in Shelburne, Massachusetts, 01301!.We're ...Show more
Registered Nurse (RN) | Telemetry.TravelNurseSource is working with GQR Healthcare to find a qualified Telemetry RN in Greenfield, Massachusetts, 01301!.GQR Healthcare is representing a well-known ...Show more
LPN Homecare in Greenfield, MA.With $1 per hour Night/Weekend Differential.Flexible day, evening and overnight shifts available.Onboarding Bonus Potential for up to $300 .Maxim Healthcare Services ...Show more
Fusion Medical Staffing is seeking an experienced Physical Therapy Assistant for an exciting Travel Allied job in Greenfield, MA.Shift: Inquire Start Date: ASAP Duration: 13 weeks Pay: $1283 / Week...Show more
About UMass AmherstThe flagship of the Commonwealth, the University of Massachusetts Amherst is a nationally ranked public land-grant research university that seeks to expand educational access, fu...Show more
AlliedTravelCareers is working with Converdia Health Staffing to find a qualified Physical Therapy Assistant (PTA) in Greenfield, Massachusetts, 01301!.ConVerdia Health Staffing- Staffing temporary...Show more
Preferred Healthcare Staffing is seeking an experienced Physical Therapy Assistant for an exciting Travel Allied job in Greenfield, MA.Shift: 8 hr days Start Date: ASAP Duration: 13 weeks Pay: $131...Show more
We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...Show more
Macroeconomic Modeling Specialist (EViews).AI labs train foundational models and enterprises build AI agents.We provide frontier evaluations and reinforcement learning environments used to improve ...Show more
Client in MA seeking Physical Therapy Assistant: LTC/SNF.We are looking for a healthcare professional who is ready to provide exceptional patient care in this contract/travel role.Contract/travel a...Show more
Real-world expertise is turned into training data, evaluations, and feedback loops that improve how models perform.AI labs and enterprises use micro1 to train models and build reliable AI agents th...Show more
AI labs train foundational models and enterprises build AI agents.We provide frontier evaluations and reinforcement learning environments used to improve LLM capabilities, as well as contextual eva...Show more
DataAnnotation is committed to creating high-quality AI.Join our team to help train the next generation of AI while enjoying the flexibility of remote work and the freedom to set your own schedule....Show more
Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion.You will help influence brand decisions on se...Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet...Show more
Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion.You will help influence brand decisions on se...Show more
AlliedTravelCareers is working with Converdia Health Staffing to find a qualified Physical Therapist (PT) in Greenfield, Massachusetts, 01301!.ConVerdia Health Staffing- Staffing temporary and perm...Show more
Competitive weekly pay (inquire for details) .AlliedTravelCareers is working with Seven Healthcare to find a qualified Physical Therapy Assistant (PTA) in Greenfield, Massachusetts, 01301!.Greenfie...Show more
