Join us in helping advance the next generation of AI models! We are looking for experienced Software Engineers to contribute to a cutting-edge AI evaluation project. This project plays a key role in improving how frontier language models understand, reason about, and generate production-quality software. You'll evaluate AI-generated solutions through the lens of an experienced software engineer, helping shape the future of AI-assisted software development. * * * ## **Project Timeline** - **Project Duration:** Approximately 1 week - **Expected Timeline:** July 8–14 - **Expected commitment:** at least 10 hours - Candidates must be located in **US/ Canada** due to the need for real-time collaboration with the project team. * * * ## **Background & Qualifications** **YOE** - 3+ years of professional software engineering experience (or equivalent open-source experience) **Technical Expertise** - **JavaScript / TypeScript:** Node.js, React, TypeScript, modern web application development - **Go:** Backend services, distributed systems, REST/gRPC APIs, cloud-native development (Kubernetes experience is a plus) - **Python:** Backend development, open-source libraries, DevOps/infrastructure automation, testing frameworks **Software Engineering** - Experience working with large production codebases - Ability to quickly understand unfamiliar repositories and software architectures - Experience reviewing code for readability, maintainability, and software design - Strong engineering judgment and a solid understanding of software engineering best practices **GitHub & Open Source** - Strong understanding of Git and GitHub workflows (e.g., branching, Issues, Pull Requests, and Code Reviews) - Experience navigating open-source repositories and collaborating through GitHub - Familiarity with open-source development workflows is highly preferred - Familiarity with SWE-Bench or SWE-Bench Pro is a plus **Communication** - Strong English communication skills * * * ## **Responsibilities** - Become familiar with assigned open-source codebases and their engineering practices - Review code changes, technical discussions, and related software artifacts - Evaluate AI-generated code for correctness, quality, maintainability, and engineering best practices - Provide structured evaluations with clear technical reasoning - Collaborate with fellow technical reviewers to ensure high-quality and consistent evaluations * * * **Note:** This is **not a software development role**. Rather than writing code, you'll leverage your software engineering expertise to evaluate AI-generated solutions and help improve the capabilities of state-of-the-art coding models.
Remote Senior Software Engineers - AI Trainer ($50-$75 per hour) • Knoxville, Tennessee, US
Review and label digital content including text, images, and documents.Every task you complete helps improve how technology interprets information and performs in practical settings.Detail-oriented... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Senior Backend Engineer Over 7,500 companies - from scrappy startups to global brands - use our platform to send billions of emails, push notifications, in-app messages, and SMS every day.We help t... Show more
Type of Requisition :Regular Clearance Level Must Be Able to Obtain :None Public Trust / Other Required :NACI (T 1) Job Family :Systems Engineering At GDIT youll be a meaningful part of improving h... Show more
Elk Valley Home And Community Based Services Aide.Explore opportunities with Elk Valley, a part of LHC Group, a leading post-acute care partner for hospitals, physicians and families nationwide.As ... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Make a Difference on Your Own Schedule and Terms!.Hiring Registered Nurses in Tennessee.Professional Case Management, the leader in home healthcare, is now hiring RN's to provide in-home healthcare... Show more
Remote Jobs are now available in your area.This position is a work from home position.You will not need to come into the office.Benefits: Health Insurance, 401K, Vacation& PTO.Apply now! Work f... Show more
Elk Valley Home And Community Based Services Aide.Explore opportunities with Elk Valley, a part of LHC Group, a leading post-acute care partner for hospitals, physicians and families nationwide.As ... Show more
Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion.You will help influence brand decisions on se... Show more
Modern HealthModern Health is a mental health benefits platform for employers.We are the first global mental health solution to offer employees access to one-on-one, group, and self-serve digital r... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion.You will help influence brand decisions on se... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Area Store Manager Trainee - Group 24.Store Managers are responsible for overseeing all aspects of store operations, driving sales, developing high-performing teams, and ensuring exceptional custom... Show more
Elk Valley Home And Community Based Services Aide.Explore opportunities with Elk Valley, a part of LHC Group, a leading post-acute care partner for hospitals, physicians and families nationwide.As ... Show more
Elk Valley Home And Community Based Services Aide.Explore opportunities with Elk Valley, a part of LHC Group, a leading post-acute care partner for hospitals, physicians and families nationwide.As ... Show more
