[Hiring] Code Expert Evaluator for AI Training @G2i

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more.

Role Description

This project involves reviewing AI-generated responses, evaluating technical accuracy and best practices, and providing expert feedback that trains AI systems to write better code.

• Work with various programming languages and coding challenges
• Ensure AI outputs are functional, efficient, and follow industry standards

Qualifications

• BS, MS, or PhD with a significant focus on Computer Science (Required)
• Expert in Python, with a firm grasp of algorithms, data structures, and debugging practices
• Expert-level English proficiency with excellent writing skills
• Expert at fact-checking information using public sources across multiple domains
• Significant experience using large language models (LLMs)
• Strong analytical and structured thinking skills
• Ability to explain complex programming concepts clearly and accurately
• Prior experience with RLHF annotation (preferred)
• Prior Software Engineering work experience (strongly preferred)
• Expertise in additional programming languages (nice to have): C#, Java, SQL, C++, TypeScript, PHP, C, Go, Bash, PowerShell, Rust, R

Requirements

• Compensation is competitive and varies based on education level, institution, and prior experience