Java of Senior Software Engineer

Responsibilities • Evaluate AI-generated coding interactions from end to end. • Judge whether agent outputs are useful, correct at a high level, and aligned with strong engineering judgment. • Assess the quality of explanations, preambles, reasoning, and user guidance rather than code correctness alone. • Distinguish different levels of response quality and help define what excellent agent behavior looks like. • Provide clear, opinionated written feedback on what worked, failed, or felt misleading. • Record short video explanations of evaluation feedback. Requirements • Senior, staff, or principal-level software engineering experience or equivalent experience. • Strong background in TypeScript, JavaScript, or Python. • Hands-on experience with at least one of OpenAI Codex, Claude Code, or Cursor. • Deep familiarity with modern AI-assisted development workflows. • Ability to evaluate code without executing it or reviewing every line. • Strong written and spoken English at B2 level or above. • Comfort giving direct, opinionated feedback and applying a high standard for engineering quality. Benefits • Remote worldwide contract engagement. • Flexible schedule of 10–20 hours per week. • Ongoing projects lasting approximately two weeks to a few months, with additional projects available to successful evaluators. • Start as soon as the take-home exercise is cleared and a project seat is available. • Selection process consists of one take-home evaluation exercise with a recorded Loom walkthrough and no interview.