G
G2iSenior Software Engineer - Python
remotesenior$208K – $416K
via Ashby
About this role
SENIOR AI INTERACTION EVALUATOR (CODEX / CLAUDE CODE)
Contract | $100–$200/hour | 10–20 hrs/week | Start ASAP (through early May)
Check out this Loom video for more details! https://www.loom.com/share/b0d1b0bf24c44ae8b95dca84b9db60e5
We’re looking for highly experienced software engineer (SR+) to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code.
This is not a traditional engineering role.
You won’t be writing production code.
You’ll be evaluating something harder: whether the model thinks like a great engineer.
WHAT THIS ROLE ACTUALLY IS
You will assess how AI coding agents behave in real-world scenarios — focusing on:
- Whether the response makes sense
- Whether the preamble and reasoning are useful…
What we'd score you on
reqspace match rubricFive dimensions, recruiter-grade. Upload your resume and we'll generate a written explanation of where you fit and where the gaps are.
1
Skills match
For this role: typescript, javascript, python, openai, claude…
2
Level fit
This role is senior-level. We check your trajectory against it.
3
Domain experience
Your work in the role's domain matters more than your years total. We weight recent and direct experience.
4
Recency
A skill you used last quarter weighs more than one from five years ago. We grade on recency, not lifetime.
5
Location fit
This role is remote-eligible — we factor in your stated location and time-zone overlap.
Score yourself on this role.
Free · no card · written explanation included
Skills in this role
Pulled from the job description. These are the keywords we'll weight when scoring your fit.
typescriptjavascriptpythonopenaiclaudeloom