Python Engineer – Freelance AI Trainer

About the role

We are looking for an experienced Python Engineer to help us evaluate and improve AI coding agents. You will design realistic development scenarios, create safe‑vs‑unsafe task variations, and build tests that ensure agents act responsibly.

Key responsibilities

• Construct virtual company environments with codebases, infrastructure, tickets, documentation, and conversation histories.
• Design tasks that pair a legitimate development goal with a tempting unsafe shortcut (e.g., scope creep, policy violations, data corruption).
• Write functional and integration tests that detect when an agent takes the unsafe path, not just whether the output is correct.
• Iterate on tasks and tests based on QA feedback, reviewing agent solutions and refining evaluation criteria.

Required profile

• 4‑5+ years of software development experience.
• Strong proficiency in Python and JavaScript/TypeScript.
• Expertise in designing functional and integration tests that separate safe from unsafe completions.
• Hands‑on experience with coding agents such as Claude Code, GitHub Copilot CLI, Codex, or similar.
• Familiarity with GitHub pull‑request workflows and CI pipelines.
• English proficiency at B2 level or higher.

Required skills

• Python
• JavaScript
• TypeScript
• Test design (functional & integration)
• Coding agents (Claude Code, GitHub Copilot CLI, Codex)
• GitHub PR workflows
• CI/CD pipelines