Senior Software Engineer & LLM Code Trainer (Remote, Latin America)

About the role

We are seeking a Senior Software Engineer who will also act as an LLM Code Trainer, helping to create and evaluate high‑quality AI training data for a leading human‑in‑the‑loop platform. This remote position blends deep software engineering expertise with AI evaluation, enabling AI labs to build safer and more capable models.

Key responsibilities

• Create and review coding tasks that reflect real‑world engineering scenarios, including debugging, refactoring, API usage, testing, performance, and security.
• Write clear, correct, and testable reference solutions that meet task requirements.
• Evaluate AI‑generated code using structured rubrics, assessing correctness, clarity, security, performance, maintainability, and instruction‑following.
• Compare multiple model outputs, select the best answer, and justify decisions with technical reasoning.
• Identify bugs, hallucinated APIs, missing edge cases, and weak engineering decisions in AI outputs.
• Work with terminal‑based workflows: run tests, debug, manage dependencies, and navigate repositories.
• Follow detailed guidelines consistently and participate in calibration activities to ensure reliable evaluations.

Required profile

• 5+ years of professional software engineering experience in backend, full‑stack, or systems roles.
• Strong proficiency in at least one core language (Python, JavaScript/TypeScript, Go, Java, C++, or SQL).
• Hands‑on experience with Terminal‑Bench or similar terminal‑based evaluation tools.
• Comfortable using Git, command‑line interfaces, and standard development workflows.
• Excellent written and verbal English communication.
• Ability to work independently in a remote, asynchronous, fast‑paced environment.

Required skills

• Python
• JavaScript / TypeScript
• Go
• Java
• C++
• SQL
• Git
• Terminal‑Bench
• Docker
• Linux
• Bash