Senior Software Engineer, AI Training

Team: IT

Location: Canada

Commitment: Contract

Workplace Type: remote

Accountabilities:

• Evaluate AI-generated coding interactions from end to end, assessing whether responses are useful, accurate at a high level, and aligned with strong engineering practices.
• Assess the quality of AI reasoning, explanations, preambles, and guidance rather than focusing solely on whether generated code is technically correct.
• Distinguish between different levels of response quality and articulate what separates an acceptable interaction from an exceptional one.
• Provide clear, direct, and well-reasoned written feedback on what worked, what failed, and what felt misleading, ineffective, or inconsistent with experienced engineering judgment.
• Help establish standards for what excellent AI-assisted development interactions should look like across tools such as Cursor, Codex, and Claude Code.
• Evaluate whether AI interactions demonstrate sound engineering judgment, build user trust, and guide developers effectively rather than simply producing technically valid output.
• Record concise video explanations when needed to communicate evaluation findings and reasoning clearly.

Requirements

• Senior, Staff, Principal-level software engineering experience, or equivalent depth of professional engineering experience.
• Strong background in TypeScript/JavaScript or Python, with a deep understanding of modern software engineering practices.
• Hands-on experience with at least one AI-assisted coding tool such as OpenAI Codex, Claude Code, or Cursor.
• Strong familiarity with modern AI-assisted development workflows and the ways developers interact with coding agents.
• Ability to evaluate code and engineering decisions at a high level without necessarily executing the code or reviewing every individual line.
• Strong written and spoken English at B2 level or above, with the ability to provide detailed written feedback and record short video explanations.
• Comfortable making subjective but rigorous judgments and communicating direct, well-supported opinions.
• High standards for engineering quality, developer experience, technical reasoning, and effective communication.

Benefits

• Contract engagement with a fully remote work model, available worldwide.
• Compensation of $100–$200/hour, depending on experience and location.
• Flexible workload of 10–20 hours per week.
• Ongoing project opportunities, with individual projects typically lasting from approximately two weeks to a few months.
• Potential for additional projects based on successful performance and available opportunities.
• Opportunity to contribute to the evaluation and development of modern AI-assisted software engineering workflows.
• Start as soon as the take-home evaluation is completed and a project opening becomes available.
• Selection process consists of one take-home evaluation exercise with a recorded Loom walkthrough; no interview is required.