Senior Python Engineer - LLM Evaluation, Part-Time AI Review - Remote (United States)

• rate not provided

• 100% remote

• Part-time independent contractor

• 20 or more hours a week, you choose when

Use your senior python engineer - llm evaluation experience to review AI-generated software work and explain what is correct, robust, and ready to improve.

AI training uses realistic code examples and expert feedback to improve model quality. You will evaluate practical engineering work rather than solve abstract puzzles.

OpenTrain AI is committed to fair hiring and evaluates applicants on relevant skills and experience.

## What you will do

• Create or refine realistic software-engineering evaluation tasks.

• Review AI-generated code for correctness, architecture, tests, and maintainability.

• Explain defects, trade-offs, and useful corrections in concise feedback.

• Apply sound engineering judgment across varied repositories and workflows.

## Why this is worth your time

• Apply your senior python engineer - llm evaluation judgment to meaningful AI evaluation work.

• Work remotely on part-time assignments with a flexible schedule.

• Turn specialist knowledge into structured feedback that improves model quality.

• Fully remote and flexible, no fixed shifts, no commute

## Who this is for

• Experience: At least three years of software engineering experience.

• Fluent in English.

• Strong Python skills, including production frameworks, tools, and best practices.

• Experience building full-stack applications and deploying scalable software.

• Strong knowledge of software architecture, development, debugging, and code review.

• Ability to write clear, structured explanations for technical evaluations.

• Familiarity with backend services, data pipelines, or machine learning infrastructure.

• Experience building production systems at high scale and a strong computer science foundation are helpful. Practical engineering skill is valued alongside formal education.

• No AI experience needed.

## Pay and details

• rate not provided as an independent contractor.

• Part-time, flexible schedule; fully remote, United States.

## How to apply

1. Apply on OpenTrain with your resume: https://app.opentrain.ai/api/out/cmw4vczw0001408l56g3ii727?ch=itrecruitment&sub=p_5d02ffc87c37

2. Complete the application on the hiring platform.

3. If shortlisted, take a short AI interview.

This is that work, done remotely around your current schedule.

## About OpenTrain AI

OpenTrain AI connects experienced professionals with paid, part-time AI training and data-labeling work. Contributors review and improve examples that help AI systems produce useful content.