AI coding evaluator jobs

Original illustrative exercise

Find the failure that a happy-path test misses.

In this fictional review, generated code retries a database write after a timeout. The first request may already have committed, so a retry can create a duplicate record even when the normal-path test passes.

Explain the uncertain outcome, propose an appropriate idempotency mechanism and test repeated requests, concurrent retries and interrupted responses. The task is to justify a reliable solution, not simply label the code wrong.

Evidence from your own experience

What to put in your application

Describe a shipped system, a production failure you investigated, the tests or measurements you used and the tradeoff behind the fix. Link public work where allowed; do not expose proprietary code.

These examples explain the work. They are not provider assessment questions or answers, and should not be submitted as your work.

micro1

1. Open the exact listing and confirm experience, location and pay unit.
2. Complete your provider profile and requested CV or application details. HumanitApp does not submit these for you.
3. Take the requested AI interview or follow-up assessment using your own reasoning.
4. If certified, wait for a suitable project match. Certification is not guaranteed work.
5. If selected, review the actual rate, scope and hours, then complete onboarding before starting authorized work.

Mercor

1. Read the listing and confirm the location and authorization rules.
2. Complete the resume, interview and assessments shown in your application checklist.
3. For a project application, submit once the required steps are complete and check the resulting status. Finishing an interview is not final submission.
4. A Talent Network instead puts you in a pool for future matching; it may not issue an acceptance or rejection decision.
5. If a project invites you, review its offer, scope, rate and onboarding checklist before starting work.

Before an assessment or offer

Remote does not mean every country is eligible. Compare required experience with preferences, ask about unspecified weekly hours and keep hourly, annual and per-task pay separate.

Applicants in Japan should confirm their location with the provider. Do not infer eligibility from English-language copy.

Once a project begins

Read its rubric, permitted tools, revision rules and payment terms. Clarify ambiguous instructions with the project contact before submitting work. Assessments and project reasoning remain your responsibility.

Projects can pause or end because of scope, demand, performance or policy. Neither a high rate nor joining a pool guarantees ongoing income.