AnnotationPrep

Mindrift AI Tutor & Writer Entry Assessment practice test

9 practice questions for this assessment, each with the grading rationale and underlying rule.

Start practising

Starter assessment: A/B evaluation & fact-checking: practice drill

10 scenarios, graded as you go, with the exact grading principle for every answer. Start free, no sign-up.

Practice tests that prepare you for this assessment

Practise by topic

About this assessment

Platform
Mindrift (Toloka)
Availability
Remote / Global

Exact question counts, time limits, and project rubrics vary by platform cohort and qualification tier. Always read the platform's live project instructions carefully.

Sample scenarios

Prompt: 'Explain how a microwave heats food to a 10-year-old.'

Model A: 'Microwaves emit non-ionizing electromagnetic radiation at 2.45 GHz, inducing dielectric heating via dipole rotation of polar water molecules.'

Model B: 'A microwave shoots invisible energy waves into your food. Those waves make the tiny water drops inside your food wiggle back and forth super fast, and all that wiggling creates heat that warms up your meal.'

Which response is better?

  1. Model A, because 2.45 GHz and dielectric heating are more scientifically precise.
  2. Model B, because it matches the target audience (a 10-year-old) while remaining factually sound.
  3. Model A, because Model B uses informal words like 'wiggle' and 'super fast'.
  4. Neither, because microwaves heat food through thermal conduction from the air.
Show the answer

B. Model B, because it matches the target audience (a 10-year-old) while remaining factually sound.

Audience adaptation is a core helpfulness criterion. Model A fails the 'to a 10-year-old' constraint by using graduate-level physics jargon, whereas Model B translates dipole rotation accurately into kid-friendly language.

Principle: RLHF Helpfulness: Audience & Tone Calibration

Read this AI claim: 'The Eiffel Tower grows up to 15 cm taller in summer due to thermal expansion of its puddle iron, and it was originally built in 1924 as a radio antenna.'

How should you rate this claim?

  1. Accurate, because thermal expansion in summer is real.
  2. Partially true / Inaccurate overall: thermal expansion (~15 cm) is real, but it was built in 1889 for the World's Fair, not 1924.
  3. Completely false on both counts.
  4. Accurate, because it was built in 1924.
Show the answer

B. Partially true / Inaccurate overall: thermal expansion (~15 cm) is real, but it was built in 1889 for the World's Fair, not 1924.

A classic evaluation trap pairs one true, surprising fact (thermal expansion of the Eiffel Tower) with a subtly wrong date (1924 instead of 1889). Evaluators must check every single atomic claim in a sentence.

Principle: Fact-Checking: Atomic Claim Decomposition

Prompt: 'Write a 2-paragraph product description for a ceramic coffee mug. Do not use any adjectives ending in -y (such as cozy, sturdy, or shiny).'

Which phrase in a model's response would FAIL this negative constraint?

  1. 'The matte ceramic surface feels warm in your hands.'
  2. 'Its thick handle provides a comfortable grip every morning.'
  3. 'Enjoy your daily brew in a weighty, glossy mug.'
  4. 'Designed to retain heat during long work sessions.'
Show the answer

C. 'Enjoy your daily brew in a weighty, glossy mug.'

'Every' is a determiner, not an adjective ending in -y, whereas 'weighty' and 'glossy' are both adjectives ending in -y, directly violating the negative constraint.

Principle: Negative Constraints: Lexical & Suffix Rules

Taking this assessment soon?

Tell us what skills or question formats you want more drills on.

Other Core & Generalist RLHF assessments