Home / AI Data & Evaluation / RLHF and preference data
RLHF and preference data

Human preference data, judged consistently.

Preference data is a set of human judgments about which of two or more model responses is better, usually with a written reason. It is used in reinforcement learning from human feedback (RLHF) and in evaluation. Navedas provides preference data from calibrated reviewers who compare responses against a written guide and report agreement every week.

What's included

What our team does.

Side-by-side comparisons

Reviewers compare two or more responses to the same prompt and pick the better one.

Written rationales

A short reason for each choice, so the judgment can be audited and reused.

Scoring against a guide

Responses rated on correctness, helpfulness, safety and policy, using your scoring guide.

Calibration and agreement

Reviewers aligned on shared items first; agreement measured on every batch.

Domain prompts

Prompts and comparisons in customer-facing and operations scenarios where our teams have the most experience.

Quality

How we keep the work consistent.

Written guidelines

Agreed with you before work starts, with every change version-tracked.

Calibration first

Reviewers score the same items until they match your own decisions, before any live work.

Gold items and agreement

Known-answer items measure accuracy per reviewer; agreement is measured on every batch.

Second check on hard cases

Edge cases get a second reviewer, and recurring ones go into the guidelines.

Weekly quality report

Accuracy, agreement and turnaround, every week, from the team doing the work.

Who it's for

Built for three kinds of teams.

AI labs

Preference and evaluation data from a managed team, directly or as a delivery partner.

Data platforms

A calibrated team that follows your guidelines and confidentiality terms.

Teams tuning their own models

Preference data built from your domain and your own policies.

Common questions

Rlhf and preference data, answered.

What is RLHF?

Reinforcement learning from human feedback is a way of training a model using human judgments about which responses are better. People compare outputs, those preferences train a reward signal, and the model is tuned toward responses people prefer.

What makes preference data good?

Clear guidelines, calibrated reviewers, written reasons for each choice, and measured agreement. Without them, preferences are noisy and the model learns the noise.

Do you write prompts as well as rank responses?

Yes. We can write domain prompts, including hard and adversarial ones, as well as compare and score the responses.

How do we start?

Every engagement starts with a pilot: a small team on a sample of your real work. We learn your guidelines and agree the quality bar with you, and nothing goes live until the team meets it.

Related
Start with a pilot

Give us one real batch of work. Judge us on that.

Tell us what you need run. We'll scope a pilot and agree the quality bar.

20-minute callYou talk to a team leadYou leave with a pilot plan