Research

Benchmark Creation Protocol

Benchmarking shows your current state, letting you track progress. This exercise sets initial metrics for usability, satisfaction, or other UX aspects. It's the base for measuring improvements later.

Duration
3 hours
Group Size
12-20
Category
Research
Difficulty
Easy
Participants will:

  • Select relevant UX metrics.

  • Design standard tasks for solid data.

  • Build repeatable processes.

  • Get baseline measurements for comparison.

  • Plan regular benchmarks and analysis.


  • Baseline metrics for tracking progress.

  • Standard process for future comparisons.

  • Clear view of current UX performance.

  • Basis for measuring design ROI.

Consistency is key—use the exact same process each time. Document everything so others can repeat it. Standard metrics help compare results. Plan how often to benchmark (quarterly, per release).

Consider these metrics:

  • Task success rate.

  • Time on task.

  • Error rate.

  • System Usability Scale (SUS).

  • Net Promoter Score (NPS).

  • Custom satisfaction measures.


In my experience, getting the task scenarios just right takes the most iterations. Don't be afraid to adjust them after the pilot.

  1. Metric Selection (30 minutes): Define what success means. Choose key metrics: success rate, time, errors, satisfaction. Use standard measures (SUS, NPS, CSAT) when you can. Define your own if needed.

  2. Task Definition (30 minutes): Pick tasks that represent real use. Make sure tasks won't change soon. Clearly define what success looks like. Write realistic task scenarios.

  3. Protocol Development (45 minutes): Write a standard test script. Set data collection steps. Create participant criteria. Decide between remote or in-person testing.

  4. Pilot Testing (45 minutes): Test the benchmark with 3-5 people. Improve tasks and steps. Check metric collection. Finalize the process.

  5. Documentation (30 minutes): Document the whole process. Create analysis templates. Plan how you'll compare results. Schedule future benchmarks.

Unlock Step-by-Step Instructions

Create a free account to access step-by-step instructions, agendas, and resources for all activities.

For Facilitators

  • Review participant profiles and expectations
  • Prepare all materials and supplies
  • Test technology and room setup

For Participants

  • Complete pre-session survey
  • Review background materials
  • Prepare examples or case studies

Unlock Pre-Work Requirements

Create a free account to access step-by-step instructions, agendas, and resources for all activities.


  • Stopwatch or timer software.

  • Screen recording software.

  • Survey tool for questionnaires.

  • Spreadsheet templates for analysis.

  • Task scenario scripts.

  • Standard questionnaires (SUS, etc.).

  • Data collection forms.

  • Baseline report template.

Unlock Materials Required

Create a free account to access step-by-step instructions, agendas, and resources for all activities.

Discussion

0/2000
Loading comments...

Related Exercises

See all exercises

Job Statement Framing

1.3 hours

Job Statement Framing ensures precise language in Jobs To Be Done. This 75-minute exercise crafts clear job statements. These capture customer intent,...

Research

Persona Creation

55 mins

Turn user research into archetypes. These personas represent key user segments. They include demographics, behaviors, goals, and frustrations. This ex...

Research

Interview Script Development

1.5 hours

Structured scripts are key to good interviews. This 90-minute exercise helps create interview guides that balance structure and flexibility. Develop p...

Research