Testing

Wizard of Oz Testing

Simulate a functional system by having a hidden person (the "wizard") control the responses. The user interacts with the interface, believing it's real. This validates concepts quickly, before investing in development.

Duration
50 mins
Group Size
3-5
Category
Testing
Difficulty
Easy
Energy
Medium

Objectives

This exercise helps you test concept viability, validate complex system ideas, observe user behavior, and identify unexpected use patterns.

Outcomes

You'll complete Wizard of Oz testing, test simulated functionality, and validate concepts.

Step-by-Step Instructions


  1. Setup & Preparation (15 minutes): Create an interface mockup. Set up a hidden workspace for the wizard. Prepare response templates. Brief the wizard on system capabilities. Test the wizard's response speed. Prepare test scenarios.

  2. User Testing Session (30 minutes): The user interacts with the interface. The wizard monitors user actions and manually generates responses. An observer takes detailed notes. Record the screen and user reactions.

  3. Debrief & Analysis (5 minutes): Thank the user. Analyze user behaviors and expectations. Review cases where the wizard struggled. Identify patterns in user language. Assess concept viability.

Unlock Step-by-Step Instructions

Join 2,500+ facilitators who use Workshopr to plan better workshops — free during beta.

Facilitator Tips

Keep the wizard completely hidden; otherwise, the test is invalid. The wizard must respond at a realistic speed. This is excellent for testing AI, chatbots, or complex algorithms early. It reveals real user expectations. The wizard needs quick access to responses but should also improvise. Expect users to push boundaries. Ethically, decide beforehand if you'll reveal the wizard. This is best for concept validation, not detailed design. It can be tiring for the wizard, so rotate roles if running multiple sessions. I've found it tricky sometimes to get the 'wizard' to respond naturally - practicing beforehand helps!

Pre-Work

For Facilitators

  • Review participant profiles and expectations
  • Prepare all materials and supplies
  • Test technology and room setup

For Participants

  • Complete pre-session survey
  • Review background materials
  • Prepare examples or case studies

Unlock Pre-Work Requirements

Join 2,500+ facilitators who use Workshopr to plan better workshops — free during beta.

Materials Required


  • Interface mockup (paper, digital, clickable)

  • Hidden workstation for the "wizard"

  • Communication system between wizard and interface

  • User task scenarios

  • Observation note templates

  • Response templates (for AI/Chatbot testing)

  • Quick typing setup (for AI/Chatbot testing)

  • Physical mockup or prop (for physical products)

  • Hidden controls for wizard (for physical products)

  • Remote operation capability (for physical products)

Unlock Materials Required

Join 2,500+ facilitators who use Workshopr to plan better workshops — free during beta.

Resources & Templates

  • Facilitator Guide (PDF)
  • Participant Workbook Template
  • Presentation Slides
  • Printable Materials

Unlock Resources & Templates

Join 2,500+ facilitators who use Workshopr to plan better workshops — free during beta.

Discussion

0/2000
Loading comments...

Related Exercises

See all exercises

Prototype Testing

1.3 hours

Test prototypes with real users. Learn what works and what doesn't. Focus on learning, not validation. Discover insights, don't prove assumptions.

Testing

System Usability Scale (SUS) Administration & Scoring

1 hour

The System Usability Scale (SUS) is a quick way to measure perceived usability. First, participants complete the SUS questionnaire after using a produ...

Testing

I Like, I Wish, What If

18 mins

This exercise uses three feedback categories to provide balanced and actionable critique. "I Like," "I Wish," and "What If" prompts generate construct...

Testing

Bulls Eye Diagramming

45 mins

Bull's-eye Diagramming is a visual prioritization method from the LUMA collection. It uses concentric circles to represent levels of importance. The e...

Luma

IDEO - Capabilities Quicksheet

1 hour

You've developed a solid solution. What will it take to implement it? Your current team might not be enough. This exercise helps you assess what you h...

Ideo