- Avoid experimenter bias
- Encourage participant motivation
- Account for participants individual differences
- Account for differences in tasks and queries
- Control test collection characteristics
- Account for differences in timing response variable
- Compare against a strong baseline

Indiana University

- Standard Information Retrieval Evaluation
- Informal Usability Testing
- Formal Studies and Controlled Experiments
- Longitudinal Studies
- Analyzing Search Engine Server Logs
- Large-Scale Log-Based Usability Testing (Bucket Testing)
- Special Concerns with Evaluating Search Interfaces

Methods for Evaluating Search User Interfaces

Hearst, M. A. (2009). Search user interfaces. Cambridge University Press. [https://searchuserinterfaces.com/book/]

Search User Interfaces

Information usability testing refers to a quicker method to obtain responses from users than formal usability testing. It is commonly used to test and identify positive and negative aspects of the user interface, or to compare designs.

Learn Before

Related