There are two solutions to the limitation of lack of follow-up questions built in to study. (1) Run some moderated pilot sessions to make sure task phrasing is understandable or if a specific category is completely avoided by users. (2) Include short/ quantitative -survey after remote session and then add follow-up open-end questions based on labels selected as difficult to understand. 

Tree Testing: Solutions to Cons

- Because it is usually remote and unmoderated, researcher can not ask follow-up questions
- User experience of design can't be tested because no visual styling or mockups are implemented

University of Michigan - Ann Arbor

Tree testing focuses on evaluating category labels. This type of study is called "tree" testing because it is assessing hierarchical menus. It is often implemented remotely and unmoderated, and primarily used to follow up card sorting. It also identifies if Information Architecture (IA) structure, labels, and placements align with users’ expectations.

Tree Testing 

Whitenton, Kathryn. “Tree Testing:  Fast, Iterative Evaluation of Menu Labels and Categories.” Nielsen Norman Group, 7 May 2017, https://www.nngroup.com/articles/tree-testing/.

Tree Testing:  Fast, Iterative Evaluation of Menu Labels and Categories

Making comparisons with Tree Testing

- able to evaluate hierarchy based on a real-world scenario
- Because sketching or prototyping  wireframes  of a website or application is not needed, testing can occur very early in design process

Tree Testing: Pros

(1) prepare tree/ hierarchy on excel spreadsheet, listing only one category per row 
(2) create tasks for tree (ex: find a specific product on company's website or test potential problem that a new category may pose)
(3) create instructions that do not give hints to users about the correct categorization and are concise

Tree Testing: Preparation and Formatting

Researchers can use paper prototype if in person or for remote, online softwares such as userzoom.com & Treejack. 

Learn Before

Related

Learn After