• Via Turkomatic, researchers requester that the crowd plan workflows for and compute answers to several types of objectives, including essay writing, natural language queries, itinerary planning, Java programming, and multimedia content generation.
• Researchers ran more than 20 distinct kinds of queries in total, where each HIT earned the worker a different price.
• Workers were given 20 minutes to complete each HIT.

Requests given to the crowd were phrased as follows:

• Essay writing: “write a 3-paragraph essay about crowdsourcing.”
• Natural language query: “create a list of the names of Department Chairs of the top 20 computer science college programs in the US.”
• Itinerary planning: “plan and complete a road trip from San Francisco, California, to New York City. Completely include the locations of all necessary hotels, restaurants, and sights along the way.”
• Java programming: “Please write a short piece of Java code to reverse a string. The algorithm should take as input a string and output its reverse. Make sure it compiles.”