Evaluation of Search Results
1. Fully Meets Ratings for the Query: [New York Spanish food], English (US)
- Result Block: Phone in process of calling the most highly-rated Spanish restaurant in New York.
- True or False: False
Explanation: This type of result does not fully meet the user's search intent as it does not directly
provide information about Spanish food options.
- Result Block: Homepage of the most highly-rated Spanish restaurant in New York.
- True or False: False
Explanation: While this may provide some relevant information, it does not address the broader query
for various Spanish food options.
- Result Block: Prominent link to the official website of a highly-rated Spanish restaurant with visit-in-
person info.
- True or False: False
Explanation: Similar to the previous examples, this result does not encompass the user's intent for a
broader selection of Spanish food.
- Result Block: List of two restaurants serving Spanish food in New York.
- True or False: False
Explanation: A limited list does not fully satisfy the information needs implied by the broad search
query.
---
2. Queries with Explicit Location
, - Query: [Pet shop in Florida], English (US)
- True or False: True
Explanation: This query specifies a clear location (Florida).
- Query: [Walmart Manhattan], English (US)
- True or False: True
Explanation: This query specifies a clear location (Manhattan).
- Query: [Book shops nearby], English (US)
- True or False: False
Explanation: This query lacks a specific location.
- Query: [Taco Bell Los Angeles], English (US)
- True or False: True
Explanation: This query specifies a clear location (Los Angeles).
---
True or False Statements
1. A Fully Meets rating can be given to a satisfying and complete result for a broad information query.
- True or False: False
2. For a Know Simple query, a Fully Meets rating can be given if the result does not display the answer
but it is at the very top of the landing page.
- True or False: False
3. A common interpretation for a non-visit-in-person entity query can have a Fully Meets rating.
- True or False: False