Search Quality Rater Guidelines UPDATED ACTUAL Questions and
CORRECT Answers
Search engines Exist to help find relevant information
High-quality automated ranking Systems identify useful and reliable information
Helpful Search features Aid users in understanding and accessing information
Content policies Ensure high quality and helpful content in Search
Signals Clues indicating high quality or reliability of a page
Search Quality Tests Evaluate if search results are relevant and reliable
User Research Understand how Search can be more useful
Live Experiments Test proposed changes with real users before launch
Provide ratings based on guidelines to assess search qual-
Search Quality Raters
ity
Assigned searches to evaluate search quality improve-
Rater Task
ments
Raters compare search results with and without proposed
Side-by-side experiment
changes
Rating scales Used by Raters to evaluate pages based on guidelines
How well a page achieves its purpose and usefulness for
Page Quality
a given search.
Assessing if the page fulfills the user's intent and purpose
Needs Met
effectively.
The reason behind the creation of a webpage, such as
Purpose of the page
informing users about events or selling products.
The goal or objective a user has in mind when conducting
User intent
a search or visiting a webpage.
Instructions and criteria for evaluating the quality and
Search Quality Rater Guidelines
relevance of search results.
CORRECT Answers
Search engines Exist to help find relevant information
High-quality automated ranking Systems identify useful and reliable information
Helpful Search features Aid users in understanding and accessing information
Content policies Ensure high quality and helpful content in Search
Signals Clues indicating high quality or reliability of a page
Search Quality Tests Evaluate if search results are relevant and reliable
User Research Understand how Search can be more useful
Live Experiments Test proposed changes with real users before launch
Provide ratings based on guidelines to assess search qual-
Search Quality Raters
ity
Assigned searches to evaluate search quality improve-
Rater Task
ments
Raters compare search results with and without proposed
Side-by-side experiment
changes
Rating scales Used by Raters to evaluate pages based on guidelines
How well a page achieves its purpose and usefulness for
Page Quality
a given search.
Assessing if the page fulfills the user's intent and purpose
Needs Met
effectively.
The reason behind the creation of a webpage, such as
Purpose of the page
informing users about events or selling products.
The goal or objective a user has in mind when conducting
User intent
a search or visiting a webpage.
Instructions and criteria for evaluating the quality and
Search Quality Rater Guidelines
relevance of search results.
