Quality Rater General Guidelines Part 3 UPDATED ACTUAL Questions and
CORRECT Answers
Queries that cannot have a fully meet result
Fully Meets (FullyM)
Highly Meets (HM)
Moderately Meets (MM)
Slightly Meets (SM)
Fails to Meet (FailsM)
What receives a needs met rating
Special Content Result Block (SCRB) Rating
Web search result block
Device Action Result Block
Fully Meets rating
, think about would the user click on the link if not rate on
special rating
the block alone
all or almost all mobile users would
If they would look at the landing page as well as both
immediately and fullysatisfied by the result
would need to be helpful to justify a high rating
and would not need to view other results
click is required
very helpful for many or most
mobile users evaluate the landing page
helpful for some users others may want to base your rating on the helpfulness of the action itself
see other re-sults specific clear
helpful for fewer mobile users fully satisfying
connection between the query and result requires minimal effort to find what they are looking for
but not strongor satsifying all or almost all users would be satisfied
most want to see more results complete and perfect
be conservative with this rating
completely fails to meet the needs of the
broad queries
mobile userseach result so the block
ambiguous queries
and the landing page
Highly Meets rating 1/5
CORRECT Answers
Queries that cannot have a fully meet result
Fully Meets (FullyM)
Highly Meets (HM)
Moderately Meets (MM)
Slightly Meets (SM)
Fails to Meet (FailsM)
What receives a needs met rating
Special Content Result Block (SCRB) Rating
Web search result block
Device Action Result Block
Fully Meets rating
, think about would the user click on the link if not rate on
special rating
the block alone
all or almost all mobile users would
If they would look at the landing page as well as both
immediately and fullysatisfied by the result
would need to be helpful to justify a high rating
and would not need to view other results
click is required
very helpful for many or most
mobile users evaluate the landing page
helpful for some users others may want to base your rating on the helpfulness of the action itself
see other re-sults specific clear
helpful for fewer mobile users fully satisfying
connection between the query and result requires minimal effort to find what they are looking for
but not strongor satsifying all or almost all users would be satisfied
most want to see more results complete and perfect
be conservative with this rating
completely fails to meet the needs of the
broad queries
mobile userseach result so the block
ambiguous queries
and the landing page
Highly Meets rating 1/5
