Query Logs Clicks are not relevance judgments although they are correlated biased by a number of factors such as rank on result list Can use clickthough data to predict preferences between pairs of documents appropriate for tasks with multiple levels of relevance, focused on user relevance various"policies"used to generate preferences 14/NQuery Logs • Clicks are not relevance judgments – although they are correlated – biased by a number of factors such as rank on result list • Can use clickthough data to predict preferences between pairs of documents – appropriate for tasks with multiple levels of relevance, focused on user relevance – various “policies” used to generate preferences 14/N