When using the learning to rank framework for combining multiple features into a ranking function, training data composed of queries and relevance judgments is needed to learn the model parameters.