UQV100Id TRECTopic TRECSubtopic DocId RenderUrl RealUrl Backstory GoldLabel GoldLabelComment UQV100.Qual.001 257 1 clueweb12-1908wb-59-07154 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-1908wb-59-07154 www.louissachar.com/HolesBook.htm You are trying to find some new books for your book-loving niece to read. While looking through a list of Newberry award winners, you see a book called Holes, written by Louis Sachar. Is there a summary of it you can read, as you don't want to give her one that has content inappropriate for her age? 4 You can see that this page is the all about the book Holes, and belongs on the author site of Louis Sachar. The page is the obvious authoritative source of information on the book and thus this is Essential. UQV100.Qual.002 266 0 clueweb12-1303wb-14-11933 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-1303wb-14-11933 heart.org/HEARTORG/Conditions/HEARTORG/Conditions/Conditions_UCM_305346_SubHomePage.jsp A friend was recently hospitalized after a heart attack. You think you should be better prepared, for both you and your partner, so you'd like to know the symptoms of a heart attack in both men and women. 4 This page is from the American Heart Association, the obvious authoritative source, and provides detailed information on heart attack symptoms and what to do in the event of one. No other page is required if you encountered this, so it is Essential. UQV100.Qual.003 269 1 clueweb12-1907wb-65-23304 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-1907wb-65-23304 boe.mars.k12.wv.us/ You are thinking of taking a job in Marshall County, West Virginia, and you'd like to find out more about living there. In particular, you'd like to find any information on the schools there. 4 This page is clearly the home page of the Marshall County schools, containing general information and links to all the schools in the county. The person would see this as an Essential page in their results. UQV100.Qual.004 210 3 clueweb12-0000wb-01-03896 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-0000wb-01-03896 gps.about.com/od/sportsandfitness/tp/Best_iPhone_Golf_GPS_Apps.htm GPS (global positioning system) technology is now in widespread use, and as a keen amateur golfer, you have noticed an increase in the use of GPS devices on the golf course, to compute shot distances and so on. You wonder whether there is an iPhone app that you can download and use, rather than having to buy a specialized golf GPS device. 3 This page lists a number of high quality iPhone apps for golf playing, equivalent to the GPS devices mentioned. It clearly answers the need, and no additional page would be required after reading this, so it is Very Useful. UQV100.Qual.005 223 0 clueweb12-0601wb-98-19026 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-0601wb-98-19026 www.okinawa-diet.com/okinawa_diet/usda_pyramid.html You've recently been binging on junk food, and want to live a healthier life. As a starting point, you decide to check information from the USDA. Find a description of their food pyramid. 3 The USDA food pyramid is shown in entirety as a picture (although without much description). If you were familiar with the concept, you might not need to read any more after seeing this, so it is Very Useful. However, it is not Essential, as there is no surrounding text should you wish to have some more description and context about the food pyramid and what it represents. Nor is it from the USDA's site. UQV100.Qual.006 227 0 clueweb12-0005wb-02-15778 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-0005wb-02-15778 lyrics.doheth.co.uk/songs/gloria-gaynor/gloria-gaynor/i-will-survive-extended-mix.php A noisy neighbor was playing "I will survive" over the weekend and the song is stuck in your head. You can't remember all of the lyrics though: what are they? 3 This page clearly has the lyrics for I Will Survive, and having read them, you might not need to read any other page. Thus this is Very Useful. Since there might be other pages with the same lyrics, it is not Essential. UQV100.Qual.007 256 0 clueweb12-0310wb-45-06246 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-0310wb-45-06246 ncpd.org/ministries-programs/specific/mentalillness/resources/patronsaint At a trivia night, a question is asked about various patron saints. You know St Anthony is the patron saint of lost things, but who is it for mental illness? 3 This page clearly answers the need to find out the name of the saint, and has a comprehensive overview, and is from an authoritative Catholic organization. You might not need to read any other page, so this is Very Useful. UQV100.Qual.008 265 5 clueweb12-0304wb-22-06981 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-0304wb-22-06981 www.spc.noaa.gov/faq/tornado/f-scale.html You overheard a TV broadcast mention an "F5" tornado, and you'd like to know what wind speed that means. 3 This page contains all the important information needed about different tornado speeds relative to scales, including F5. There might be other equivalently good pages however, so it is Very Useful, not Essential. UQV100.Qual.009 214 0 clueweb12-0208wb-88-11331 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-0208wb-88-11331 www.mystockoptions.com/faq/index.cfm/catID/C93C0B43-0AD9-43C2-9100D87486AE4035/ObjectID/D943A3D6-30A9-11D4-B9080008C79F9E62 Your aunt who lives in the USA has asked you for help in completing her tax return. Being a helpful person, you quickly agreed to find out what the US capital gains tax rate consists of, and how it's broken down. 2 This page provides some substantial information about capital gains and the associated taxation rules, but mainly about stock and does not discuss other capital gains. It is a page on mystockoptions.com, so it is not as authoritative as something from the government or a reputable accounting firm, and thus it is Mostly Useful, and not Very Useful. UQV100.Qual.010 222 1 clueweb12-0101wb-31-04912 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-0101wb-31-04912 www.bodylogicmd.com/for-men/symptoms-of-andropause Your uncle told you that he's been feeling strange lately, and this made you wonder if he might be going through male menopause. What are the symptoms and signs of this condition? 2 This page contains descriptions of the condition, and various symptoms, together with links to more detailed information on those symptoms. It also discusses treatment options, and comes from a medical site. However, you would expect to read other pages on other sites, so this is Mostly Useful. UQV100.Qual.011 234 0 clueweb12-0112wb-65-34543 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-0112wb-65-34543 www.longevity-and-antiaging-secrets.com/healthy-chocolate.html A magazine article mentioned dark chocolate as a "healthy" food. This has got you wondering what the health benefits of dark chocolate might actually be. 2 This page has extensive information about the health benefits of dark chocolate, and why these may exist and what kind of dark chocolate you should eat. It is a page on an anti-ageing website however, so is not as authoritative as a medical site for example, and you would expect to read other pages from other sites. Thus this is a Mostly Useful page, not a Very Useful page. UQV100.Qual.012 267 0 clueweb12-0702wb-03-33929 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-0702wb-03-33929 www.spanishromance.com/spanish-language/lyrics/jose-feliciano/feliz-navidad.asp You came across some old Christmas cards the other day and one of them said "Feliz Navidad". You know there's a song with that name and now you'd like some help remembering the lyrics. 2 This page appears to have the lyrics for Feliz Navidad. However, the site itself seems not to be a dedicated lyrics site, and it says Spanish lyrics, with English below the Spanish. You cannot be sure this is authoritative and comprehensive, so it is only Mostly Useful, and not Very Useful. UQV100.Qual.013 201 4 clueweb12-0917wb-42-14097 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-0917wb-42-14097 elinux.org/RaspberryPi You have heard quite a lot about cheap computing as being the way of the future, including one recent model called a Raspberry Pi. You start thinking about buying one, and wonder how much they cost. 1 This page clearly comes from a comprehensive community wiki site about the Raspberry Pi computer, and has a Buying Guide section with links to information about how much you may expect to pay. Earlier in the page, there is a minimal bit of information about expected costs in GBP and USD indicated with a "~" to indicate approximate amounts, but without firm prices. Thus this is Slightly Useful since you are probably only one click away from getting useful information, plus there is a minimal bit of information in the page itself. It is neither Mostly Useful, which would require substantial information about the need, or Not Useful. UQV100.Qual.014 203 0 clueweb12-0103wb-91-09127 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-0103wb-91-09127 www.cinemainfocus.com/messages.aspx?parentnavigationid=2869&viewmessageguid=83e10632-31cb-4873-95d0-8a70557b9fea Your sister has given you tickets to the movie "Les Miserables" for your birthday. You decide to read some online reviews of it before you attend, to get a feeling for what you are going to see. 1 While this page is on a movie site, the information provided is really just a plot summary, not an actual review of the movie. About the only information useful is mentioning some of the actors who play lead roles. Thus this is Slightly Useful, you would definitely have to read other pages to understand whether the movie itself was any good or not. UQV100.Qual.015 216 1 clueweb12-1910wb-54-15386 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-1910wb-54-15386 www.competitivecars.com/tag/nicolas-cage-films You recently watched an awful movie called "The Knowing" which starred Nicolas Cage. This has made you wonder what other movies Nicolas Cage has appeared in. 1 This page has a link and picture of Gone In 60 Seconds, and indicates clearly that it is a Nicolas Cage movie. However there are no other movies by him listed on the page, and it is a relatively low quality page, so this is just a Slightly Useful page. UQV100.Qual.016 269 1 clueweb12-0007wb-12-04368 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-0007wb-12-04368 west-virginia.schooltree.org/Marshall-County-Schools.html You are thinking of taking a job in Marshall County, West Virginia, and you'd like to find out more about living there. In particular, you'd like to find any information on the schools there. 1 This page has some minimal information about a set of schools in Marshal Country, West Virginia, such as the grades and student population sizes. The links might help if the person was to click on them too, so overall this makes this page Slightly Useful. You would definitely need to visit other pages to satisfy the need. UQV100.Qual.017 208 2 clueweb12-1802wb-68-02041 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-1802wb-68-02041 www.tcm.com/tcmdb/person/510682|119317/Omar-Sharif/ One of your friends has been telling you for ages that you should read the book Doctor Zhivago. But you never seem to be able to finish books, and decide instead to find a brief synopsis of it so that at least you know what the main storyline is. 0 This page provides information on Omar Sharif, an actor, who appeared in a movie version of Doctor Zhivago. However, you need to find synopsis information about the book, so this is Not Useful. UQV100.Qual.018 225 1 clueweb12-0201wb-24-03404 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-0201wb-24-03404 www.lookintheattic.com/matte-black-knobs.html You want some black and gold shoes, but need to make sure that they will match your newly acquired sports top. Find a picture of an Air Jordan Black and Gold. 0 This is a shopping page for home hardware and fittings, it has nothing to do with shoes, and has no pictures of Air Jordans. Thus this is Not Useful. UQV100.Qual.019 226 1 clueweb12-0804wb-50-12260 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-0804wb-50-12260 realestate.mlive.com/michigan/grand-traverse-county/traverse-city/for-rent/land-lots You are passing through Traverse City for a work trip, and thought it might be a good place to take a day or two of leave. What attractions are there in the town? 0 This is a real estate page for Traverse City, but that does not give you any useful information about things to do there, so this is Not Useful. UQV100.Qual.020 243 3 clueweb12-0401wb-30-17363 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-0401wb-30-17363 www.armstrongflag.com/Afghanistan-Flags-252.aspx Last night on the news, you saw pictures of troops returning from Afghanistan. The national flag was shown flying over a building, and you saw some writing on it. You wonder what that writing means. 0 This page has pictures of the Afghanistan flag, but no information about the words and text on the flag itself. Thus this is Not Useful. UQV100.Qual.021 292 0 clueweb12-1309wb-76-29033 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-1309wb-76-29033 www.chartware.com/abrv.php Electronic medical records are now in widespread use, and make health treatments more consistent between providers. But it hasn't always been this way, and you become interested in knowing more about the evolution of electronic health records, and how they have changed through the years to reach their current state. 0 This page contains information about a specific medical records software system, but nothing about the evolution of electronic medical records or their history in general. Thus this is Not Useful. UQV100.Qual.022 201 4 clueweb12-1118wb-81-10505 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-1118wb-81-10505 teamrockymnt.pointstreaksites.com/calendar_events/calendar/237/7042/6/2011/1/view You have heard quite a lot about cheap computing as being the way of the future, including one recent model called a Raspberry Pi. You start thinking about buying one, and wonder how much they cost. -1 The page has no useful information, just some links possibly to calendar information. You would just go back to the search results, so this is Junk. UQV100.Qual.023 211 0 clueweb12-0200wb-97-06906 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-0200wb-97-06906 www.inn-hotel.com/hotels_france.php Many countries and regions are associated with specific products, animals, or locations. For example, Arizona is known for the Grand Canyon; China has pandas and the Great Wall; Australia is known for kangaroos and the Great Barrier Reef; and Switzerland for its mountains and fine watches. Prior to a holiday in the country of Madagascar, you wonder what it is best known for. -1 The page just contains many links for hotel bookings in different cities in France, without useful information about specific hotels or locations. Thus it is Junk. UQV100.Qual.024 214 0 clueweb12-1501wb-46-02282 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-1501wb-46-02282 dollardaze.org/feeds/history_rub_in_usd.txt Your aunt who lives in the USA has asked you for help in completing her tax return. Being a helpful person, you quickly agreed to find out what the US capital gains tax rate consists of, and how it's broken down. -1 The page appears to contain exchange rate information for a range of dates, but is almost impossible to read, and has no information about what rates these are. Thus this is Junk. UQV100.Qual.025 257 1 clueweb12-0103wb-21-23989 http://boston.lti.cs.cmu.edu/Services/clueweb12_render/renderpage.cgi?id=clueweb12-0103wb-21-23989 www.buildingrainbows.com/CA/lesson/lessonid/1069775339 You are trying to find some new books for your book-loving niece to read. While looking through a list of Newberry award winners, you see a book called Holes, written by Louis Sachar. Is there a summary of it you can read, as you don't want to give her one that has content inappropriate for her age? -1 The page is broken and contains no useful information, you would go straight back to the search results, and so this is Junk.