A comparison of implicit and explicit links for web page classification

Dou Shen, Jian-Tao Sun, Qiang Yang, and Zheng Chen

Abstract

It is well known that Web-page classification can be enhanced by using hyperlinks that provide linkages between Web pages. However, in the Web space, hyperlinks are usually sparse, noisy and thus in many situations can only provide limited help in classification. In this paper, we extend the concept of linkages from explicit hyperlinks to implicit links built between Web pages. By observing that people who search the Web with the same queries often click on different, but related documents together, we draw implicit links between Web pages that are clicked after the same queries. Those pages are implicitly linked. We provide an approach for automatically building the implicit links between Web pages using Web query logs, together with a thorough comparison between the uses of implicit and explicit links in Web page classification. Our experimental results on a large dataset confirm that the use of the implicit links is better than using explicit links in classification performance, with an increase of more than 10.5% in terms of the Macro-F1 measurement.

Details

Publication typeInproceedings
Published inWWW '06: Proceedings of the 15th international conference on World Wide Web
URLhttp://doi.acm.org/10.1145/1135777.1135871
Pages643–650
ISBN1-59593-323-9
AddressNew York, NY, USA
PublisherACM
> Publications > A comparison of implicit and explicit links for web page classification