Skip to main content
SpringerLink
Log in

Characterizing Web Document Change

  • Conference paper
  • First Online:
Advances in Web-Age Information Management (WAIM 2001)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2118))

Included in the following conference series:

Abstract

The World Wide Web is growing and changing at an astonishing rate. For the information in the web to be useful, web information systems such as search engines have to keep up with the growth and change of the web. In this paper we study how web documents change. In particular, we study two important characteristics of web document change that are directly related to keeping web information systems up-to-date: the degree of the change and the clusteredness of the change. We analyze the evolution of web documents with respect to these two measures and discuss the implications for web information systems update.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. B. Brewington and G. Cybenko. How dynamic is the web? In Proceedings of the Ninth International World Wide Web Conference, May 2000.

    Google Scholar 

  2. B. Brewington and G. Cybenko. Keeping up with the changing web. IEEE Computer, 33(5):52–58, May 2000.

    Google Scholar 

  3. J. Cho and H. Garcia-Molina. Estimating frequency of change. Submitted for publication, 2000.

    Google Scholar 

  4. J. Cho and H. Garcia-Molina. The evolution of the web and implications for an incremental crawler. 26th International Conference on Very Large Data Bases, September 2000.

    Google Scholar 

  5. F. Douglis, A. Feldmann, B. Krishnamurthy, and J. Mogul. Rate of change and other metrics: A live study of the world wide web. Proceedings of the USENIX Symposium on Internet and Systems, 1997.

    Google Scholar 

  6. S. Lawrence and C. L. Giles. Accessibility of information on the web. Nature, 400:107–109, 1999.

    Article  Google Scholar 

  7. A. Tomasic, H. Garcia-Molina, and K. Shoens. Incremental updates of inverted lists for text document retrieval. Proceedings of 1994 ACM International Conference of Management of Data (SIGMOD), pages 289–300, May 1994.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Dept. of Computer Science, Duke University, Durham, NC, 27708-0129

    Lipyeow Lim & Jeffrey Scott Vitter

  2. IBM T. J. Watson Research Ctr., Hawthorne, NY, 10532

    Min Wang, Sriram Padmanabhan & Ramesh Agarwal

Authors
  1. Lipyeow Lim
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Min Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sriram Padmanabhan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jeffrey Scott Vitter
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ramesh Agarwal
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Information and Software Engineering, George Mason University, Fairfax, VA, 22030-4444, USA

    X. Sean Wang

  2. Department of Computer Science and Engineering, Northeastern University, Shenyang, 110004, China

    Ge Yu

  3. Department of Computer Science, Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China

    Hongjun Lu

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Lim, L., Wang, M., Padmanabhan, S., Vitter, J.S., Agarwal, R. (2001). Characterizing Web Document Change. In: Wang, X.S., Yu, G., Lu, H. (eds) Advances in Web-Age Information Management. WAIM 2001. Lecture Notes in Computer Science, vol 2118. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-47714-4_13

Download citation

  • DOI: https://doi.org/10.1007/3-540-47714-4_13

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-42298-3

  • Online ISBN: 978-3-540-47714-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation