Caching Personalized and Database-related Dynamic Web Pages

Chang, Yeim-Kuan; Lin, Yu‐Liang; Ting, Yi-Wei

doi:10.1109/iwnas.2006.20

Cited by 1 publication

(1 citation statement)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For instance, a dynamic website may include a half dozen cache mechanisms: at the database layer [11,25], data interface layer [11], scripting layer, virtual file system, and the network proxy layer [14]. Several cache systems for dynamic websites attempt to map underlying queries to cache objects for intelligent invalidation [13,20,25]. The web application as a whole may also include several programmatic caches to cache repeated function results, web objects, and templates [3].…”

Section: Related Workmentioning

confidence: 99%

Surviving a search engine overload

Koehl

Wang

2012

Proceedings of the 21st International Conference on World Wide Web

View full text Add to dashboard Cite

Search engines are an essential component of the web, but their web crawling agents can impose a significant burden on heavily loaded web servers. Unfortunately, blocking or deferring web crawler requests is not a viable solution due to economic consequences. We conduct a quantitative measurement study on the impact and cost of web crawling agents, seeking optimization points for this class of request. Based on our measurements, we present a practical caching approach for mitigating search engine overload, and implement the two-level cache scheme on a very busy web server. Our experimental results show that the proposed caching framework can effectively reduce the impact of search engine overload on service quality.

show abstract