The point of looking at the cached headers is to see why the file was fetched more than once. The sort of things that might be seen are: Different 'Expires' headers for recent dates WWWOFFLE is re-fetching the page because the headers say that the page has expired. You can stop WWWOFFLE doing this by setting 'request-expired = no' in the OnlineOptions section of the wwwoffle.conf file. A 'Cache-Control: no-cache' or 'Pragma: no-cache' header WWWOFFLE is re-fetching the page because it contains a header that says that it is not to be cached. You can stop WWWOFFLE doing this by setting 'reqeust-no-cache = no' in the OnlineOptions section of the wwwoffle.conf file. A 'Cache-Control: max-age=...' header and a 'Date' header The specified age in seconds needs to be added to the date, this sets an expiry time for the page and is treated the same way as an 'Expires' header. Different 'ETag' headers WWWOFFLE is re-fetching the page because when it asks the server if the page has changed (a different Etag) the server says that it has (even though it may not have changed). Disabling this will become an option in the next version of WWWOFFLE. The scripts are in this directory with examples of their use below. $ ./find-duplicate-urls.sh ... 2 DikktDk-E6-RJzjBO0gLYTw http://images.slashdot.org/topics/topicgamesportable.gif ... $ ./find-duplicate-headers.sh DikktDk-E6-RJzjBO0gLYTw 2 Accept-Ranges: bytes 2 Cache-Control: max-age=604800 2 Connection: close 2 Content-Length: 1278 2 Content-Type: image/gif 1 Date: Fri, 27 Jun 2003 05:16:13 GMT 1 Date: Sat, 28 Jun 2003 05:22:10 GMT 1 ETag: "1b408f-4fe-b7d3a080" 1 ETag: "2de1c-4fe-b7d3a080" 1 Expires: Fri, 04 Jul 2003 05:16:13 GMT 1 Expires: Sat, 05 Jul 2003 05:22:10 GMT 2 HTTP/1.1 200 OK 2 Last-Modified: Fri, 27 Jun 2003 03:41:38 GMT 2 Server: Apache/2.0.46 (Unix) mod_ssl/2.0.46 OpenSSL/0.9.6c This has probably been refetched because of the Etag header.