On Fri, 11 Sep 2009 21:02:10 +0100, Robin wrote:
I am having trouble downloading the raw monthly archives of
fedora-test-list. For example:
[greenrd@fedora shm]$ wget --no-cache
'https://www.redhat.com/archives/fedora-test-list/2009-August.txt.gz'
--2009-09-11 20:58:30--
https://www.redhat.com/archives/fedora-test-list/2009-August.txt.gz
Resolving
www.redhat.com... 88.221.160.112
Connecting to
www.redhat.com|88.221.160.112|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [application/x-gzip]
Saving to: `2009-August.txt.gz'
[ <=>
] 43,213 --.-K/s in 0.04s
2009-09-11 20:58:31 (946 KB/s) - `2009-August.txt.gz' saved [43213]
The resultant file only contains 1 email (uncompressed).
Looks like a server error. Try multiple times with option -c, although
that will corrupt the downloaded file (but demonstrate that a larger
file is offered). It's reproducible here.
Also with "curl -C - -O ...", which shows behaviour like wget -c ...:
$ curl -C - -O
https://www.redhat.com/archives/fedora-test-list/2009-August.txt.gz
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 43213 0 43213 0 0 33946 0 --:--:-- 0:00:01 --:--:-- 46565
curl: (18) transfer closed with outstanding read data remaining
$ curl -C - -O
https://www.redhat.com/archives/fedora-test-list/2009-August.txt.gz
** Resuming transfer from byte position 43213
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 2267k 100 2267k 0 0 490k 0 0:00:04 0:00:04 --:--:-- 525k
$ gunzip 2009-August.txt.gz
gzip: 2009-August.txt.gz: not in gzip format
$ file 2009-August.txt.gz
2009-August.txt.gz: data
The first 43K is an uncompressed rawhide report (that alone is a server error
already). The second download attempt appends the compressed archive for August.