On 04/10/2016 07:22 PM, fred roller wrote:
On Sun, Apr 10, 2016 at 8:16 PM, bruce <badouglas(a)gmail.com
<mailto:badouglas@gmail.com>> wrote:
Hi.
I know.. off topic questions are usually frowned upon!
I was curious as to why the following wget returns a
403/forbidden. The base url is accessed via the ff/chrome
browser.. As far as I can tell/see, the cmd should match what the
network is seeing regarding the headers/traffic.
Any thoughts.. thanks
wget -vvv --user-agent="Mozilla/5.0 (X11; Linux x86_64; rv:38.0)
Gecko/20100101 Firefox/38.0" --cookies=on
--load-cookies=aa.lwp --keep-session-cookies
--save-cookies=aa.lwp --referer
http://coursebook.utdallas.edu
http://coursebook.utdallas.edu
I tested it.
They do not block robots.