Comments on: Wget Trick to Download from Restrictive Sites http://www.askapache.com/dreamhost/wget-header-trick.html Advanced Web Development Wed, 18 Nov 2009 23:28:48 -0500 hourly 1 By: AskApache http://www.askapache.com/dreamhost/wget-header-trick.html#comment-104258 AskApache Tue, 22 Sep 2009 03:11:17 +0000 http://www.askapache.com/tools/wget-header-trick.html#comment-104258 <strong>@ lien</strong> <p>Nice idea there, haven't tried that yet, but I plan on it..</p> @ lien

Nice idea there, haven’t tried that yet, but I plan on it..

]]> By: lien http://www.askapache.com/dreamhost/wget-header-trick.html#comment-100625 lien Sat, 05 Sep 2009 18:03:15 +0000 http://www.askapache.com/tools/wget-header-trick.html#comment-100625 This can also be used to see if competitors web sites are feeding google spider food. <strong>Just set your user agent to googlebot</strong>. This can also be used to see if competitors web sites are feeding google spider food. Just set your user agent to googlebot.

]]> By: Deserio http://www.askapache.com/dreamhost/wget-header-trick.html#comment-72587 Deserio Fri, 01 May 2009 23:41:14 +0000 http://www.askapache.com/tools/wget-header-trick.html#comment-72587 I was looking for "user agent", works great for me, specially with rapidshare. I was looking for “user agent”, works great for me, specially with rapidshare.

]]> By: Torrid Luna http://www.askapache.com/dreamhost/wget-header-trick.html#comment-67098 Torrid Luna Thu, 26 Feb 2009 02:07:03 +0000 http://www.askapache.com/tools/wget-header-trick.html#comment-67098 There's an uncommented feature "<code>robots=off</code>", if all else fails, you could add that to your list. Cheers, Torrid There’s an uncommented feature “robots=off“, if all else fails, you could add that to your list.

Cheers,
Torrid

]]> By: elkdbrlg http://www.askapache.com/dreamhost/wget-header-trick.html#comment-29969 elkdbrlg Fri, 30 Nov 2007 12:33:32 +0000 http://www.askapache.com/tools/wget-header-trick.html#comment-29969 how could you download a page what has 404 return code? how could you download a page what has 404 return code?

]]>