PDA

View Full Version : how to download multiple .jpg files from a website directory?



buffylover
Jul 11th, 2012, 09:19 PM
I want to download all files from a server which has many many subdirectories in which .jpg pictures are. When I use any of programs (tried flashgot, downthemall and getlefttogo) it doesn’t download these files. With getlefttogo for example it only downloads some random .gif files within the folders but those aren’t the actualy files listed, those are just some layout files or something.

How can I download all images from that server without having to manually add every subdirectory?

and no its not porn

JAC
Jul 11th, 2012, 10:13 PM
https://www.google.ca/#hl=en&safe=off&output=search&sclient=psy-ab&q=how+do+i+download+an+entire+website+free

BobSagget
Jul 11th, 2012, 10:18 PM
Use wget

Download from here:
http://users.ugent.be/~bpuype/cgi-bin/fetch.pl?dl=wget/wget-1.10.2.exe
Drag and drop the .exe into your windows/system32 folder and rename to wget.exe

Now click start and type in "cmd" to open the command prompt
Now you can type/paste your wget command to download all jpeg files located in the directory and subdirectories on the website.

Here is the command:


wget -x -r -np -N -A .jpg,.jpeg -R index,htm,html,css -e robots=off "http://websitegoeshere.com"

-A .jpg,.jpeg - this is telling wget to accept(download) all .jpg and .jpeg files
-R index,htm,html,css - this is telling wget to reject any index, htm, htm; or css files
You can add or remove any file type to the command (.gif, .pdf, .bmp or whatever you want)
"http://websitegoeshere.com" - replace this with the URL of the directory you want to download the files from

I am no expert on wget and there's more commands you can use but this should be good enough to download all the jpg files in the parent and subdirectories.

If you did it right all the jpg files will be saved in C:\Users\<your username>\websitegoeshere.com\folder\subfolder\*.jpg etc

The command above is ready to go to download just .jpg and .jpeg files, so just replace the http:// part and copy/paste into the command prompt.

Learn about wget and all the commands here:
http://man.cx/wget

xalex0
Jul 12th, 2012, 12:23 AM
Is it an FTP site?

wilsonlam97
Jul 12th, 2012, 03:27 AM
Is it an FTP site?

OP could try FTPing it as guest. Idk if that would work.

buffylover
Jul 12th, 2012, 02:26 PM
Use wget

Download from here:
http://users.ugent.be/~bpuype/cgi-bin/fetch.pl?dl=wget/wget-1.10.2.exe
Install in your windows/system32 folder

Now click start and type in "cmd" to open the command prompt
Now you can type/paste your wget command to download all jpeg files located in the directory and subdirectories on the website.

Here is the command:


wget -x -r -np -N -A .jpg,.jpeg -R index,htm,html,css -e robots=off "http://websitegoeshere.com"

-A .jpg,.jpeg - this is telling wget to accept(download) all .jpg and .jpeg files
-R index,htm,html,css - this is telling wget to reject any index, htm, htm; or css files
You can add or remove any file type to the command (.gif, .pdf, .bmp or whatever you want)
"http://websitegoeshere.com" - replace this with the URL of the directory you want to download the files from

I am no expert on wget and there's more commands you can use but this should be good enough to download all the jpg files in the parent and subdirectories.

If you did it right all the jpg files will be saved in C:\Users\<your username>\websitegoeshere.com\folder\subfolder\*.jpg etc

The command above is ready to go to download just .jpg and .jpeg files, so just replace the http:// part and copy/paste into the command prompt.

Learn about wget and all the commands here:
http://man.cx/wget

awesome! im going to try this when I get home. I googled it like crazy last night and kept seeing wget, NOWHERE would break down a explanation like that for me. I used some firefox addon and its doing the job, but wont go into subdirectories so I have to do it 1 folder at a time. Thanks so much for this, I'll try it asap.

one question, when you say

Download from here:
http://users.ugent.be/~bpuype/cgi-bi...get-1.10.2.exe
Install in your windows/system32 folder

when I download the .exe file, do I just drop it in the system32 folder or do I have to do something else?

BobSagget
Jul 12th, 2012, 05:32 PM
Oops sorry.
Ya download that exe file, drop it into your system32 folder and rename it to "wget.exe". That's it.

buffylover
Jul 12th, 2012, 07:30 PM
Thanks it's working as I write this!

BobSagget
Jul 12th, 2012, 08:05 PM
Good to hear. It comes in really handy for downloading all files of a certain type from directories. I mostly use it to download .epub/.mobi ebooks from random directories I come across.

evergreen2
Jul 13th, 2012, 05:59 AM
Nice thread