Messages

1

Finished Programs / Re: DONE: Extracting All Image Links from a Booru Website

« on: August 06, 2017, 07:41 AM »

But unfortunately, Its sooooooo slow. It leeched 2MB in 2 minutes!

-rayman3003 (August 06, 2017, 04:36 AM)

This is going to be due to your location and ISP speed since I was able to grab 30+ megs of images in two minutes even with just that single-threaded code.  Here's a modification that simply creates a text file of image links.  As Ath mentioned, you can comment out line 17 for a tiny speedup but I don't think it's going to make a noticeable difference.

-skwire (August 06, 2017, 06:51 AM)

Thank u. This time it worked just as I wanted. Thank u. 
(And thanks to others that helped me in this topic  )

2

Finished Programs / Re: DONE: Extracting All Image Links from a Booru Website

« on: August 06, 2017, 04:36 AM »

Here's an AutoHotkey example showing how to download all the images from the example site you gave:

-skwire (August 05, 2017, 05:12 PM)

Thank u very much. It works like a charm.

But unfortunately, Its sooooooo slow. It leeched 2MB in 2 minutes!

But with "download managers", I could grab at least 15MB in 2 minutes!! "Download Managers" can download files simultaneously, so with them I can download with more speed; Thats why I prefer image links over leeching them by a none-downloader tool (like hotkey).

Speed is very important for me in this case (Like I said in the first post), Bcuz I want to leech more than 800,000 images among three different booru websites. 

But again, Thank u for your time. 

3

Finished Programs / Re: DONE: Extracting All Image Links from a Booru Website

« on: August 05, 2017, 10:24 AM »

Wouldn't it be easier to use a Download Manager within the browser?

eg. Firefox + DownThemAll  or  Chrome-based + GetThemAll

Both of these allow you to filter on filetype.

-4wd (August 05, 2017, 06:44 AM)

OK, thats also a download manager. 

I have "DownThemAll" in my firefox. Please show me how to grab all images by "DownThemAll" within all of these 161151 pages:

[Select]

http://mspabooru.com/index.php?page=post&s=view&id=161151
http://mspabooru.com/index.php?page=post&s=view&id=161150
http://mspabooru.com/index.php?page=post&s=view&id=161149
...
.
.
.
http://mspabooru.com/index.php?page=post&s=view&id=1

4

Finished Programs / Re: DONE: Extracting All Image Links from a Booru Website

« on: August 05, 2017, 12:23 AM »

Do you really need to keep a list of the links, or is it okay to "merely" get the pictures?

-Curt (August 04, 2017, 05:50 PM)

My goal is to get the pictures. But having the list of links, helps me to put them in download managers and leech them faster.  (So I prefer the links list)

5

Finished Programs / DONE: Extracting All Image Links from a Booru Website

« on: August 04, 2017, 01:59 PM »

I want to extract links of all images (png-jpg-jpeg-gif) in a booru website. (Booru(s) are some kind of image hosting websites).

Here is an example:

[Select]

http://mspabooru.com/

(contains 161151 images)



When clicking on posts, we could see images:

[Select]

http://mspabooru.com/index.php?page=post&s=list

Then, after clicking on any images, It goes to a page:

[Select]

http://mspabooru.com/index.php?page=post&s=view&id=166035

That contains the link (url) of that image in left side of the page, when we click on the "original image" placeholder:

[Select]

http://mspabooru.com//images/15/953debec5a4f550b37a7b0cabe5395a2.png

-------------

Now I 'm looking for a tool (an app or an online website) that helps me extract all these "Original image" links (urls) fast, And then I import the list of those urls in a download manager to leech them all.

I give that tool, these links:

[Select]

http://mspabooru.com/index.php?page=post&s=view&id=161151
http://mspabooru.com/index.php?page=post&s=view&id=161150
http://mspabooru.com/index.php?page=post&s=view&id=161149
...
.
.
.
http://mspabooru.com/index.php?page=post&s=view&id=1

Then it gives me the links of images in each page:

[Select]

http://mspabooru.com//images/15/aa2652c67b307eefb48ca3672fe09517.jpeg
http://mspabooru.com//images/15/fae66c978b7e52ada0e5332b5dbe2abd.png
http://mspabooru.com//images/15/38d72ad818e1471c5955db17ce2e89c4.jpeg
...
.
.
http://mspabooru.com//images/15/38d72ad818e14645955db17ce2e89c4.jpeg

So please give me any suggestion.
(or maybe a coder here could help me (I think its not hard to code a tiny app that doing this).

Thank u