Download files from a website by type

[Contro]

Some times, like now, I need to locate and download files from a website.

In the present case I am searching for free libraries of 3D files.

So I need a downloader able to filter any type of file. By example : dwg files

Best Regards

A download configurable program to download files by type from a single website.

 

[publicdomain]

Hello & good day dear Contro! You can achieve this via HTTrack Website Copier:

https://www.httrack.com

If you provide both the website URL & file type, I can help you craft the exact command

Cheers!

[Contro]

Hello & good day dear Contro! You can achieve this via HTTrack Website Copier:

https://www.httrack.com

If you provide both the website URL & file type, I can help you craft the exact command

Cheers!

-publicdomain (December 06, 2021, 12:41 PM)

Sure ? I was throwing the towel at these moment !!!!!!!!!!

the url :

https://3dwarehouse....?domain=Architecture

The file extension .skp

event better if I could filter for "steel structure".

Best Regards
 

[publicdomain]

the url :

https://3dwarehouse....?domain=Architecture

The file extension .skp

-Contro (December 06, 2021, 01:50 PM)

Hello dear Contro, I've checked the search results' source code from 3dwarehouse... it may need a browser-simulation download bot as opposed to simpler site backup as httrack does, given the links are Javascript-based (not plain HTML as usual).

The bright side being the upcoming N.A.N.Y. 2022 pdGet for nkhormanik has such a module in preparation

As the first version comes up, I am personally creating the specifications for downloading "*.skp" files from 3dwarehouse search results. This batch-fetching is absolutely doable with the right programming.

Okie, I am taking the opportunity to finish your other pending requests in the interim

Cheers!

[Contro]

I will try also Chrome Multi-File Downloader
it requires sign up or login in the trimble account.
Then appear the download options.

The real problem I think is if the webmaster authorize or not the download.
Specially from special types of files.

The usual may be pdf, html, image or video as httrack does, but is not so easy download any type of files.

May be this target is in relation to download files from a ftp. Or even the possibility to download files from open online databases ...
 

[Contro]

I think is an impossible task if the webmaster forbid or limit the massive download.
There are a lot of dwg libraries, and not all completely free.  So I Understand i can try to download the free ones.
I have signed up in trimble with no reading the small letters ( a very bigger text...) . I am supposing that you may be banned.
 

[Contro]

In the chapter of download emails or many other grabbing or ripping tasks may be limits.
The best software automate the task considering limits.
 

I am not sure about all this. I recenty use EmailGrabber2.exe - Acceso directo with good results.
I remember my first attempts with limits until the last two programs I tried.
The other one was email extractor 7 in free mode. You can't save the project to txt or any other easy format with this one.
I bought email grabber and was enough for me.

[KimberlyMunoz]

In the chapter of download emails or many other grabbing or ripping tasks may be limits.
The best software automate the task considering limits.
 

I am not sure about all this. I recenty use EmailGrabber2.exe - Acceso directo with good results.
I remember my first attempts with limits until the last two programs I tried.
The other one was email extractor 7 in free mode. You can't save the project to txt or any other easy format with this one.
I bought email grabber and was enough for me.

-Contro (December 07, 2021, 03:13 PM)

Thanks for sharing. It looks very informative as usual. LOL!