topbanner_forum
  *

avatar image

Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
  • Friday March 29, 2024, 12:16 am
  • Proudly celebrating 15+ years online.
  • Donate now to become a lifetime supporting member of the site and get a non-expiring license key for all of our programs.
  • donate

Author Topic: Download files from a website by type  (Read 2405 times)

Contro

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 3,940
    • View Profile
    • Donate to Member
Download files from a website by type
« on: December 05, 2021, 10:49 AM »
Some times, like now, I need to locate and download files from a website.

In the present case I am searching for free libraries of 3D files.

So I need a downloader able to filter any type of file. By example : dwg files

Best Regards

A download configurable program to download files by type from a single website.

 :-* :P

publicdomain

  • Honorary Member
  • Joined in 2019
  • **
  • Posts: 732
  • Call me Vic!
    • View Profile
    • Donate to Member
Re: Download files from a website by type
« Reply #1 on: December 06, 2021, 12:41 PM »
Hello & good day dear Contro! You can achieve this via HTTrack Website Copier:

https://www.httrack.com

If you provide both the website URL & file type, I can help you craft the exact command :)

Cheers!
My name's Victor but do feel free to call me Vic!

Support with your DonationCredits!
❤️ Support on Patreon @ www.patreon.com/publicdomain
🎁 One-time Paypal @ www.paypal.com/paypalme/victorvls
Email/Paypal: publicdomainvicgmail.com
« Last Edit: December 06, 2021, 12:56 PM by publicdomain »

Contro

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 3,940
    • View Profile
    • Donate to Member
Re: Download files from a website by type
« Reply #2 on: December 06, 2021, 01:50 PM »
Hello & good day dear Contro! You can achieve this via HTTrack Website Copier:

https://www.httrack.com

If you provide both the website URL & file type, I can help you craft the exact command :)

Cheers!
Sure ? I was throwing the towel at these moment !!!!!!!!!!

the url :

https://3dwarehouse....?domain=Architecture

The file extension .skp

event better if I could filter for "steel structure".

Best Regards
 :-* :P

publicdomain

  • Honorary Member
  • Joined in 2019
  • **
  • Posts: 732
  • Call me Vic!
    • View Profile
    • Donate to Member
Re: Download files from a website by type
« Reply #3 on: December 07, 2021, 02:33 PM »
the url :

https://3dwarehouse....?domain=Architecture

The file extension .skp

Hello dear Contro, I've checked the search results' source code from 3dwarehouse... it may need a browser-simulation download bot as opposed to simpler site backup as httrack does, given the links are Javascript-based (not plain HTML as usual).

The bright side being the upcoming N.A.N.Y. 2022 pdGet for nkhormanik has such a module in preparation :up:

As the first version comes up, I am personally creating the specifications for downloading "*.skp" files from 3dwarehouse search results. This batch-fetching is absolutely doable with the right programming.

Okie, I am taking the opportunity to finish your other pending requests in the interim :)

Cheers!
My name's Victor but do feel free to call me Vic!

Support with your DonationCredits!
❤️ Support on Patreon @ www.patreon.com/publicdomain
🎁 One-time Paypal @ www.paypal.com/paypalme/victorvls
Email/Paypal: publicdomainvicgmail.com
« Last Edit: December 07, 2021, 04:15 PM by publicdomain »

Contro

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 3,940
    • View Profile
    • Donate to Member
Re: Download files from a website by type
« Reply #4 on: December 07, 2021, 03:02 PM »
I will try also Chrome Multi-File Downloader
it requires sign up or login in the trimble account.
Then appear the download options.

The real problem I think is if the webmaster authorize or not the download.
Specially from special types of files.

The usual may be pdf, html, image or video as httrack does, but is not so easy download any type of files.

May be this target is in relation to download files from a ftp. Or even the possibility to download files from open online databases ...
 :-* :P

Contro

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 3,940
    • View Profile
    • Donate to Member
Re: Download files from a website by type
« Reply #5 on: December 07, 2021, 03:06 PM »
I think is an impossible task if the webmaster forbid or limit the massive download.
There are a lot of dwg libraries, and not all completely free.  So I Understand i can try to download the free ones.
I have signed up in trimble with no reading the small letters ( a very bigger text...) . I am supposing that you may be banned.
 :-[

Contro

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 3,940
    • View Profile
    • Donate to Member
Re: Download files from a website by type
« Reply #6 on: December 07, 2021, 03:13 PM »
In the chapter of download emails or many other grabbing or ripping tasks may be limits.
The best software automate the task considering limits.
 :-\

I am not sure about all this. I recenty use EmailGrabber2.exe - Acceso directo with good results.
I remember my first attempts with limits until the last two programs I tried.
The other one was email extractor 7 in free mode. You can't save the project to txt or any other easy format with this one.
I bought email grabber and was enough for me.

KimberlyMunoz

  • Participant
  • Joined in 2021
  • *
  • default avatar
  • Posts: 1
    • View Profile
    • Donate to Member
Re: Download files from a website by type
« Reply #7 on: December 16, 2021, 04:52 AM »
In the chapter of download emails or many other grabbing or ripping tasks may be limits.
The best software automate the task considering limits.
 :-\

I am not sure about all this. I recenty use EmailGrabber2.exe - Acceso directo with good results.
I remember my first attempts with limits until the last two programs I tried.
The other one was email extractor 7 in free mode. You can't save the project to txt or any other easy format with this one.
I bought email grabber and was enough for me.

Thanks for sharing. It looks very informative as usual. LOL!