DonationCoder.com forum
 
Read-only archive. This is a static copy of the DonationCoder.com forum. Reading and searching work as before; logging in, posting and private messages do not.
Archive of 2026-10-21 · About this archive · Main site

Author Topic: Automated site capture  (Read 5,873 times)

rgdot

  • Supporting Member
  • Joined in 2009
  • **
  • Posts: 2,197
Automated site capture
« on: October 29, 2011, 03:28 PM »
Is there a program that can, via an internal browser or perhaps other method, automatically load a site and take a screenshot of it? For example I want to take a screenshot of example.com every day at 3PM.
I am thinking if such a program doesn't exist may be an existing website capture program can be set to do it with an external task scheduler?

Any ideas? :)

Ath

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 3,649
    • Participated in NANY Challenge Eleven Times
    • Coding Snacks
    • Linux User
    • Hardware Hacker
Re: Automated site capture
« Reply #1 on: October 29, 2011, 03:30 PM »
/Ton
Ath's software collection, Quote: "A problem well stated is a problem half-solved." (Charles Kettering)

Ath

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 3,649
    • Participated in NANY Challenge Eleven Times
    • Coding Snacks
    • Linux User
    • Hardware Hacker
Re: Automated site capture
« Reply #2 on: October 29, 2011, 03:32 PM »
And a free one: http://www.sadmansoftware.com/snapshot/screenshot.htm
Disqualified, not from webpages, sorry.
/Ton
Ath's software collection, Quote: "A problem well stated is a problem half-solved." (Charles Kettering)

rgdot

  • Supporting Member
  • Joined in 2009
  • **
  • Posts: 2,197
Re: Automated site capture
« Reply #3 on: October 29, 2011, 03:38 PM »
I really did google it, don't ask how I didn't find that  :-[
Thanks, although freeware would be better seems exactly what I need, this might be the shortest thread ever on DC  ;D

IainB

  • @Slartibartfarst
  • Supporting Member
  • Joined in 2008
  • **
  • Posts: 7,544
Re: Automated site capture
« Reply #4 on: October 30, 2011, 03:05 PM »
...this might be the shortest thread ever on DC
Don't speak too soon. A lot of websites nowadays seem to have coded-in detection of crawlers and downloaders that behave badly - e.g., start firing off hundred of queries a second, which overloads the server. To protect the server, if a norty crawler  is detected, then that crawler/downloader is blocked.
This has the potential effect of making some site-scraping software obsolete.

rgdot

  • Supporting Member
  • Joined in 2009
  • **
  • Posts: 2,197
Re: Automated site capture
« Reply #5 on: October 30, 2011, 04:48 PM »
Good point, these tools have the potential to abuse. As for me I will be doing one site - one page - once a day.

IainB

  • @Slartibartfarst
  • Supporting Member
  • Joined in 2008
  • **
  • Posts: 7,544
Re: Automated site capture
« Reply #6 on: November 02, 2011, 01:01 PM »
Good point, these tools have the potential to abuse. As for me I will be doing one site - one page - once a day.
Sorry, I did not register this till just now.
If you have not already tried it, then I would recommend you take a look at: ScrapBook
It's very handy indeed. I use it all the time.

Original address: https://www.donationcoder.com/forum/index.php?topic=28510.0