topbanner_forum
  *

avatar image

Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
  • Thursday March 28, 2024, 3:49 am
  • Proudly celebrating 15+ years online.
  • Donate now to become a lifetime supporting member of the site and get a non-expiring license key for all of our programs.
  • donate

Author Topic: program which lists new google page hits  (Read 13178 times)

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
program which lists new google page hits
« on: September 21, 2005, 07:05 PM »
anyone know of a program that can tell you about *new* google pages? or sort by date added?

let me explain:
let's say i want to find new pages on the web that mention DonationCoder.com
i can search google and get a list of 500 pages or whatever, but i have no way of coming back next week and saying "show me all the new pages which have been found since the last search"

if such a tool doesn't exist it sure seems like something that would be useful and not too hard to write.

« Last Edit: September 21, 2005, 07:08 PM by mouser »

Veign

  • Charter Honorary Member
  • Joined in 2005
  • ***
  • Posts: 993
    • View Profile
    • Veign - Where design meets development
    • Donate to Member
Re: program which lists new google page hits
« Reply #1 on: September 21, 2005, 08:52 PM »
That would be a very cool tool!.

Have you done anything with the Google API?

clif_notes

  • Charter Honorary Member
  • Joined in 2005
  • ***
  • Posts: 199
  • Clif Notes Newsletter
    • View Profile
    • Clif Notes Newsletter
    • Donate to Member
Re: program which lists new google page hits
« Reply #2 on: September 21, 2005, 09:46 PM »
anyone know of a program that can tell you about *new* google pages? or sort by date added?

let me explain:
let's say i want to find new pages on the web that mention DonationCoder.com
i can search google and get a list of 500 pages or whatever, but i have no way of coming back next week and saying "show me all the new pages which have been found since the last search"

if such a tool doesn't exist it sure seems like something that would be useful and not too hard to write.



Hi Mouser,

No need to write any code. Try Google Alerts. I've used it a few times. It does pretty much what you are asking for. http://www.google.com/alerts

Devoted to promoting freeware and free information

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Re: program which lists new google page hits
« Reply #3 on: September 21, 2005, 09:52 PM »
cool - i'll give it a try.
i tend to prefer local solutions, so i might still write an application to do this (what do you think of the name "Newgle") but i'll give google alerts a try.

Veign

  • Charter Honorary Member
  • Joined in 2005
  • ***
  • Posts: 993
    • View Profile
    • Veign - Where design meets development
    • Donate to Member
Re: program which lists new google page hits
« Reply #4 on: September 21, 2005, 10:17 PM »
Gonna give that a try and see....

sword

  • Charter Member
  • Joined in 2005
  • ***
  • Posts: 200
    • View Profile
    • Donate to Member
Re: program which lists new google page hits
« Reply #5 on: October 14, 2005, 02:17 PM »


Google advanced search, accessed:10/14/05 11:36 AM

Results 1 - 14 of about 24 for allintext: DonationCoder.com 1004...1014. 
Results 1 - 50 of about 287 for allintext: DonationCoder.com 904...1014.   

Find results  with all of the words   50 results 
Occurrences Return results where my terms occur in the text of the page

The first listing in the first search was created 10/14/05. “1014=10/14”?

Cheers, Robert

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Re: program which lists new google page hits
« Reply #6 on: October 14, 2005, 02:58 PM »
hi robert,
i'm not sure exactly what your post is telling us.. can you explain more?

ps.
i've thought a lot about this project and i want to do it; ive worked out some details but i can't begin coding it because i have other programs on the site that need attention first (Clipboard Help+Spell for one!)

but i'd like to work with someone else on this - helping out.
after some real thought i think it needs to be written mostly in a scripting language like Python (ruby, perl, php, dylan, etc. would be other possibilities, but i'd prefer python).

if there is a programmer (amateur is ok) who wants to embark on a project, and either knows or wants to learn python, and would like some guidance, and has some real dedication, please contact me about teaming up on this. i think we could make something fun.

sword

  • Charter Member
  • Joined in 2005
  • ***
  • Posts: 200
    • View Profile
    • Donate to Member
Re: program which lists new google page hits
« Reply #7 on: October 15, 2005, 05:30 PM »

Subject: revised Google search for mouser trying to solve problem, “let's say i want to find new pages on the web that mention DonationCoder.com
i can search google and get a list of 500 pages or whatever, but i have no way of coming back next week and saying ‘show me all the new pages which have been found since the last search’ “.

sword: My previous posting used a variation of a search used successfully to find a range of dates such as 1750…1759. When I got a match for “1014” to “10/14” in a file that mentioned “Oct 14” I thought my old search worked with months too.

Here is a revised search that seems to be a slight improvement over bring back 500 results in the last three months:

with all of the words: DonationCoder.com
with the exact phrase: Oct* 7
[Oct* 7 changed to Oct* 8 for next search]
Date: past 3 months
Occurrence: in the text of the page
Domain: Don't return results from the site or domain: donationcoder.com

Search results:
1. Oct* 7: 1-5 of about 8
2. Oct* 8: 1
3. Oct* 9: 1 of about 7
4.1 Oct* 10: 1-11 of about 35
4.2 Oct* 10: 1-13 of about 35 [repeat search with omitted results included]
5. Oct* 11: all
6. Oct* 12: 1-10 of about 31 all
7. Oct* 13: 1-7 of about 30 all
8. Oct* 14: 1-6 of about 16 all


Search details:
1.
frieddoh.stumbleupon.com/
www.artima.com/groups/group.jsp?group=dotnet
www.artima.com/forums/flat. jsp?forum=278&thread=107078
www.bacanalnica.com/foros/ viewtopic.php?t=30315&start=0
nighted.stumbleupon.com/

2.
www.bacanalnica.com/foros/ viewtopic.php?t=30315&start=0

3.
www.msoftware.co.nz/modules.php?op=modload& name=phpbb2&file=viewtopic.php&p=872

4.1
www.msoftware.co.nz/modules.php?op=modload& name=phpbb2&file=viewtopic.php&p=872
www.dslreports.com/forum/remark,14434066
www.dslreports.com/forum/remark,14335473~start=80
slowass.net/phaedrus/
www.kbcafe.com/tags.aspx/utils
www.download.com/WinZip-Beta/3640-2250_4-10433036.html
nighted.stumbleupon.com/
whirlpool.net.au/forum-replies-archive.cfm/409954.html
www.abstrakone.com/bookmarks/
www.broadbandreports.com/forum/remark,14335473
forums.whirlpool.net.au/ forum-replies-archive.cfm/409954.html


4.2 repeat search with omitted results included:
as in 4.1 plus:
www.msoftware.co.nz/modules.php?op=modload& name=phpbb2&file=viewtopic.php&p=873
www.dslreports.com/forum/remark,14401655~start=40
www.dslreports.com/forum/remark,14401655~start=0

5.
www.msoftware.co.nz/modules.php?op=modload& name=phpbb2&file=viewtopic.php&p=872
www.msoftware.co.nz/modules.php?op=modload& name=phpbb2&file=viewtopic.php&t=188
www.proxyblind.org/freeware.shtml
www.dslreports.com/forum/remark,14421632
www.dslreports.com/forum/ remark,14402348~days=9999~start=40
www.dslreports.com/forum/remark,14401655~start=20
www.dslreports.com/forum/remark,14380117
it.mylounge.com/lastpostinthread106072.html
www.pcreview.co.uk/forums/thread-2177739.php
www.gmailforums.com/index.php?showtopic=12842
www.gmailforums.com/lofiversion/index.php/t12842.html
www.bacanalnica.com/foros/ viewtopic.php?t=30315&start=0
www.betanews.com/article/print/ Google_to_Students_Try_Open_Source/1117638650
nighted.stumbleupon.com/

6.
www.msoftware.co.nz/modules.php?op=modload& name=phpbb2&file=viewtopic.php&p=872
www.msoftware.co.nz/modules.php?op=modload& name=phpbb2&file=viewtopic.php&p=873
www.download.com/WinZip-Beta/3640-2250_4-10433036.html
www.download.com/WinZip-Beta/ 3640-2250_4-10433036.html?sb=3&v=0
www.bacanalnica.com/foros/ viewtopic.php?t=30315&start=0
www.dslreports.com/forum/remark,14416704
www.betanews.com/article/Google_ to_Students_Try_Open_Source/1117638650
www.broadbandreports.com/forum/remark,14330194~start=40
www.broadbandreports.com/forum/remark,14330194~start=20

7.
www.dslreports.com/forum/ remark,14401655~days=9999~start=60
www.dslreports.com/forum/remark,14300829?hilite=opera
www.kbcafe.com/tags.aspx/utils
www.pcreview.co.uk/forums/thread-2177739.php
www.broadbandreports.com/forum/ remark,13893795~reverse=0;days=30;root=features;mode=full
www.broadbandreports.com/forum/remark,13893795~start=60
www.neowin.net/forum/lofiversion/index.php/t320017.html - 83k

8.
www.pcreview.co.uk/forums/thread-2177739.php
www.broadbandreports.com/shownews/64694
www.kbcafe.com/tags.aspx/process
www.kbcafe.com/tags.aspx/utils
www.dslreports.com/forum/remark,14335473~start=20
www.dslreports.com/forum/ remark,14401655~days=9999~start=40
www.dslreports.com/forum/ remark,13666232?hilite=copernic

sword: I saved details of each of these URLs in my file, 5x15D1, in case you might like to check them with what you might have. I will do a similar search for any time period you have previously searched so that you can compare the quality of this suggested search. I hope this helps.

Cheers, Robert


mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Re: program which lists new google page hits
« Reply #8 on: October 15, 2005, 05:40 PM »
ah i understand now - thanks robert that's actually a different kind of method for searching for when something was mentioned; a good idea and something to think about possibly automating.

clif_notes

  • Charter Honorary Member
  • Joined in 2005
  • ***
  • Posts: 199
  • Clif Notes Newsletter
    • View Profile
    • Clif Notes Newsletter
    • Donate to Member
Re: program which lists new google page hits
« Reply #9 on: October 18, 2005, 10:28 PM »
I use a personal "start" page in all my browsers that I made myself. One of the prominent links is the the Google Advanced seach. http://www.google.co...dvanced_search?hl=en

Great job using it there Sword.

Devoted to promoting freeware and free information

brotherS

  • Master of Good Ideas
  • Honorary Member
  • Joined in 2005
  • **
  • Posts: 2,260
    • View Profile
    • Donate to Member
Re: program which lists new google page hits
« Reply #10 on: November 20, 2005, 12:25 PM »
I use a personal "start" page in all my browsers that I made myself. One of the prominent links is the the Google Advanced seach. http://www.google.co...dvanced_search?hl=en
Nice idea, I thought about such a personal page too, but wasn't able to do that then... Now I just use AutoHotkey to easily access my most needed stuff :)