program which lists new google page hits

[mouser]

anyone know of a program that can tell you about *new* google pages? or sort by date added?

let me explain:
let's say i want to find new pages on the web that mention DonationCoder.com
i can search google and get a list of 500 pages or whatever, but i have no way of coming back next week and saying "show me all the new pages which have been found since the last search"

if such a tool doesn't exist it sure seems like something that would be useful and not too hard to write.

[Veign]

That would be a very cool tool!.

Have you done anything with the Google API?

[clif_notes]

anyone know of a program that can tell you about *new* google pages? or sort by date added?

let me explain:
let's say i want to find new pages on the web that mention DonationCoder.com
i can search google and get a list of 500 pages or whatever, but i have no way of coming back next week and saying "show me all the new pages which have been found since the last search"

if such a tool doesn't exist it sure seems like something that would be useful and not too hard to write.

-mouser (September 21, 2005, 07:05 PM)

Hi Mouser,

No need to write any code. Try Google Alerts. I've used it a few times. It does pretty much what you are asking for. http://www.google.com/alerts

[mouser]

cool - i'll give it a try.
i tend to prefer local solutions, so i might still write an application to do this (what do you think of the name "Newgle") but i'll give google alerts a try.

[Veign]

Gonna give that a try and see....

[sword]

Google advanced search, accessed:10/14/05 11:36 AM

Results 1 - 14 of about 24 for allintext: DonationCoder.com 1004...1014. 
Results 1 - 50 of about 287 for allintext: DonationCoder.com 904...1014.   

Find results  with all of the words   50 results 
Occurrences Return results where my terms occur in the text of the page

The first listing in the first search was created 10/14/05. “1014=10/14”?

Cheers, Robert

[mouser]

hi robert,
i'm not sure exactly what your post is telling us.. can you explain more?

ps.
i've thought a lot about this project and i want to do it; ive worked out some details but i can't begin coding it because i have other programs on the site that need attention first (Clipboard Help+Spell for one!)

but i'd like to work with someone else on this - helping out.
after some real thought i think it needs to be written mostly in a scripting language like Python (ruby, perl, php, dylan, etc. would be other possibilities, but i'd prefer python).

if there is a programmer (amateur is ok) who wants to embark on a project, and either knows or wants to learn python, and would like some guidance, and has some real dedication, please contact me about teaming up on this. i think we could make something fun.

[sword]

Subject: revised Google search for mouser trying to solve problem, “let's say i want to find new pages on the web that mention DonationCoder.com
i can search google and get a list of 500 pages or whatever, but i have no way of coming back next week and saying ‘show me all the new pages which have been found since the last search’ “.

sword: My previous posting used a variation of a search used successfully to find a range of dates such as 1750…1759. When I got a match for “1014” to “10/14” in a file that mentioned “Oct 14” I thought my old search worked with months too.

Here is a revised search that seems to be a slight improvement over bring back 500 results in the last three months:

with all of the words: DonationCoder.com
with the exact phrase: Oct* 7
[Oct* 7 changed to Oct* 8 for next search]
Date: past 3 months
Occurrence: in the text of the page
Domain: Don't return results from the site or domain: donationcoder.com

Search results:
1. Oct* 7: 1-5 of about 8
2. Oct* 8: 1
3. Oct* 9: 1 of about 7
4.1 Oct* 10: 1-11 of about 35
4.2 Oct* 10: 1-13 of about 35 [repeat search with omitted results included]
5. Oct* 11: all
6. Oct* 12: 1-10 of about 31 all
7. Oct* 13: 1-7 of about 30 all
8. Oct* 14: 1-6 of about 16 all


Search details:
1.
frieddoh.stumbleupon.com/
www.artima.com/groups/group.jsp?group=dotnet
www.artima.com/forums/flat. jsp?forum=278&thread=107078
www.bacanalnica.com/foros/ viewtopic.php?t=30315&start=0
nighted.stumbleupon.com/

2.
www.bacanalnica.com/foros/ viewtopic.php?t=30315&start=0

3.
www.msoftware.co.nz/modules.php?op=modload& name=phpbb2&file=viewtopic.php&p=872

4.1
www.msoftware.co.nz/modules.php?op=modload& name=phpbb2&file=viewtopic.php&p=872
www.dslreports.com/forum/remark,14434066
www.dslreports.com/forum/remark,14335473~start=80
slowass.net/phaedrus/
www.kbcafe.com/tags.aspx/utils
www.download.com/WinZip-Beta/3640-2250_4-10433036.html
nighted.stumbleupon.com/
whirlpool.net.au/forum-replies-archive.cfm/409954.html
www.abstrakone.com/bookmarks/
www.broadbandreports.com/forum/remark,14335473
forums.whirlpool.net.au/ forum-replies-archive.cfm/409954.html


4.2 repeat search with omitted results included:
as in 4.1 plus:
www.msoftware.co.nz/modules.php?op=modload& name=phpbb2&file=viewtopic.php&p=873
www.dslreports.com/forum/remark,14401655~start=40
www.dslreports.com/forum/remark,14401655~start=0

5.
www.msoftware.co.nz/modules.php?op=modload& name=phpbb2&file=viewtopic.php&p=872
www.msoftware.co.nz/modules.php?op=modload& name=phpbb2&file=viewtopic.php&t=188
www.proxyblind.org/freeware.shtml
www.dslreports.com/forum/remark,14421632
www.dslreports.com/forum/ remark,14402348~days=9999~start=40
www.dslreports.com/forum/remark,14401655~start=20
www.dslreports.com/forum/remark,14380117
it.mylounge.com/lastpostinthread106072.html
www.pcreview.co.uk/forums/thread-2177739.php
www.gmailforums.com/index.php?showtopic=12842
www.gmailforums.com/lofiversion/index.php/t12842.html
www.bacanalnica.com/foros/ viewtopic.php?t=30315&start=0
www.betanews.com/article/print/ Google_to_Students_Try_Open_Source/1117638650
nighted.stumbleupon.com/

6.
www.msoftware.co.nz/modules.php?op=modload& name=phpbb2&file=viewtopic.php&p=872
www.msoftware.co.nz/modules.php?op=modload& name=phpbb2&file=viewtopic.php&p=873
www.download.com/WinZip-Beta/3640-2250_4-10433036.html
www.download.com/WinZip-Beta/ 3640-2250_4-10433036.html?sb=3&v=0
www.bacanalnica.com/foros/ viewtopic.php?t=30315&start=0
www.dslreports.com/forum/remark,14416704
www.betanews.com/article/Google_ to_Students_Try_Open_Source/1117638650
www.broadbandreports.com/forum/remark,14330194~start=40
www.broadbandreports.com/forum/remark,14330194~start=20

7.
www.dslreports.com/forum/ remark,14401655~days=9999~start=60
www.dslreports.com/forum/remark,14300829?hilite=opera
www.kbcafe.com/tags.aspx/utils
www.pcreview.co.uk/forums/thread-2177739.php
www.broadbandreports.com/forum/ remark,13893795~reverse=0;days=30;root=features;mode=full
www.broadbandreports.com/forum/remark,13893795~start=60
www.neowin.net/forum/lofiversion/index.php/t320017.html - 83k

8.
www.pcreview.co.uk/forums/thread-2177739.php
www.broadbandreports.com/shownews/64694
www.kbcafe.com/tags.aspx/process
www.kbcafe.com/tags.aspx/utils
www.dslreports.com/forum/remark,14335473~start=20
www.dslreports.com/forum/ remark,14401655~days=9999~start=40
www.dslreports.com/forum/ remark,13666232?hilite=copernic

sword: I saved details of each of these URLs in my file, 5x15D1, in case you might like to check them with what you might have. I will do a similar search for any time period you have previously searched so that you can compare the quality of this suggested search. I hope this helps.

Cheers, Robert

[mouser]

ah i understand now - thanks robert that's actually a different kind of method for searching for when something was mentioned; a good idea and something to think about possibly automating.

[clif_notes]

I use a personal "start" page in all my browsers that I made myself. One of the prominent links is the the Google Advanced seach. http://www.google.co...dvanced_search?hl=en

Great job using it there Sword.

[brotherS]

I use a personal "start" page in all my browsers that I made myself. One of the prominent links is the the Google Advanced seach. http://www.google.co...dvanced_search?hl=en

-clif_notes (October 18, 2005, 10:28 PM)

Nice idea, I thought about such a personal page too, but wasn't able to do that then... Now I just use AutoHotkey to easily access my most needed stuff