Author Topic: IDEA: link in window grabber (Read 19946 times)

somps · « **on:** September 22, 2009, 03:05 PM »

Hi, It has been a while since i have been here. If I'm in the wrong area or going about this the wrong way, please let me know.

I have a request: I'm looking for a prog that would allow me to query all links in a page and/or links with a specific word or extenstion in it and be able to copy and paste it onto notepad or into a download manager....

Thanks,
If this is done the wrong way, please forgive me and let me know the correct way!

Somps
(with a long O)

awopbamboo · « **Reply #1 on:** September 24, 2009, 03:21 AM »

Hi Somps (with a long O)

Let me get this right....

You want something where you say for instance, give it a URL, it then downloads the content of that URL and scans though it for any links to other pages or sites? If the text content of that page or site matches some 'word or extension' that you choose, the link text itself will then be copied to notepad. So, you will end up with a list of links, matching your criteria, from a particular page, in notepad?

Have I understood that right?

J.

somps · « **Reply #2 on:** September 24, 2009, 07:56 AM »

I think we are on the same page, but let me give an actual example to make sure. Let's say I go to abc.com and there are 50 shortcut links to www.dddpotbelly.com/ with various things after the .com/ and there may be exe files at the end or .rar or .zip, but there may be other links to other sites or pages, but I only care about the ones from www.dddpotbelly.com. And keep in mind that these are shortcut links, not full links. It may show up as www.dddpotbelly.com/5612....r.html or something like that....

Have I confused you enough? Sorry. Hope u understand...

awopbamboo · « **Reply #3 on:** September 24, 2009, 08:15 AM »

but I only care about the ones from www.dddpotbelly.com.
-somps (September 24, 2009, 07:56 AM)

FROM? do you mean Links TO?

I think I understand.... Not entirely sure what you mean by a shortcut link as apposed to a full link? Can you explain?

somps · « **Reply #4 on:** September 24, 2009, 09:42 AM »

yes, srry, links to....

sometimes, on a webpage, there is a link to the file when you click it, but the actual link isn't visible. Kind of like a button. You see the button and if you hover the mouse over it, you can see the actual url, but if you right click on the button and choose "copy", it will copy the picture; if you right click on the button and choose copy shortcut then you get the url. That is an example...

Some site links are spelled out: http://autos.msn.com...orpage.aspx?page=gas
other links are not fully spelled out: http://autos.msn.com/....aspx?page=gas,
but when you put the mouse over it, then you see the full url.

I would like something that I could, for example, query any links with autos and it would catch both ways... I'm srry... I think I'm making it more confusing than it should be....

Thank you for your help!
Actually, after posting, I saw it do the same thing to the first link... so something like that.
If i just right click I can copy shortcut. I want to be able to pull all links from the website and be able to specify the criteria so that I don't get links to URLs that I don't want and yes, for that to show up in notepad or something where I can easily highlight and copy so I can paste into a download manager...

awopbamboo · « **Reply #5 on:** September 24, 2009, 09:50 AM »

Ummm....

Let me try and do something in the way I think I understand, and we'll go from there......

somps · « **Reply #6 on:** September 24, 2009, 11:55 AM »

Thank You!

awopbamboo · « **Reply #7 on:** September 24, 2009, 04:58 PM »

Hi

Not sure if this is what you want, not much error checking or anything on this yet, but give it a go then I'll tidy it.

Standalone executable, just download and run. Enter your url in the first box i.e. http://www.bbc.co.uk, second box enter a keyword of fileextension name. Then click go.

The results will appear in the box below which you can cut and paste from.

I may have mis-understood entirely what you wanted though!!

Let me know

J.

somps · « **Reply #8 on:** September 24, 2009, 05:48 PM »

It is only grabbing links that are in the main menu and in the side frame, but not from the body of the URL. I have some example pages, but could I get them to you somehow in a pm or something?

Thank you for your work.

awopbamboo · « **Reply #9 on:** September 25, 2009, 01:16 AM »

It is only grabbing links that are in the main menu and in the side frame, but not from the body of the URL. I have some example pages, but could I get them to you somehow in a pm or something?

Thank you for your work.

-somps (September 24, 2009, 05:48 PM)

Thats weird, it should be looking through the whole page. I think I need some real samples like you said. Ummm, just send me a message with the url's in and what you would expect to get back as a result. A couple of examples should do it.

Thanks

J.

awopbamboo · « **Reply #10 on:** September 26, 2009, 01:22 AM »

Hi Somps,

Try this version now...

J.

somps · « **Reply #11 on:** September 28, 2009, 08:39 AM »

I sent u a message with another example. With this latest example, it seems to capture a portion of html tags that incorporate some URLs
Thank you so much. This is doing what I want. You are the BEST!!! Mate!

awopbamboo · « **Reply #12 on:** September 28, 2009, 08:41 AM »

Ok, will look a bit later. At work at the moment!

awopbamboo · « **Reply #13 on:** September 30, 2009, 07:34 AM »

Somps,

try this for size. Work gets in the way of things, which is why I couldn't do this earlier....

J.

somps · « **Reply #14 on:** September 30, 2009, 12:03 PM »

This is sooooo beautiful!!!!!!!!!!!
WoW!
Thank you so much!

It works!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
I'm beside myself.... now maybe I can get some work done while I sleep then....

awopbamboo · « **Reply #15 on:** September 30, 2009, 12:26 PM »

If you want it improved, let me know. I notice some pages have duplicates so that could be fixed.

I assume what you want to do it download some/all of the links that come up? I could build it in so that it downloads the links for you?

Let me know if you have any ideas.

somps · « **Reply #16 on:** September 30, 2009, 01:43 PM »

Awopbamboo,

Can it download all the links, for example, that are on a page like the example I gave? Also, is there a way to have it start if I type in the website/keyword and hit enter?
This is already so great. I appreciate your help.

awopbamboo · « **Reply #17 on:** October 01, 2009, 04:34 AM »

Now made a few changes.

After the list of links comes up, you can right click.
You can then Download the selected links (you can select as many as you want)
Delete from the result list
Copy to Clipboard
and Clear the results

Give it a try and let me know if it works....

J.

awopbamboo · « **Reply #18 on:** October 01, 2009, 07:16 AM »

Somps

Try it now.

It will tend to bring back more results, but you can delete the result lines you don't want anyway.

let me know how you get on....

paarkhi · « **Reply #19 on:** October 01, 2009, 08:39 AM »

A humble request to awopbamboo is that make the first post always updates with your program, so that dumb people like me don't download the old version.

Forget it if you felt wrong.
BTW Nice Program

awopbamboo · « **Reply #20 on:** October 01, 2009, 08:42 AM »

Point taken, I do have some members space that I WILL start using!

So, in future will just include a link to my space todownload.

BTW Nice Program
-paarkhi (October 01, 2009, 08:39 AM)

ta

somps · « **Reply #21 on:** October 01, 2009, 12:29 PM »

Is it wrong for me to start getting so excited about this?

I'm like WoW!!!!!

Ok, I hope I'm not pushing it..... I'm just so excited. This is so real and so great!

1) Can it work off of hitting enter in the "URL to Scan" box?
2) If I'm scanning for an "exe" file and a "rar" file, can I do like a comma delimter or semicolon between the two extensions and it bring back results for both. Then the example I sent you before would come back with only the items I'm looking for.

I love how you've made it so far.
Two other things:
1) if you need any space for this type of thing, just let me know. I have extra space on my server.
2) if you ever need some graphic work for any of your projects, let me know and I will do my best to come up with something.

I found a small bug. Not sure about it, but when it pulls the URL links, for some reason this latest version is cutting off the first letter of the link after http:// ie:
http://faq.list.com comes out as http://aq.list.com

Somps

awopbamboo · « **Reply #22 on:** October 01, 2009, 01:10 PM »

This does your new requests now.....

Enter now works in URL box

You can now seperate multiple keywords with a comma. i.e.
exe,rar,zip

Give it a try...

I just notoced you said there is a bug. Will look into that....

awopbamboo · « **Reply #23 on:** October 01, 2009, 11:32 PM »

Bug is now fixed so the first character is not lost on some link types. Updated can be downloaded from below.

Let me know how it goes.....

somps · « **Reply #24 on:** October 02, 2009, 08:43 AM »

This is the BESTEST EVER!!!!!!

Only one thing missing: You need an "about" link with your credits!!!! This is a much wanted/needed app and I'm sure it will be hot soon and props should be in there for you! I love this little powerful app! I hope it wasn't too much of a pain. So cool. You don't mind if I pass the final version around do you? The final version would be the one with your credits in it.