Author Topic: URLplayer thread (Read 16,626 times)

publicdomain · « **on:** January 07, 2021, 04:39 AM »

URLplayer.
Browse link lists, one website at a time.

Original thread	DONE: Have list of URLs, and, in Chrome, manually load one, then next, etc.
Source code	https://github.com/publicdomain/urlplayer
2021-02-01 version	0.2.0
Image
Made for	nkormanik

Download: https://www.dcmembers.com/publicdomainvic/download/urlister-v0-2-0/

Quote from: nkormanik on January 06, 2021, 10:26 AM

Well, URLister is needed, and will be greatly appreciated.

Requests:

-- Allow copy/paste to get list of URLs entered.
-- Allow drag-into-window to get list of URLs entered.
-- Allow drag-to-program-icon (on desktop), and SendTo, to get list of URLs entered.
-- Allow option to open each URL into separate tabs, OR into just the first tab, overwriting what was there.
-- Allow program window option to STAY ON TOP of other windows (i.e, browsers)

That would be a good start.

Thanks for keeping this alive!

Nicholas Kormanik

nkormanik · « **Reply #1 on:** January 07, 2021, 10:49 AM »

Quote

As I get into it, would you like to add:

- Global hotkeys (for moving to next URL using the keyboard).

Cheers!
Vic

Thanks a million, Vic. Yes, it would be helpful to have a keyboard shortcut, if possible, to move on to the next URL.

In my particular case, I have been using a macro program (Macro Express) and Flem (Waterfox extension), and moving mouse cursor specifically to a little box (need screen coordinates), clicking in that little box, to move on to the next URL. This all depends on the screen, window, staying exactly as it was when the macro was 'programmed.' I was anticipating doing similarly with your program.

Having a keyboard shortcut to move on to the next URL would indeed make life easier.

Let's take a little example:

Below is a list of direct-link URLs for six pdf books I would like to download:

http://digamo.free.fr/salva03.pdf
https://repub.eur.nl/pub/51601/Edle-Dusko-Krsmanovic-lr-.pdf
http://www.thebestofrawfood.com/support-files/thebestrecipes.pdf
http://finpko.faculty.ku.edu/myssi/FIN938/Thaler_Advances%20in%20Behavioral%20Finance-II_2005.pdf
https://www.pdfdrive.com/download.pdf?id=18725882&h=3645287dbb0ecb96c14e4f9be308214a&u=cache&ext=pdf
https://www.pdfdrive.com/download.pdf?id=19590962&h=70be5da5486ac0aa207703878f1850f4&u=cache&ext=pdf

I find it best to make sure one book is fully downloaded before starting to download the next. So, let's assume, I sit and wait. Then click on tiny box "Next" as needed when the right time comes, for the next URL. Again and again. Until all books are downloaded.

(Uhhmmm.... What about 100 books? Or 1000....)

(Actually, I assume the worst case, and build that into a macro -- say, two minutes per book. Macro waits, then repeats. Set that all rolling, while I sleep at night. By morning, a folder full of new reading material, images, songs, whatever.)

Thanks!
Nicholas Kormanik

nkormanik · « **Reply #2 on:** January 07, 2021, 01:18 PM »

An additional point is, in what form are the URLs.

In the example above, the six URLs are in a list. A text list. Text file.

What, though, if user has Windows desktop links, six little icons, shortcuts?, sitting on desktop. Or in a folder.

In such case, how is the user supposed to get those desktop links into your program?

Probably difficult to code, but ideally the user could simply drag those six desktop links over into your program, and *shazam*, all links suddenly are transformed into a list.

(Wonder how many out there have folder after folder of such links, not even remembering what they would lead to. Wouldn't it be terrific to drag a folder over into your program, generate a big list, and zip through to all sorts of various web pages long forgotten....)

Such a conversion functionality would be pretty significant. Not at all readily found out there.

If the list could then be saved (.txt, or, huge bonus, .html), well, people might be downloading your program simply to have such easy link conversion. Let alone the primary ability to load those links one after the other.

nkormanik · « **Reply #3 on:** January 13, 2021, 11:32 AM »

Number of lines appears limited. Increase that by tenfold.

i.e., from roughly 300 --> 3000.

publicdomain · « **Reply #4 on:** January 13, 2021, 07:58 PM »

Hi there Nick! Got your suggestions and all of them are doable (We're tackling them one by one in code).

BTW I believe the PDF download part is perfect for our upcoming "pdGet" downloader project; a web macro input module fits your requirement perfectly since button clicking is performed via direct/internal browser automation.

Chances are both URLplayer and pdGet move from alphas to first public betas in the next few releases (I'm free enough this month).

Do monitor this thread! You're the very first tester

Vic

nkormanik · « **Reply #5 on:** January 14, 2021, 10:22 AM »

Thanks much, Vic. Another thing I noticed is that URLplayer does not yet allow for opening JUST ONE tab of the browser (in my case, Edge -- seemed Chrome was suddenly sort of misbehaving on various fronts...). Instead, multiple tabs are being opened, one per URL. Perhaps that's unavoidable. Since I am downloading so many files, it would be necessary to have the option of just a single tab being repeatedly used. (Possible with the Waterfox/Firefox extension Flem, now history...)

publicdomain · « **Reply #6 on:** January 15, 2021, 01:48 PM »

My pleasure!

Quote from: nkormanik on January 14, 2021, 10:22 AM

it would be necessary to have the option of just a single tab being repeatedly used.

Just checking... would closing & re-launching browser with new URL suffice?

There's a bit more of a delay yet it's certain to use only one tab to save memory.

Cheers!

nkormanik · « **Reply #7 on:** January 16, 2021, 08:45 AM »

Great, Vic. Glad you are still game.

Probably users in general would not want to be reloading their browsers. But, I don't have a problem with doing that.

Actually, a clever idea.

If unloading browser is accepted, URLplayer may be usable presently -- except for needing a much, much larger list allowance.

If I am orchestrating the whole works on my system, I can tell my macro program (presently MacroExpress) to unload the browser -- after, say, two minutes (to download a .pdf file). After browser is unloaded, go back to URLplayer, and load the next URL in the list. Which will fire up the browser again, and go to the subsequent page (or download the next pdf in line).

So, what we would have is a nice 'semi-automatic', with a really long clip.

publicdomain · « **Reply #8 on:** January 24, 2021, 03:59 PM »

Quote from: nkormanik on January 16, 2021, 08:45 AM

Great, Vic. Glad you are still game.

Always happy to assist!

Quote from: nkormanik on January 16, 2021, 08:45 AM

If unloading browser is accepted, URLplayer may be usable presently

Sweet! Browser closing is programmed (Source: MainForm.cs).

I'm adding some more code to publish new release (save settings, open/import URL file, always on top).

Quote from: nkormanik on January 16, 2021, 08:45 AM

except for needing a much, much larger list allowance.

Default MaxLength limit is addressed now.

Quote from: nkormanik on January 16, 2021, 08:45 AM

If I am orchestrating the whole works on my system, I can tell my macro program (presently MacroExpress) to unload the browser -- after, say, two minutes (to download a .pdf file). After browser is unloaded, go back to URLplayer, and load the next URL in the list. Which will fire up the browser again, and go to the subsequent page (or download the next pdf in line).

So, what we would have is a nice 'semi-automatic', with a really long clip.

Hope we can make things easier on your end.

Thanks for working along Nick! It helps improve our software which in turn helps other fellows around

Vic

publicdomain · « **Reply #9 on:** February 02, 2021, 04:14 AM »

URLister v0.2.0:

Download page: https://www.dcmembers.com/publicdomainvic/download/urlister-v0-2-0/

nkormanik · « **Reply #10 on:** February 02, 2021, 11:24 AM »

Nice, Vic. Coming along!

Enhancement Requests:

-- Allow .txt list of bookmarks to be dragged to URLister icon, to automatically open into program.

-- Allow .htm/.html list of bookmarks to be dragged to URLister icon, to automatically open into program.

The above two items will allow URLister to be placed into the SendTo folder as well.

-- Allow .txt list of bookmarks to be dragged to URLister opened program window to open.

-- Allow .htm/.html list of bookmarks to be dragged to URLister opened program window to open.

Copied and pasted a list of URLs into program okay.

Received the following error message:

Thanks!

publicdomain · « **Reply #11 on:** February 02, 2021, 12:03 PM »

Quote from: nkormanik on February 02, 2021, 11:24 AM

Copied and pasted a list of URLs into program okay.

Good! New code at work

Quote from: nkormanik on February 02, 2021, 11:24 AM

Received the following error message:

Holy potatoes! What's your exact Windows version?

Got it running on Win7:

https://www.youtube.com/watch?v=l2QaxiGKYb8

(May need to fall back to previous launch code for v0.3.0 with your drag & drop additions)

nkormanik · « **Reply #12 on:** February 02, 2021, 12:22 PM »

Excellent video. Can't get clearer than that.

Windows 10 Pro, 20H2, 19042.746, Windows Feature Experience Pack 120.2212.1070.0

And presently using the new Edge browser.

But willing to use ANY browser with URLister. Noticed the only option is "Default." If user can insert in the .xml file their preferred browser (path, etc.), that would be sweet.

nkormanik · « **Reply #13 on:** February 03, 2021, 11:24 AM »

By the way, Vic, and others... I had asked about this functionality years ago. One person that worked on it is at this link:

RegaLink

He, Stephen66515, did a pretty good job, until he stopped. He left available his code for others to use if they wanted.

publicdomain · « **Reply #14 on:** February 20, 2021, 06:52 PM »

Quote from: nkormanik on February 02, 2021, 11:24 AM

Copied and pasted a list of URLs into program okay.

Received the following error message:

[attachthumb=1,msg443553]

Thanks!

Okay! the sure-fire solution is to have a file-browsing dialog for manual browser picking.

It gets added to next version for moving on from URLister this February to the original URLplayer program from March onward.

Cheers!

publicdomain · « **Reply #15 on:** March 01, 2021, 06:39 AM »

Nick! Next release is almost done featuring:

- HTML link importing.
- Drag & Drop support for .txt, .htm, .html and .url.
- Proper URL format validation.
- Proper scroll bars.
- Multiple custom browser support.
- Removal of custom browser with DELETE key.
- Multiple file processing by passed arguments.
- Previous and next URL hotkeys. <-- I've hard-coded F9-F12 like this: (MainForm.cs line).

If you'd like different Hotkey combinations, please shoot! Right now is a great time to say it

Cheers!

publicdomain · « **Reply #16 on:** March 06, 2021, 11:02 PM »

Quote from: publicdomain on March 01, 2021, 06:39 AM

If you'd like different Hotkey combinations, please shoot!

Okay! Just updated them for left-handed pressing: (See Manform.cs line)

- HTML link importing.
- Drag & Drop support for .txt, .htm, .html and .url.
- Proper URL format validation.
- Proper scroll bars.
- Multiple custom browser support.
- Remember last used browser.
- Removal of custom browser with DELETE key.
- Multiple file processing by passed arguments.
- Previous and next URL hotkeys on SHIFT + A, S, D, Q, W.

URLister v0.3.0 is basically done! Just need to create the release video & update its about message

nkormanik · « **Reply #17 on:** July 05, 2021, 05:41 AM »

Now Vic is up to 0.4.0 on this project. Has been working really well for me.

I've accumulated over a thousand URLs linking to ebooks I want to download. URLister brings 'em up one at a time. I've set up a macro to do the downloading. After download, macro goes back to URLister for the next.

Thanks Vic!

publicdomain · « **Reply #18 on:** July 08, 2021, 05:02 AM »

Thanks Vic!
[/quote]

My pleasure AMIGO

Development of sequential/macro downloader for the web comes in the form of the pledged pdGet downloader:

https://www.donationcoder.com/forum/index.php?topic=51531.0

Yours is the very first functionality in the list to be added

nkormanik · « **Reply #19 on:** September 04, 2021, 06:32 AM »

Vic, still often getting same error as mentioned back a few months:

[attachthumb=#]

Hope you might be able to figure out the reason. Seems to be timing. Maybe due to Edge browser. Who knows.

Thanks!
Nicholas

publicdomain · « **Reply #20 on:** September 05, 2021, 09:29 PM »

Quote from: nkormanik on September 04, 2021, 06:32 AM

Vic, still often getting same error ...

Hi Nick, it gets refactored/re-done in pdGet v0.1.0.

nkormanik · « **Reply #21 on:** September 05, 2021, 09:40 PM »

Good news, then, Vic. Perhaps put a link here to pdGet?

Thanks!