Author Topic: Compressing files into multiple .zip archives with each .zip being independent (Read 149375 times)

sri · « **on:** November 29, 2006, 10:47 PM »

Anyone know a way to compress about 9000 files into multiple .zip files of 8 MB each?

The individual zip files have to be independent of each other, meaning: each of them should be extractable to get the files inside w/o the necessity of other .zip files.

Thanks for help/ideas.

skwire · « **Reply #1 on:** November 30, 2006, 01:37 AM »

Since it's the closest post to the top that I can edit, I'm going to hijack it to provide the latest download link for SpinZip. I had a report of the links pointing at autohotkey.net not working properly so please use this link instead:

SpinZip v0.0.9.0

~ORIGINAL POST BELOW~

Here's a quick-n-dirty script. Unzip the attached file to its own folder and run sri-zip.exe (or sri-zip.ahk if you have AutoHotkey installed). A folder dialog will pop up, select the folder that contains the files you want to zip and click OK. There's no GUI (except for the tray icon) so a message box will pop up when the app has finished running and you'll find your zips in a "zips" sub-folder of the one you chose when running the script. Currently, it does no recursion through folders (all your files must be in the folder you chose at the start) so if you want something more configurable, just ask. I can write up a GUI for it in no time. Let me know how it works for you.

sri · « **Reply #2 on:** November 30, 2006, 02:08 AM »

skwire: I tried the script. It seemed to be working because I could see some temporary folder/file changing its size while the operation was going on. After some time I got a pop up that it's done. But the 'zips' folder is empty.

Are the new .zip files placed some where else? What will their names be? (so I can do a search)

skwire · « **Reply #3 on:** November 30, 2006, 02:27 AM »

Are the new .zip files placed some where else?

Hmmm...they shouldn't be.

What will their names be?

zip-1.zip
zip-2.zip
zip-3.zip
...

sri · « **Reply #4 on:** November 30, 2006, 02:30 AM »

searched for zip-1.zip...nothing $:-\$

skwire · « **Reply #5 on:** November 30, 2006, 02:34 AM »

Mind giving me a small sample of the filenames you're using?

sri · « **Reply #6 on:** November 30, 2006, 02:35 AM »

ACC35108.jpg
ACC35108L.jpg
...
...
ZNG9264L.jpg
ZNG9269L.jpg

skwire · « **Reply #7 on:** November 30, 2006, 02:41 AM »

Hmmm...not sure what the issue could be. It works here in my (albeit limited) testing. Is the zip.exe file in the same folder as sri-zip.exe? Each zip is generated sequentially so you should be able to watch them be created in the zips folder as the script runs.

sri · « **Reply #8 on:** November 30, 2006, 03:00 AM »

Yes. It is in the same folder as sri-zip.exe. Kindly download this screencast and launch skwire.html:

http://www.sendspace.com/file/0f8lzi

skwire · « **Reply #9 on:** November 30, 2006, 03:09 AM »

Try the attached version.

sri · « **Reply #10 on:** November 30, 2006, 03:13 AM »

Excellent! It is working.

Thanks a ton skwire. I'll blog about your tiny program and give the link here.

skwire · « **Reply #11 on:** November 30, 2006, 03:16 AM »

Great to hear. If you'd like, I can make up a GUI for it with options for zip size, output directory, etc.

sri · « **Reply #12 on:** November 30, 2006, 03:21 AM »

Yes. Please do. Being able to specify the max individual .zip file size is useful. Also, if you can code it such a way that there is a provision to enter the name used for the generated zip files.

Like if I enter "skwire", it should output "skwire-1.zip", "skwire-2.zip" etc.

Another way it could be extended is by giving the user an option of output being .zip or .rar.

skwire · « **Reply #13 on:** November 30, 2006, 03:26 AM »

Yes. Please do. Being able to specify the max individual .zip file size is useful. Also, if you can code it such a way that there is a provision to enter the name used for the generated zip files.

Like if I enter "skwire", it should output "skwire-1.zip", "skwire-2.zip" etc.

Easily done.

Another way it could be extended is by giving the user an option of output being .zip or .rar.

I could write the code to do that, however, the end-user would have to provide the rar.exe themselves since it's not a free program. If I'm mistaken, somebody please correct me.

skwire · « **Reply #14 on:** November 30, 2006, 06:09 AM »

I've attached the setup package for the GUI version. There is only very basic error checking involved at this point. Let me know how you like it and if you'd like anything changed.

sri · « **Reply #15 on:** December 01, 2006, 11:29 PM »

skwire:

1. I entered 8 in the Size field and all (almost) the resulting zip files are more than 8 MB in size. Pls chk the attached screenshot. Is this a bug? I think this will be fixed by being able to specify the size field in bytes and not in megs.

2. If the Output directory doesn't exist, even tho the prog says that zip files are generated, they aren't. Ideally the output directory has to be created if it doesn't exist.

3. Rename the program from Sri-zip to "SPinZip" (SP = Span, in = independently). That is, this is a program that generates spanned zip files that are independent of each other.

4. What's the max. allowable value in Compression field?

skwire · « **Reply #16 on:** December 02, 2006, 07:16 AM »

1. I entered 8 in the Size field and all (almost) the resulting zip files are more than 8 MB in size. Pls chk the attached screenshot. Is this a bug? I think this will be fixed by being able to specify the size field in bytes and not in megs.

No, it's not a bug; it's a by-product of the way the app works. It goes through the list of files in the folder one-by-one (in order) and keeps track of the total size. Once the amount goes over the value you entered, it zips those and the process repeats until there are no more files in the directory. In other words, there is no magic algorithm going on that scans the whole folder and attempts to make perfect-sized zip files.

2. If the Output directory doesn't exist, even tho the prog says that zip files are generated, they aren't. Ideally the output directory has to be created if it doesn't exist.

Again, there is little to no error-checking implemented at this point; the GUI was more of a proof-of-concept for you.

3. Rename the program from Sri-zip to "SPinZip" (SP = Span, in = independently). That is, this is a program that generates spanned zip files that are independent of each other.

Can do.

4. What's the max. allowable value in Compression field?

Nine.

skwire · « **Reply #17 on:** December 05, 2006, 05:29 AM »

Here's the latest version (v0.0.3) with some fairly comprehensive error-checking. Let me know how it works for you. Thanks.

sri · « **Reply #18 on:** December 05, 2006, 11:05 PM »

Thanks sk. Works fine. Looks like you improved the compression logic. Now the generated zip files are all less than the max size that we enter in the program.

I blogged about this in my site.

http://www.sridharee...le-independent-zips/.

skwire · « **Reply #19 on:** December 05, 2006, 11:31 PM »

You're welcome; I'm happy to help. =]

AHMalik · « **Reply #20 on:** December 10, 2006, 08:26 PM »

Sorry that I can't find Files page to download.
Regards

AHMalik · « **Reply #21 on:** December 10, 2006, 08:28 PM »

Can someone give me the link io download

sri · « **Reply #22 on:** December 10, 2006, 09:13 PM »

Malik,

Download it from https://www.donation...=6321.0;attach=12926

I also uploaded it here: http://www.sridharee....3/spinzip-setup.exe

CNeo · « **Reply #23 on:** February 21, 2007, 12:56 PM »

Thanks for a great little utility. I had been scouring Google trying to find a program to do exactly this. Great site, bookmarked!

skwire · « **Reply #24 on:** February 21, 2007, 01:14 PM »

I did release a later version that isn't on this thread. You can download it here: http://www.autohotke...zip-setup-v0.0.4.exe

It offers recursive zipping as well as a single wildcard (*.jpg, etc.) option. If you find problems with it...don't hesitate to let me know. Thanks. =]