Welcome Guest.   Make a donation to an author on the site November 28, 2014, 03:51:06 AM  *

Please login or register.
Or did you miss your validation email?


Login with username and password (forgot your password?)
Why not become a lifetime supporting member of the site with a one-time donation of any amount? Your donation entitles you to a ton of additional benefits, including access to exclusive discounts and downloads, the ability to enter monthly free software drawings, and a single non-expiring license key for all of our programs.


You must sign up here before you can post and access some areas of the site. Registration is totally free and confidential.
 
The N.A.N.Y. Challenge 2011! Download 30+ custom programs!
   
   Forum Home   Thread Marks Chat! Downloads Search Login Register  
Pages: Prev 1 [2]   Go Down
  Reply  |  New Topic  |  Print  
Author Topic: All AutoHotkey (AHK) coders read: No more upx packing of compiled ahk utils  (Read 28633 times)
wraith808
Supporting Member
**
Posts: 6,505



"In my dreams, I always do it right."

see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #25 on: June 08, 2010, 06:10:51 PM »

I'm a sarcopath)
Please, get off the path and back  to your phagus!

You *really* want to make sure you keep that turkey badge, don't you?  Wink
Logged

cranioscopical
Friend of the Site
Supporting Member
**
Posts: 4,196



see users location on a map View Profile Read user's biography. Give some DonationCredits to this forum member
« Reply #26 on: June 08, 2010, 06:41:07 PM »

You *really* want to make sure you keep that turkey badge, don't you?  Wink
By fair means or fowl!
Logged

Chris
Target
Honorary Member
**
Posts: 1,414



see users location on a map View Profile WWW Give some DonationCredits to this forum member
« Reply #27 on: June 08, 2010, 08:29:37 PM »

You *really* want to make sure you keep that turkey badge, don't you?  Wink
By fair means or fowl!

does nothing phage you?
Logged

"Look wise, say nothing, and grunt. Speech was given to conceal thought" - Sir William Osler
MilesAhead
Member
**
Posts: 5,055



View Profile WWW Give some DonationCredits to this forum member
« Reply #28 on: June 24, 2010, 09:12:04 PM »

I found this interesting. I recompiled a bunch of my ahk and AutoIt3 utilities without UPX compression.  I noticed the other day MalwareBytes anti-malware still flagged a bunch of them.  Seems like there may be something in the compile wrapper rather than in UPX.  Seems a bit odd.

edit: before anyone gets paranoid, I scanned the compiled exes in the script folders and none of them were flagged.  Seems it only wants to flag them in Windows7 32 bit.  Weird.
« Last Edit: June 24, 2010, 09:15:51 PM by MilesAhead » Logged

"It's only called research if you didn't find it the first time."
-- MilesAhead
ewemoa
Honorary Member
**
Posts: 2,492



View Profile Give some DonationCredits to this forum member
« Reply #29 on: June 25, 2010, 09:37:06 PM »

That does sound weird.

Did you happen to try sending various things to virustotal?
Logged
MilesAhead
Member
**
Posts: 5,055



View Profile WWW Give some DonationCredits to this forum member
« Reply #30 on: June 25, 2010, 09:57:22 PM »

That does sound weird.

Did you happen to try sending various things to virustotal?

Nope.  What I think it is, when I get the false positives in Malwarebytes and it's just the AutoIt or ahk program, I add it to the ignore list.  I probably forgot that I already added them on the Vista machine earlier. When I did a full scan on the Windows7 machine it found the files without UPX compression so it probably disregarded the ignore list since they were so much bigger.  At least that's my theory. smiley


Does make you wonder what it finds that triggers it off though.

Logged

"It's only called research if you didn't find it the first time."
-- MilesAhead
MilesAhead
Member
**
Posts: 5,055



View Profile WWW Give some DonationCredits to this forum member
« Reply #31 on: August 29, 2010, 06:02:53 PM »

This issue caused me to look into some of the pros/cons of UPX compression.  I can't seem to find the links right now. But one of the issues mentioned was Windows system handling of compressed exes afa paging into memory etc..  The gist of it was, the only benefit was reduced download size, while the side-effects included Windows loading the entire exe into memory instead of paging in the code(which may not matter for small utilities.) But in any event it made me think I'm just as well off not to use compression.  These days most people can handle downloading 800KB as opposed to 600KB. Not a big issue.  Guess I could try a more thorough 7-zip or other zip program compression setting as a means to reduce the download bulk.
Logged

"It's only called research if you didn't find it the first time."
-- MilesAhead
Jibz
Developer
***
Posts: 946



Cold Warrior

View Profile WWW Give some DonationCredits to this forum member
« Reply #32 on: August 30, 2010, 01:25:00 AM »

This issue caused me to look into some of the pros/cons of UPX compression.  I can't seem to find the links right now.

f0dder wrote a nice article about (some of) the reasons why exe compression is bad:

http://f0dder.reteam.org/packandstuff.htm

You can add the never ending problems with false positives to that.
Logged

"A problem, properly stated, is a problem on it's way to being solved" -Buckminster Fuller
"Multithreading is just one damn thing after, before, or simultaneous with another" -Andrei Alexandrescu
MilesAhead
Member
**
Posts: 5,055



View Profile WWW Give some DonationCredits to this forum member
« Reply #33 on: August 30, 2010, 12:58:39 PM »

For some reason I also thought zip compressors had an adjustment how thorough a compression to use.  At least the free ones seem to do it all about the same.  7-zip .7z format seems to compress a bit more, but I'd either have to change the download links or put a .7z file inside a .zip file.  To get 207KB download instead of 240KB it's not worth the effort or confusion.
Logged

"It's only called research if you didn't find it the first time."
-- MilesAhead
f0dder
Charter Honorary Member
***
Posts: 8,774



[Well, THAT escalated quickly!]

see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #34 on: August 30, 2010, 01:12:30 PM »

There are adjustments to zip compression - it supports a few different algorithms, and the most common one (deflate) can have compression characteristics adjusted; not much point in going for less than maximum compression on today's hardware, though smiley. The .7z and .rar formats have fairly more decent algorithms, but they also have a huge advantage over .zip: solid compression, which matters a lot when your archive includes a lot of small files (typical for source code distribution).
Logged

- carpe noctem
MilesAhead
Member
**
Posts: 5,055



View Profile WWW Give some DonationCredits to this forum member
« Reply #35 on: August 30, 2010, 01:15:07 PM »

This issue caused me to look into some of the pros/cons of UPX compression.  I can't seem to find the links right now.

f0dder wrote a nice article about (some of) the reasons why exe compression is bad:

http://f0dder.reteam.org/packandstuff.htm

You can add the never ending problems with false positives to that.

Recognition of UPX may have triggered false positives but I think many of these av apps are seeing scripting code wrapped as an exe.  Many will flag compiled scripts UPX or no UPX I'm thinking. I know Malwarebytes does.   I have to empty my recycle bin of old compiled scripts or it sucks them up and wants to reboot my machine to purge them.  It seems to sick any ahk or autoit3 script compiled to exe.
Logged

"It's only called research if you didn't find it the first time."
-- MilesAhead
MilesAhead
Member
**
Posts: 5,055



View Profile WWW Give some DonationCredits to this forum member
« Reply #36 on: August 30, 2010, 01:16:45 PM »

There are adjustments to zip compression - it supports a few different algorithms, and the most common one (deflate) can have compression characteristics adjusted; not much point in going for less than maximum compression on today's hardware, though smiley. The .7z and .rar formats have fairly more decent algorithms, but they also have a huge advantage over .zip: solid compression, which matters a lot when your archive includes a lot of small files (typical for source code distribution).

Maybe you can tell me which (free) zipper you are using? I looked at four and didn't see any "more thorough" setting for .zip format.  Only other formats.
Logged

"It's only called research if you didn't find it the first time."
-- MilesAhead
f0dder
Charter Honorary Member
***
Posts: 8,774



[Well, THAT escalated quickly!]

see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #37 on: August 30, 2010, 03:12:58 PM »

I use WinRAR - it isn't free, but it supports store/fastest/fast/normal/good/best for both .rar and .zip. Haven't tested how it affects compression ratio for .zip, so it could be that in reality it only supports store and one form of deflate - *shrug*. I thought the info-zip commandline zipper supported adjusting compression ratio, but can't find a reference to it in the manual.
Logged

- carpe noctem
MilesAhead
Member
**
Posts: 5,055



View Profile WWW Give some DonationCredits to this forum member
« Reply #38 on: August 30, 2010, 03:27:55 PM »

Thanks for the feedback.  At the size of my stuff even a v90 dial-up it's only a few seconds difference on the download.  Plus some newbs may wonder why there's a .7z file inside their .zip file.  So it's not really worth messing with it at this point.  Zip may not be a the best but it's built into Windows. Pretty much guaranteed to be there even for the newbiest newbs. smiley

edit: I did find out 7-zip command line implementation has a switch for more thorough .zip compression.  But at the size of my files, the archive is only about 1 or 2 KB smaller.  Guess I'll stick with 7-zip shell integrated version.  .7z does come out a bit smaller but "file not found" is about a fate comparable to death. Too much risk and not much reward trying to change links. If I was just starting now I'd probably go with .7z format though.


« Last Edit: August 30, 2010, 05:02:21 PM by MilesAhead » Logged

"It's only called research if you didn't find it the first time."
-- MilesAhead
Pages: Prev 1 [2]   Go Up
  Reply  |  New Topic  |  Print  
 
Jump to:  
   Forum Home   Thread Marks Chat! Downloads Search Login Register  

DonationCoder.com | About Us
DonationCoder.com Forum | Powered by SMF
[ Page time: 0.04s | Server load: 0.44 ]