Welcome Guest.   Make a donation to an author on the site May 18, 2013, 02:31:07 PM  *

Please login or register.
Or did you miss your validation email?


Login with username and password (forgot your password?)
Why not become a lifetime supporting member of the site with a one-time donation of any amount? Your donation entitles you to a ton of additional benefits, including access to exclusive discounts and downloads, the ability to enter monthly free software drawings, and a single non-expiring license key for all of our programs.

You must sign up here before you can post and access some areas of the site. Registration is totally free and confidential.
 
Learn about the DonationCoder.com microdonation system (DonationCredits).
   
   Forum Home   Thread Marks Chat! Downloads Search Login Register  
+  DonationCoder.com Forum
|-+  Main Area and Open Discussion
| |-+  General Software Discussion
| | |-+  Experts opinion on very odd Camera -> Card -> File Copy corruptions
Pages: [1]   Go Down
« previous next »
  Reply  |  New Topic  |  Print  
Author Topic: Experts opinion on very odd Camera -> Card -> File Copy corruptions  (Read 3086 times)
Perry Mowbray
N.A.N.Y. Organizer
Charter Member
***
Posts: 1,693



Thoughtful Scribbles

plarker scribbly see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« on: November 11, 2011, 03:27:20 PM »
I'm on Win7 Professional SP1 64bit, lots of RAM (don't laugh Nudone), and a SONY CyberShot camera.

After my recent short walk I have 3 16Gb SD cards full of photos, which I moved to my computer with MultiComander. The first two cards went flawlessly, but I've run into dreadful issues with the third, where the images are corrupt. Well, corrupt on the first copy/move (mostly).

What I did, which is what I've always done (maybe not any more though  embarassed), is to move the files from the card to the computer. Some of the moved files ended up like this (reduced): . The regularity of a file being corrupted increased during the move opperation (that is, it was maybe 1 in 20 at the beginning and 1 in 3 at the end). I may attach other examples, but some of them look they have multiple layers overwritten with mismatched origin points (ie offset). I used EASEUS Data Recovery Wizard 5.0.1 to recover the deleted (when moved) files, and mostly they seem to be OK: . But sometimes the files are also corrupt on the card, iterestingly mostly different to the file that was moved, but the same as what was recovered. I also tried Recuva, but Recuva found 3169 files as Easeus found 9442 files, which seemed to give me greater ability to find a non-currupted file. BUT, what is also extremely odd is that sometimes the recovered file on the HDD is not the same as what is on the card, and when recovered individually.

Now, what that implies to me is:
  • The original move produced some corrupted files. Caused by?
    • MultiCommander?
    • Windows?
    • Hard Drive?
  • The camera wrote corrupted files.
    • Bad Card? But it's not consistent?
    • Naughty camera? It's not the most perfect environment for a camera in the hot and cold, sometimes rain, and jolted when I fell over... But the timing of the corrupt files doesn't correspond with any of those events.
    • The recovered files may not have been the final file the camera wrote? Maybe the camera used the card as a temporary storage when combining images?
    • The recovered files are not named the same as what was moved, so I'm not sure what that means?  huh

If a JPEG expert is interested they can access the original, non-reduced, files for comparison here (warning - they are large files). When I edited them with IrfanView (eg to resize), IrfanView would complain that the file format was corrupt: extra data where it shouldn't be, or missing data; which to me sounds like the file has been written incorrectly (either by camera or software during the copy):

I'm going through, slowly, and re-copying them when necessary and I think that in the end I should not have lost very many images (though with 9,500 I can afford to lose some and not be too upset  embarassed), but the why of this problem is troubling me... anyone with any ideas?

The main lesson I learned is that Move as a file action is not the best idea when there are lots of files and it may be best to check first before removing them from the origin location (but in my defense: this is the first time that something like this has ever happened).
Logged
Perry Mowbray
N.A.N.Y. Organizer
Charter Member
***
Posts: 1,693



Thoughtful Scribbles

plarker scribbly see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #1 on: November 11, 2011, 03:47:31 PM »
Here's another example:

Original Move:


IrfanView complained when saving after reducing:
Logged
Perry Mowbray
N.A.N.Y. Organizer
Charter Member
***
Posts: 1,693



Thoughtful Scribbles

plarker scribbly see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #2 on: November 11, 2011, 05:24:37 PM »
and another:



which IrfanView complained:
Logged


[ may-june 2013 ad experiment; click here to learn more about donationcoder.com ]

rgdot
Supporting Member
**
Posts: 1,240


View Profile WWW Give some DonationCredits to this forum member
« Reply #3 on: November 11, 2011, 05:41:48 PM »
I have seen similar to your screenshots (but not the JPEG errors) when the camera's CCD went bad when the camera was moved or jerked too much.
Logged
RGdot.com
Perry Mowbray
N.A.N.Y. Organizer
Charter Member
***
Posts: 1,693



Thoughtful Scribbles

plarker scribbly see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #4 on: November 11, 2011, 05:44:21 PM »
Quote from: rgdot on November 11, 2011, 05:41:48 PM
I have seen similar to your screenshots (but not the JPEG errors) when the camera's CCD went bad when the camera was moved or jerked too much.

When actually taking the photo or after a serious jerk (bump)?

Generally I'm pretty steady when taking a photo (after long experimentation of long exposures without a tripod)...
Logged
skwire
Charter Member
***
Posts: 3,448



Another Coding Snack request? Om nom nom...

see users location on a map View Profile WWW Give some DonationCredits to this forum member
« Reply #5 on: November 11, 2011, 05:46:29 PM »
Based off of my own experiences (personally and professionally), I'd say it's the card.  To rule out the camera, have you tried taking any test photos with it and one of the known good cards?
Logged
rgdot
Supporting Member
**
Posts: 1,240


View Profile WWW Give some DonationCredits to this forum member
« Reply #6 on: November 11, 2011, 05:50:20 PM »
Quote from: Perry Mowbray on November 11, 2011, 05:44:21 PM
Quote from: rgdot on November 11, 2011, 05:41:48 PM
I have seen similar to your screenshots (but not the JPEG errors) when the camera's CCD went bad when the camera was moved or jerked too much.

When actually taking the photo or after a serious jerk (bump)?

Generally I'm pretty steady when taking a photo (after long experimentation of long exposures without a tripod)...

In my experience serious jerk
Logged
RGdot.com
Perry Mowbray
N.A.N.Y. Organizer
Charter Member
***
Posts: 1,693



Thoughtful Scribbles

plarker scribbly see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #7 on: November 11, 2011, 05:55:14 PM »
Quote from: skwire on November 11, 2011, 05:46:29 PM
Based off of my own experiences (personally and professionally), I'd say it's the card.  To rule out the camera, have you tried taking any test photos with it and one of the known good cards?

I will... I'm busy trying to get this mess fixed at the moment  Angry  But have you found it to be every file or random?

But interestingly, I just found one moved:


That IrfanView said:


And recoved, which was the same on the card:


That IrfanView said:
« Last Edit: November 11, 2011, 06:03:18 PM by Perry Mowbray » Logged
Perry Mowbray
N.A.N.Y. Organizer
Charter Member
***
Posts: 1,693



Thoughtful Scribbles

plarker scribbly see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #8 on: November 11, 2011, 05:56:20 PM »
Quote from: rgdot on November 11, 2011, 05:50:20 PM
Quote from: Perry Mowbray on November 11, 2011, 05:44:21 PM
When actually taking the photo or after a serious jerk (bump)?

Generally I'm pretty steady when taking a photo (after long experimentation of long exposures without a tripod)...

In my experience serious jerk

and I should have added: permanent problems or just for the current photo? Because this is rather ad-hoc...
« Last Edit: November 11, 2011, 06:04:41 PM by Perry Mowbray » Logged
rgdot
Supporting Member
**
Posts: 1,240


View Profile WWW Give some DonationCredits to this forum member
« Reply #9 on: November 11, 2011, 06:27:34 PM »
I had a Canon that after I ran and played sports with it in my pocket became similar to this permanently.
Logged
RGdot.com
Perry Mowbray
N.A.N.Y. Organizer
Charter Member
***
Posts: 1,693



Thoughtful Scribbles

plarker scribbly see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #10 on: November 11, 2011, 06:34:21 PM »
Quote from: rgdot on November 11, 2011, 06:27:34 PM
I had a Canon that after I ran and played sports with it in my pocket became similar to this permanently.

 Sad mad ohmy Angry
Logged
nudone
Cody's Creator
Columnist
***
Posts: 4,116



see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #11 on: November 11, 2011, 06:40:36 PM »
Sorry to hear this - and after such a great adventure. It's a harsh lesson but "copying" from one location to another is the only way; maybe even treating the original cards as permanent media rather than something you can reuse. That's all in hindsight though.

I'd also blame the card(s), i.e. I've seen it happen and assumed it was the card so threw it away - then not had the problem arise again. I convinced myself this was due to putting the card in my back pocket - did you store the cards in a less than perfect way?
Logged
Perry Mowbray
N.A.N.Y. Organizer
Charter Member
***
Posts: 1,693



Thoughtful Scribbles

plarker scribbly see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #12 on: November 11, 2011, 06:51:39 PM »
Quote from: nudone on November 11, 2011, 06:40:36 PM
Sorry to hear this - and after such a great adventure. It's a harsh lesson but "copying" from one location to another is the only way; maybe even treating the original cards as permanent media rather than something you can reuse. That's all in hindsight though.

It was only 1 16Gb card (of 3), and not every image on the card -- it's quite random... and actually, only mainly evident on copied files once they get onto the HDD (and even then not every time for the same file)... which made me wonder about the software: so I'm generally able to copy them off again without too many issues (apart from time).

Quote from: nudone on November 11, 2011, 06:40:36 PM
I'd also blame the card(s), i.e. I've seen it happen and assumed it was the card so threw it away - then not had the problem arise again. I convinced myself this was due to putting the card in my back pocket - did you store the cards in a less than perfect way?

 ohmy  You are joking, right?? Me, do something less than perfect??  Wink

Well, seriously... this was such an important walk (for us), that I had the filled cards in their cases, inside a padded bag that was inside a protected pocket of my pack.

And the images that are corrupt on the card, are fairly few... unless the card can affect the file as it's copied off?? I wouldn't have thought that was possible??

Anyway, I've got to get as many rescued before I start any investigation which may overwrite those files and make them unrecoverable permanently Sad

Maybe it's all part of the adventure?
Logged
4wd
Supporting Member
**
Posts: 2,480



Light's on but nobody's home.

see users location on a map View Profile Read user's biography. Give some DonationCredits to this forum member
« Reply #13 on: November 11, 2011, 07:57:56 PM »
As a suggestion, why not try a couple of other recovery programs?

eg. PhotoRec and Restoration

Who knows, between them all you might recover almost everything intact.

Or, using the different programs might recover enough partials so that complete photos can be stitched together.
Logged
Four wheel drive: Helping you get stuck faster, harder, further from help...........and it's no different on this forum Evil
IainB
Supporting Member
**
Posts: 3,140


Slartibartfarst

see users location on a map View Profile Give some DonationCredits to this forum member
« Reply #14 on: November 12, 2011, 12:18:28 AM »
In hope that this might help:
You say you moved the image files from "A" to "B" (i.e., from card to computer) - right?
Have you been able to prove that the images:
are corrupt on "B" (e.g., say by using another image viewer), and
are equally corrupt on "A" (e.g., by viewing them in the camera's display)?

Not sure if you have already considered this, but if the image files were deleted on the "A" (card) during the move, they will be relatively easily recoverable/undeleted, unless you have overwritten that card with any data since the move. Just recover them to another device though.

I have had similar difficulties as this in the past, when plugging in camera cards to my laptop. I found that it's safest to use the software that comes with the camera to transfer files to my laptop - either directly from the camera or from the card when it had been inserted into my laptop's car-reader. If I didn't use that software, then I found it could sometimes cause card corruption and the card had to be reformatted in the camera before it could work properly again.

I assumed that the cause of this was possibly due to the camera manufacturers using proprietary formats for their card formatting and sophisticated on-card writing operations in-camera - e.g., when carrying out in-camera image edits.
Logged
Curt
Supporting Member
**
Posts: 5,888


Trial all, keep only the best

see users location on a map View Profile Read user's biography. Give some DonationCredits to this forum member
« Reply #15 on: November 12, 2011, 11:42:59 AM »
regarding




I am not an expert, but I have seen this error many times, and in my cases it never had to do with the camera or the card. The fact that you were able to recover a perfect example of the same file, should imply the same conclusion. In my situations it was always the transfer itself, the "safe as" or "move to". Of course this particular card may improve from re-formatting, but in general my best bet is, to try a more easy-going "Copy/Move"-program.
Logged
Remember what you said, because in a day or two, I'll have a witty and blistering retort! You'll be devastated THEN!
IainB
Supporting Member
**
Posts: 3,140


Slartibartfarst

see users location on a map View Profile Give some DonationCredits to this forum member
« Reply #16 on: November 12, 2011, 08:46:18 PM »
+1 for what @curt said: That's why I wrote:
Quote
I found that it's safest to use the software that comes with the camera to transfer files to my laptop - either directly from the camera or from the card when it had been inserted into my laptop's car-reader.
Logged
mouser
First Author
Administrator
*****
Posts: 30,962



plarker mouser see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #17 on: November 13, 2011, 12:57:26 AM »
This thread just confirms my general paranoia against ever using a "move" operation for more than one file or for sensitive data.. Always copy, check, then delete.
Logged
IainB
Supporting Member
**
Posts: 3,140


Slartibartfarst

see users location on a map View Profile Give some DonationCredits to this forum member
« Reply #18 on: November 13, 2011, 02:35:26 AM »
+ 1 for what @mouser wrote: I assuage my paranoia to some extent by using xplorer² "robust copy" when moving/copying my critical/archive data around.
Logged
Pages: [1]   Go Up
  Reply  |  New Topic  |  Print  
« previous next »



[ may-june 2013 ad experiment; click here to learn more about donationcoder.com ]


 
Jump to:  
   Forum Home   Thread Marks Chat! Downloads Search Login Register  

DonationCoder.com | About Us
DonationCoder.com Forum | Powered by SMF
[ Page time: 0.052s | Server load: 0.49 ]