topbanner_forum
  *

avatar image

Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
  • Tuesday March 19, 2024, 4:23 am
  • Proudly celebrating 15+ years online.
  • Donate now to become a lifetime supporting member of the site and get a non-expiring license key for all of our programs.
  • donate

Author Topic: SOLVED: Copy massive folder/file directory....  (Read 25562 times)

nkormanik

  • Participant
  • Joined in 2010
  • *
  • Posts: 552
    • View Profile
    • Donate to Member
SOLVED: Copy massive folder/file directory....
« on: June 22, 2014, 09:08 PM »
Task seems pretty straight-forward:

One hard disk.  Two partitions.

On Partition 1 is folder PF1.  On Partition 2 is folder PF2.

In PF2 resides a complicated folder-file-structure set totaling 400 gigabytes.

Challenge:

Copy contents of PF2 to PF1.

Results must be PF2=PF1.  No errors.  Same total number of files and folders, as seen in Windows Explorer, Properties.

=====

System is Windows 7, 64-bit.  8 gigs memory.  Plenty of room on hard disk.

=====

Problem is, Windows chokes.  Gets part way through the task, then stops.  Computer sometimes automatically reboots (what an a**hole!).

As you can imagine, unless the task gets 100% completed, with some final message saying so, trust and confidence is shattered.

I've been searching for answers and other possible programs to use.  So still hopeful.

Just wanted to put this thread out there.  Any thoughts and observations welcome.

Nicholas Kormanik


lanux128

  • Global Moderator
  • Joined in 2005
  • *****
  • Posts: 6,277
    • View Profile
    • Donate to Member
Re: SOLVED: Copy massive folder/file directory....
« Reply #1 on: June 22, 2014, 09:50 PM »
there are several file-copy tools that can do this. have you tried any of these: teracopy, robocopy, xxcopy?

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member

nkormanik

  • Participant
  • Joined in 2010
  • *
  • Posts: 552
    • View Profile
    • Donate to Member
Re: SOLVED: Copy massive folder/file directory....
« Reply #3 on: June 22, 2014, 11:35 PM »
Teracopy chokes after as little as 10 gig.  Consistently.  Every time.

Just tried FastCopy.  Went into the other room to eat dinner.  Came back and computer had rebooted.

Good grief.


tomos

  • Charter Member
  • Joined in 2006
  • ***
  • Posts: 11,958
    • View Profile
    • Donate to Member
Re: SOLVED: Copy massive folder/file directory....
« Reply #4 on: June 22, 2014, 11:56 PM »
A sync programme?
I use Syncovery, cant say I've ever copied such a large/complex amount, but I'd be surprised if it didnt manage.
Not sure how the free offers would cope.
Tom

lanux128

  • Global Moderator
  • Joined in 2005
  • *****
  • Posts: 6,277
    • View Profile
    • Donate to Member
Re: SOLVED: Copy massive folder/file directory....
« Reply #5 on: June 23, 2014, 12:02 AM »
just a thought, check both partitions with scandisk before any copy attempts.

skwire

  • Global Moderator
  • Joined in 2005
  • *****
  • Posts: 5,286
    • View Profile
    • Donate to Member
Re: SOLVED: Copy massive folder/file directory....
« Reply #6 on: June 23, 2014, 12:03 AM »
All this computer-rebooting has me thinking that something is wrong with the computer or, at the very least, with the drives you're messing with.

Have you tried to determine what is causing the computer to reboot?  Is this one of those cases where a blue screen is causing an automatic reboot?  If so, that "feature" can be turned off so the blue screen stays there, possibly enabling you to get some clues as to why this is rebooting.

nkormanik

  • Participant
  • Joined in 2010
  • *
  • Posts: 552
    • View Profile
    • Donate to Member
Re: SOLVED: Copy massive folder/file directory....
« Reply #7 on: June 23, 2014, 12:15 AM »
Good idea, Skwire.  I sure could use a clue or two.

And, lanux128, disk scan seems totally reasonable.  What I'm actually copying from, though, is a mounted Acronis backup (disk image from another computer, old XP system).


skwire

  • Global Moderator
  • Joined in 2005
  • *****
  • Posts: 5,286
    • View Profile
    • Donate to Member
Re: SOLVED: Copy massive folder/file directory....
« Reply #8 on: June 23, 2014, 12:38 AM »
mounted Acronis backup

Ahhh...that's key.  I've never used this product myself but I have heard the stories over the years of how it works for some folks and not at all for others.  It seems very finicky.  Knowing this, and knowing what sort of low-level file system drivers are at play, I wouldn't be surprised if your rebooting is due to a bad Acronis-related file system driver causing a blue screen.  That's my guess anyway.
« Last Edit: June 23, 2014, 08:15 AM by skwire »

Target

  • Honorary Member
  • Joined in 2006
  • **
  • Posts: 1,832
    • View Profile
    • Donate to Member
Re: SOLVED: Copy massive folder/file directory....
« Reply #9 on: June 23, 2014, 01:08 AM »
I don't know what your folder structure looks like but could you break it up into smaller lots?


x16wda

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 888
  • what am I doing in this handbasket?
    • View Profile
    • Read more about this member.
    • Donate to Member
Re: SOLVED: Copy massive folder/file directory....
« Reply #10 on: June 23, 2014, 05:25 AM »
I've used FreeFileSync for similar tasks, although never quite 400gb worth (~50 was my max) and never from an Acronis disk (although I've copied 10gb over a vpn connection, and smaller amounts to TrueCrypt volumes). FWIW.
vi vi vi - editor of the beast

MilesAhead

  • Supporting Member
  • Joined in 2009
  • **
  • Posts: 7,736
    • View Profile
    • Donate to Member
Re: SOLVED: Copy massive folder/file directory....
« Reply #11 on: June 23, 2014, 07:11 AM »
I would give RichCopy a try.

I used it to copy Windows.old folder.  I forget the size.  But I remember there were more than 256,000 files/folders in it.  The target was a mapped network drive.  Virtual drive to same physical disk may be a bit tougher.  But this freebie was written by an MS employee no doubt dismayed by existing OS copy tools.

Edit:  What I noticed when I tried to use Explorer was I ran out of patience as it counted how many files it was going to copy.  RichCopy is multithreaded and starts copying right away.  Also it has a pause/resume mechanism.
« Last Edit: June 23, 2014, 07:40 AM by MilesAhead »

Renegade

  • Charter Member
  • Joined in 2005
  • ***
  • Posts: 13,288
  • Tell me something you don't know...
    • View Profile
    • Renegade Minds
    • Donate to Member
Re: SOLVED: Copy massive folder/file directory....
« Reply #12 on: June 23, 2014, 08:05 AM »
All this computer-rebooting has me thinking that something is wrong with the computer or, at the very least, with the drives you're messing with.

Have you tried to determine what is causing the computer to reboot?  Is this one of those cases where a blue screen is causing an automatic reboot?  If so, that "feature" can be turned off so the blue screen stays there, possibly enabling you to get some clues as to why this is rebooting.

That.

Windows pukes on large copies, but doesn't reboot.

mounted Acronis backup

Ahhh...that's key.  I've never used this product myself but I have heard the stories over the years of how it works for some folks and not at all for others.  It seems very finicky.  Knowing this, and knowing what sort of low-level file system drives are at play, I wouldn't be surprised if your rebooting is due to a bad Acronis-related file system driver causing a blue screen.  That's my guess anyway.

Another thing to try is turning off Acronis temporarily.

I had this exact problem before. And I use Acronis. I forget the details now as it was a while back, but I did get it solved... Now if only I could remember... I'm not sure if I wrote some software to do the job... I'll check later when I have time, but that will likely be a day or 2.
Slow Down Music - Where I commit thought crimes...

Freedom is the right to be wrong, not the right to do wrong. - John Diefenbaker

40hz

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 11,857
    • View Profile
    • Donate to Member
Re: SOLVED: Copy massive folder/file directory....
« Reply #13 on: June 23, 2014, 12:25 PM »
+1 w/Miles on RichCopy. I do some massive file moves for clients. It's never failed me.

However, I think part of the problem might be going from partition to partition on the same drive. You might be maxing the data buss or some internal scratch file Windows is using to keep track of what's going on. If that's what's actually happening, Windows is doing another one of those "graceful degradation & fails" you sometimes hear about.

reboot.gif

You might try dumping the file onto an external drive first and then copying back over to the partition you want it on.

Another alternative might be to boot off a Windows or Linux 'live' rescue-type CD/DVD and see if you can get the copy operation to work that way. Since they're running as minimalist OSes, these tools have very little overhead and few if any 'distractions' running in the background. That may allow your copy to complete without interruption.

Luck!
« Last Edit: June 23, 2014, 12:43 PM by 40hz »

nkormanik

  • Participant
  • Joined in 2010
  • *
  • Posts: 552
    • View Profile
    • Donate to Member
Re: SOLVED: Copy massive folder/file directory....
« Reply #14 on: June 23, 2014, 05:04 PM »
Mission accomplished.

FastCopy did the trick.  Using following parameters:  Buffer Size=64 MB; Max I/O Size=8 MB; Use OS buffer for reading.

No hiccups.  "Job Finished" message at end.

Thanks for all the input above, folks.  Greatly appreciate it.


David.P

  • Supporting Member
  • Joined in 2008
  • **
  • Posts: 206
  • Ergonomics Junkie
    • View Profile
    • Donate to Member
Re: SOLVED: Copy massive folder/file directory....
« Reply #15 on: December 03, 2019, 09:44 AM »
Hi @all,

Has someone already found a copier tool that is simple -- and that simply works?

It should preserve the modification date of folders, and also copy hidden folders as hidden.

Thanks heaps!

David.P

  • Supporting Member
  • Joined in 2008
  • **
  • Posts: 206
  • Ergonomics Junkie
    • View Profile
    • Donate to Member
Re: SOLVED: Copy massive folder/file directory....
« Reply #16 on: December 03, 2019, 10:02 AM »
Okay, I'm done.

I shall look no further and simply use the ingenious Freefile Sync, which does everything those st00pid specialized file copiers can't do properly -- and then even much more.

:)