Welcome Guest.   Make a donation to an author on the site July 25, 2014, 03:39:06 PM  *

Please login or register.
Or did you miss your validation email?


Login with username and password (forgot your password?)
Why not become a lifetime supporting member of the site with a one-time donation of any amount? Your donation entitles you to a ton of additional benefits, including access to exclusive discounts and downloads, the ability to enter monthly free software drawings, and a single non-expiring license key for all of our programs.


You must sign up here before you can post and access some areas of the site. Registration is totally free and confidential.
 
The N.A.N.Y. Challenge 2011! Download 30+ custom programs!
   
   Forum Home   Thread Marks Chat! Downloads Search Login Register  
Pages: [1]   Go Down
  Reply  |  New Topic  |  Print  
Author Topic: IDEA: mount virtual folders  (Read 2588 times)
blauand
Supporting Member
**
Posts: 4

View Profile Give some DonationCredits to this forum member
« on: May 02, 2010, 03:12:07 PM »

Hi,
Assign files and folders to a virtual folder and mount it to be accesible for the file system.
We are dealing, at this moment, with +75.000 files in multiple locations.

1- only files are to be listed, when a folder is dropped to the VF this has to add (recursively) only the files.
The result is just one VF with only files inside.
2- automatic synchronize (or user dependant), for new or deleted files on the original folders.

If anyone has used Directory Opus, it's a little like its Collections feature, to get you an idea.

cheers
blau

Logged
f0dder
Charter Honorary Member
***
Posts: 8,774



[Well, THAT escalated quickly!]

see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #1 on: May 02, 2010, 03:23:51 PM »

NTFS Junctions wouldn't cut the cheese?
Logged

- carpe noctem
blauand
Supporting Member
**
Posts: 4

View Profile Give some DonationCredits to this forum member
« Reply #2 on: May 03, 2010, 01:03:04 PM »

i'll take a look into it
thans f0dder
Logged
f0dder
Charter Honorary Member
***
Posts: 8,774



[Well, THAT escalated quickly!]

see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #3 on: May 03, 2010, 01:10:11 PM »

i'll take a look into it
thans f0dder
Let's know how it works out - NTFS junctions have a number of quirks and limitations, so might not be perfect... unfortunately I misread your post, they won't solve your point #1 - each junction will appear as a subfolder under the main folder.

I'm not sure trying to have 75k files in a single folder (even if it's virtual, with the real files in multiple subfolders scattered around) is a good idea - some applications might not deal with that amount of files very well smiley
Logged

- carpe noctem
blauand
Supporting Member
**
Posts: 4

View Profile Give some DonationCredits to this forum member
« Reply #4 on: May 05, 2010, 05:08:10 AM »

I've read a lot these past two days about Junctions, hardlinks and softlinks and as you said  i couldn't find a solution for point #1, seems there is no program/script that allows to have one junction to many target (only content) folders at once.
I can think of another approach.
Get a list of all files at source dirs, compare them to destination dir containing  harklinks, skip the existing, and copying as hardlinks the new found. Not a beautiful solution with that amount of  files but it can do the work.
Do you think this can be done?
I've tried with diropus internal COPY MAKELINK=hardlink WHENEXISTS=skip
but it don't skip existing files it just append (1) and make a new file.

cheers
blau
Logged
f0dder
Charter Honorary Member
***
Posts: 8,774



[Well, THAT escalated quickly!]

see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #5 on: May 05, 2010, 05:25:43 AM »

Such an approach would probably work, but the process of updating the links could be slow - if having a monitoring program (on the system hosting the "master folder") running at all times is acceptable, the overhead could be reduced. Keep in mind that hardlinks onlycan't reach out to remote machines, or even files on another partition. Vista introduced symlinks which don't have this restriction.
Logged

- carpe noctem
Target
Honorary Member
**
Posts: 1,382



see users location on a map View Profile WWW Give some DonationCredits to this forum member
« Reply #6 on: May 05, 2010, 06:37:13 PM »

I may not have understood what it is you're asking for, but could you not leave the files where they are and setup a folder with shortcuts to the content?

it should be pretty trivial to setup a script to monitor the source folders periodically and update the shortcuts, and you could use a junction to map the folder...

of course this presupposes that all the source files are accessible to all the users....
Logged

"Look wise, say nothing, and grunt. Speech was given to conceal thought" - Sir William Osler
blauand
Supporting Member
**
Posts: 4

View Profile Give some DonationCredits to this forum member
« Reply #7 on: May 07, 2010, 08:04:10 AM »

@f0dder
Almost did it! smiley
XXCOPY  has /SG switch that gathers files into one-level directory and it works as intended.
It also has another one to copy files as hardlinks /MLH.
Then while xxcopy c:\sourcedir\nesteddirs c:\destdir /SG works nicely for normal files.
xxcopy c:\sourcedir\nesteddirs c:\destdir /SG /MLH just copy as hardlinks the files, if any, from the source dir but ignores the files from nested dirs.
But well, it's a little more progress.
BTW are you the same f0dder in osnews.com?

@target
Is it possible to do the same but instead of shortcuts, hardlinks or softlinks?

thanks both smiley
Logged
Pages: [1]   Go Up
  Reply  |  New Topic  |  Print  
 
Jump to:  
   Forum Home   Thread Marks Chat! Downloads Search Login Register  

DonationCoder.com | About Us
DonationCoder.com Forum | Powered by SMF
[ Page time: 0.028s | Server load: 0.16 ]