DonationCoder.com Forum

Main Area and Open Discussion => General Software Discussion => Topic started by: Contro on September 10, 2013, 04:20 AM

Title: Resident search inside eml files and thoses from Thunderbird
Post by: Contro on September 10, 2013, 04:20 AM
Resident search inside eml files and thoses from Thunderbird

I am very happy with search options like everything, Qiqqa, DocFetcher, but this last only index pst files from Outlook

I would like a resident and seperate tool for background indexing of my email files.

Best Regards
 :P
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: tomos on September 10, 2013, 05:58 AM
I thought eml files were just like text files (yes - I just opened one in notepad), i.e. I wouldn't have thought that any search and/or indexing programme would have a problem reading them.
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: Contro on September 10, 2013, 06:11 AM
 :-\

But don't forget the msf files from TB
I usually collect some emails to my folders in eml format, but the gross is in msf format.

DocFetcher can manipulate txt files. Or files similar.
What do you think about OSForensic from Passmark
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: Contro on September 10, 2013, 02:51 PM
I think I have seen that windows search under seven may index the emails.
I don't know.
Is possible configure windows search to look only inside emails ?
I don't want to renounce to my wonderful Everything
 :-[
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: 4wd on September 10, 2013, 07:59 PM
But don't forget the msf files from TB
I usually collect some emails to my folders in eml format, but the gross is in msf format.

Each Thunderbird mail folder is stored in two files named after this mail folder name:
  •    File with no extension stores email messages in the plain text format, one after one. This file is larger than the MSF index.
  •    A corresponding (smaller) .MSF file contains mail folder indexes and preference data. Thunderbird figures out what part of the message to be displayed, the order of messages within a folder, and the like - all based on the .MSF file information. It is important to note that .MSF files do not contain any email messages and, all in all, are redundant. Thunderbird will rebuild .MSF files as needed if they are missing.

MSF files are just indexes, all your emails are stored in plain text in the files with no extension, eg. Drafts, Sent Mail

[ You are not allowed to view attachments ]
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: Shades on September 10, 2013, 11:14 PM
To search through mail (and attachments) my accounts have collected throughout the years, I use MailStore Home. That particular version is free (and available in portable format on www.portableapps.com).

It finds more concise results to any search query when compared with the search capabilities of Thunderbird, my email client of choice. It also serves as a backup of your mail and it allows you to convert mail to different formats so the messages in MailStore home can be exported to the mail client of your choice.

No affiliation, just a (very) content user.
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: PhilB66 on September 10, 2013, 11:45 PM
(and available in portable format on www.portableapps.com).
Link please.
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: Contro on September 11, 2013, 03:18 AM
To search through mail (and attachments) my accounts have collected throughout the years, I use MailStore Home. That particular version is free (and available in portable format on www.portableapps.com).

It finds more concise results to any search query when compared with the search capabilities of Thunderbird, my email client of choice. It also serves as a backup of your mail and it allows you to convert mail to different formats so the messages in MailStore home can be exported to the mail client of your choice.

No affiliation, just a (very) content user.

I use too. One year or more using. Totally according with you.
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: Contro on September 11, 2013, 03:22 AM
(and available in portable format on www.portableapps.com).
Link please.

Mail Store Home (http://www.mailstore.com/en/mailstore-home.aspx)

I install in portable way.

Is not background indexing I think. Takes a time to index the files and recently i was using specially to search in my sent emails because I have a lot off accounts.

But I have integrated a sent folders with my accounts.
I must revise when I create another one....

 :-[

I use the concept of virtual folder or saved search (http://kb.mozillazine.org/Saved_Search)
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: Contro on September 11, 2013, 03:31 AM
But don't forget the msf files from TB
I usually collect some emails to my folders in eml format, but the gross is in msf format.

Each Thunderbird mail folder is stored in two files named after this mail folder name:
  •     File with no extension stores email messages in the plain text format, one after one. This file is larger than the MSF index.
  •     A corresponding (smaller) .MSF file contains mail folder indexes and preference data. Thunderbird figures out what part of the message to be displayed, the order of messages within a folder, and the like - all based on the .MSF file information. It is important to note that .MSF files do not contain any email messages and, all in all, are redundant. Thunderbird will rebuild .MSF files as needed if they are missing.

MSF files are just indexes, all your emails are stored in plain text in the files with no extension, eg. Drafts, Sent Mail
 (see attachment in previous post (https://www.donationcoder.com/forum/index.php?topic=36075.msg337472#msg337472))

Thanks a lot 4wd

I was wondering why appear in the web utilities like docFetcher able to search inside pst files, but not so many utilities to search in the specific folders of Thunderbird. I suppose msf because I see somewhere. Perhaps in OSForensics Passmark ?

Nooooo.
What email formats are compatible with OSF (http://www.osforensics.com/faqs-and-tutorials/which-e-mail-formats-are-compatible-with-osforensics.html)

The very good news are that are simple text.
Because in that case sure DocFetcher can make his labour.

OSForensics don't seems index in background and hangs after more than one day indexing. That was my particular experience.

 :-\
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: Contro on September 11, 2013, 03:34 AM
What I would like ?

Simple.
An effective background index programmated to search structurally in the contents of the email.
DocFetcher seems able to do, but not structurally in the sense of determine the sender, the receiver, the subject and so on.
MailStore does, but is not background indexing.

Anyone has tried with the addon for windows search in windows 7 ?
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: Contro on September 11, 2013, 03:53 AM
(and available in portable format on www.portableapps.com).
Link please.

Mail Store Home (http://www.mailstore.com/en/mailstore-home.aspx)

I install in portable way.

Is not background indexing I think. Takes a time to index the files and recently i was using specially to search in my sent emails because I have a lot off accounts.

But I have integrated a sent folders with my accounts.
I must revise when I create another one....

 :-[

I use the concept of virtual folder or saved search (http://kb.mozillazine.org/Saved_Search)



I found a interesting article about. It's not a paf, but mailstore is good portable in the classic sense (don't write in the windows registry). I have good residents that are not independent in the sense they need Java o Framework.

Big issue with backup/restore (http://portableapps.com/node/25623)

Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: PhilB66 on September 11, 2013, 06:27 AM
(and available in portable format on www.portableapps.com).
Link please.

Mail Store Home (http://www.mailstore.com/en/mailstore-home.aspx)

I install in portable way.
That does not render the application portable.
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: Contro on September 11, 2013, 07:02 AM
(and available in portable format on www.portableapps.com).
Link please.

Mail Store Home (http://www.mailstore.com/en/mailstore-home.aspx)

I install in portable way.
That does not render the application portable.

Yeahhhh
 :-[
At the present moment i have more GB of space in a data disk with programs in portable mode than in the system disk.
In the past was very useful for me because of my multiple startup, but now with the limitation of the windows 7 license.....
Of course we have the virtual machines under xp.
 :tellme:
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: PhilB66 on September 11, 2013, 07:20 AM
(and available in portable format on www.portableapps.com).
Link please.

Mail Store Home (http://www.mailstore.com/en/mailstore-home.aspx)

I install in portable way.
That does not render the application portable.

Yeahhhh
 :-[
At the present moment i have more GB of space in a data disk with programs in portable mode than in the system disk.
In the past was very useful for me because of my multiple startup, but now with the limitation of the windows 7 license.....
Of course we have the virtual machines under xp.
 :tellme:
Que?

MailStoreHomePortable saves some settings to the registry plus other stuff in AppData = not portable.

@Shades
Where can I get the paf version from?
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: 4wd on September 11, 2013, 08:10 AM
Perhaps here: MailStore Home Portable 8.1.0.9075 (http://www.thinstallsoft.com/mailstore-home-portable/)

Except the interface seems to be in Japanese.

Fixed, just delete all the language folders in MailStoreHomePortable\Application, (ie. all folders except Firebird_x86).
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: Contro on September 11, 2013, 02:07 PM
(and available in portable format on www.portableapps.com).
Link please.

Mail Store Home (http://www.mailstore.com/en/mailstore-home.aspx)

I install in portable way.
That does not render the application portable.

Yeahhhh
 :-[
At the present moment i have more GB of space in a data disk with programs in portable mode than in the system disk.
In the past was very useful for me because of my multiple startup, but now with the limitation of the windows 7 license.....
Of course we have the virtual machines under xp.
 :tellme:
Que?

MailStoreHomePortable saves some settings to the registry plus other stuff in AppData = not portable.

@Shades
Where can I get the paf version from?

That's the way Phil.
"Hilas fino"
You observ the details
 :-*
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: PhilB66 on September 12, 2013, 05:50 PM
Perhaps here: MailStore Home Portable 8.1.0.9075 (http://www.thinstallsoft.com/mailstore-home-portable/)

Except the interface seems to be in Japanese.

Fixed, just delete all the language folders in MailStoreHomePortable\Application, (ie. all folders except Firebird_x86).
Thank you for the link, 4wd. I could not find any information about license/distribution of this package. Not sure it's legal. This paf version creates a folder in \user\all\firebird and I also found some entries in the registry at HKEY_CURRENT_USER\Software\Deepinvent\MailStore\Client Settings
HKEY_CURRENT_USER\Software\Deepinvent\MailStore
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: Contro on September 12, 2013, 08:36 PM
Seems difficult search inside TB in background mode indeed
And structurally of course, with definition of fields.
 ;D
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: 4wd on September 12, 2013, 09:29 PM
This paf version creates a folder in \user\all\firebird and I also found some entries in the registry at HKEY_CURRENT_USER\Software\Deepinvent\MailStore\Client Settings
HKEY_CURRENT_USER\Software\Deepinvent\MailStore

What you're after is Portable & Stealth - not just portable.

The reg entry contains the GUI window coords & size and the folder is empty after running - things that can be easily fixed by creating a batch file with a couple of extra commands.
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: Contro on September 13, 2013, 08:59 AM
 :huh:
Portable or not portable the interesting point is searching structurally inside all types of files from Thunderbird. That, of course, can be a portable program too.
But I only have in portable way. That is for me :
Install TB in a data disk (over my disk y: data disk, not in the system). Why ? Because in my old windows xp I share this installation between the differents installations under the same windows xp pro ....
I don't need to install in a usb drive, by example.
And I think too is an advantage because i have configuration and data in a data disk continually backing up to my security copies disk.
Is my system collapse I have the emails in other places. And I don't have to worry about so much installation in the system.
I try to install all i can in portable way. Even if the program have dependencies like net framework, java, etc.
Sometimes in "this portable way" i had to reinstall the program in every system because write fragments in the registry or even in some folders in the system.
Others cases for me had been when the installer only let me install on the system, but really the program is almost portable. So I copy the installation folder to my data disk and execute from there. Many times give me good results and no additional problems.

Usually some absolutely not portable programs are fat software.

 :-[
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: PhilB66 on September 13, 2013, 08:46 PM
Yes, 4wd, I will make a wrapper to delete the registry keys / folder after exit. Many thanks.
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: Shades on September 13, 2013, 09:05 PM
Sorry, I had no time to respond earlier.  The version of MailStore I use is: 4.2.1.6501 (came out early 2011) and at the time I found the portable version easily.

If you want I can PM the archive I created from that software package (it's around 8MByte) as I am not sure if attaching that package to this post is legit.
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: Contro on September 14, 2013, 10:24 AM
Grrrrrnnnnnnnn grrrrrrrrrr ngggggg ngggnnnnnn
I don't find good software for background indexing.
 :(
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: PhilB66 on September 14, 2013, 11:12 AM
If you want I can PM the archive
Thanks, Shades, but that's not needed. I should be able to create a wrapper working with the latest official release. Cheers.
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: Contro on September 14, 2013, 02:22 PM
I don't find a resident or background indexing program.

But some day I will
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: tomos on September 14, 2013, 02:49 PM
I don't find a resident or background indexing program.

But some day I will

have you looked at any of the desktop search programmes?
There was an old thread about them resurrected here lately:
https://www.donationcoder.com/forum/index.php?topic=2434.msg337045#msg337045
"What is the currently best Desktop Search software?"
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: Contro on September 14, 2013, 03:12 PM
I don't find a resident or background indexing program.

But some day I will

have you looked at any of the desktop search programmes?
There was an old thread about them resurrected here lately:
https://www.donationcoder.com/forum/index.php?topic=2434.msg337045#msg337045
"What is the currently best Desktop Search software?"

Yeapp. But the point is look inside TB...
But I'll try revising the post.
Best Regards
 :-*
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: tomos on September 14, 2013, 03:40 PM
But the point is look inside TB...

we are going around in clircles.

4wd said:
all your emails are stored in plain text in the files with no extension, eg. Drafts, Sent Mail

which means there should be no problem indexing them - or am I misunderstanding something?
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: Contro on September 14, 2013, 03:51 PM
But the point is look inside TB...

we are going around in clircles.

4wd said:
all your emails are stored in plain text in the files with no extension, eg. Drafts, Sent Mail

which means there should be no problem indexing them - or am I misunderstanding something?

But Tomos is not structured search like in MailStore Home I think
That's the reason
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: tomos on September 14, 2013, 04:17 PM
Okay, got you.
I'm no expert, so I'm not going to be able to help much - I'm just trying to figure out what *exactly* the problem is. (I'm also unhappy with Thunderbird search btw - maybe we just need a better email client :-/ )

So, by 'structured', do you mean - tell me where (in which folder: sent/inbox/etc) the email is located (?)
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: Contro on September 14, 2013, 04:22 PM
Okay, got you.
I'm no expert, so I'm not going to be able to help much - I'm just trying to figure out what *exactly* the problem is. (I'm also unhappy with Thunderbird search btw - maybe we just need a better email client :-/ )

So, by 'structured', do you mean - tell me where (in which folder: sent/inbox/etc) the email is located (?)

Search in the subject, in the message, in the sender.
But I suppose I am talking nonsense.

In the post seems good for this purpose :

Archivarious 3000
dtSearch
File Locator pro

All seems to go well.

I gonna to try first.
 :P
Title: Re: Resident search inside eml files and thoses from Thunderbird
Post by: Contro on September 14, 2013, 04:38 PM
Archivarius seems perfect
 ;D