Local Network Mail (IMAP) server for backup old mails

0

Firstly a bit of context:

I'm managing a business network with 30 windows workstations, each one has Outlook installed and configured for an Exchange account. The Exchange server grant 4G of space per account, but many users will fill up this space quickly. Till now the solution was quick and dirt: a local pst archive where to tranfer all old emails to make room for new ones. It works, but, it's a local archive and need to be backed up regularly to prevent loss of the emails in case of problems with the pc. Backing up a pst file is...tricky, since Outlook need to be closed and a large file must be copied over the network (even 10G for some users) or using some incremental backups like rsync (a pain to setup). This could hardly be done automatically (just because Outlook need to be closed) and not all users are able/willing to.

---end context---

Yesterday i came up with an idea: Why not set up a local IMAP mail server and configure an IMAP account instead of the local pst file? This way all users could store theirs old emails in this local account that might be easily backed up on the serer.

But...it seem too easy...and i don't find any reference to alike solution till now, so i was wondering:

where is the problem? What am i missing? Do you think that this would be a viable solution?

UPDATE

New facts and problems:

  • IMAP is a bidirectional protocol (it permit to upload emails) *;
  • Outlook (and other email clients) will force to configure also a SMTP server, this should be solvable using a fake SMTP server (to be verified);
  • Upload emails to an IMAP account seem a slow process (to be verified on the local network);
  • This method could work, but still seem an overkill

*** Or it use SMTP to upload?

lelmarir

Posted 2014-02-11T14:41:06.613

Reputation: 113

Easier solution would be to archive every email recieved. This way users don't have to worry about backing up email unless they wanted to. There are commericial soluions to do this. – Ramhound – 2014-02-11T15:26:21.670

@Ramhound, that is not a good solution since it would also archive unwanted emails including SPAM, it might also create uncontrolled archives of sensitive emails. – Julian Knight – 2014-02-11T16:59:32.820

@JulianKnight - They have solutions that delete the spam and encrypt what emails remain. – Ramhound – 2014-02-11T17:05:47.603

That isn't stated. However, you could do that but now it is getting more complex as you have to make sure that you are doing things in the right order. In any case, you still are archiving far too much since most emails can be deleted - but only users know which. – Julian Knight – 2014-02-11T17:09:52.940

@Ramhound, Julian Knight is right, archiving all emails would be too much, and there is no way to set up an automatic filter (the only one that can tell if a mail is to be kept is the user) – lelmarir – 2014-02-11T17:35:13.000

Not sure who is voting this down - I think it is an excellent question. I've voted back up. – Julian Knight – 2014-02-11T19:29:16.177

IMAP has some odd side effects in Outlook that might be annoying to some of your users. You should probably test it if you opt to go that direction. Things like deleting items for instance require you to "purge" before they are deleted. They are not moved to the deleted items folder like a typical Exch connected mailbox is. But the suggestion for archiving all mail is a better all around solution as it can file mail by person and is designed for use case scenarios like these. Often as an admin you won't want the users to delete things and having another backup lets you "undo" mistakes. – MikeAWood – 2014-02-12T01:11:37.890

Answers

0

Rather than a local IMAP server, why not create a proper IMAP server and give people access as secondary accounts?

Typical IMAP servers will store the data in a format that is very easy to back up and recover.

I think that @thims's answer might be better though :)

One minor issue with either of these solutions is that I don't think that users can set these locations as the archive location so that they wouldn't be able to use Outlook's automatic archiving. (Not sure about that though - can anyone else clarify?)

Julian Knight

Posted 2014-02-11T14:41:06.613

Reputation: 13 389

Yes, this is exactly what i meant, with "local" i was only mean, on the local network (and without send/receive capability) , just to don't have to set up static public ip and dns. I may do without automatic archiving i imagine (from what i can see it only work with pst files). – lelmarir – 2014-02-11T17:51:47.763

Oh, OK. Sorry misunderstood. In that case, that is a perfectly OK idea. It has the advantage of being fairly easy to set up (the IMAP server is the easiest part of a open source mail setup) & it's easy to back up. – Julian Knight – 2014-02-11T19:25:14.563

0

Just setup Exchange Public Folders placing database on a reliable hard drive and grant appropriate permissions for users (say, one user per folder). After that each user will be able to select his/her public folder for archiving purposes.

thims

Posted 2014-02-11T14:41:06.613

Reputation: 8 081

I have forget to mention, the Exchange server is not mine, and the owner will charge any aditional space i'd request. Nor can i set up another Exchange server (becouse of the price). – lelmarir – 2014-02-11T17:39:13.207

Ok, then why not just put there archive PSTs right on your file server and connect them by LAN? This is not the best solution for PSTs in work, but may be suitable for archiving purposes. – thims – 2014-02-11T17:57:21.387

Some workstations are laptops, and even for desktop pcs, i'd don't trust the lan connection for a file that need to be locked by Otlook, this will surely leads to corruption soon or later. And when a laptop will disconnect it would lose the archive, instead imap can keep a local cache. – lelmarir – 2014-02-11T18:30:45.377

@thims - NO! That's not a good idea at all. It is a recipe for corrupted PST files. Not only do MS not recommend it, I can say from first hand experience it is a very good way to loose large amounts of data (though that keeps your archive space down!) – Julian Knight – 2014-02-11T19:27:08.290

@lelmarir: although using PSTs by LAN is not a good solution but IMAP will not work at all. – thims – 2014-02-12T12:17:32.627

@thims, why it will not? Till now the only problem that showed up is the need to purge deleted emails (and it is not a big problem). Could you explain more? – lelmarir – 2014-02-12T13:37:57.147

>

  • You can't backup any item type other than email message (see 2). 2. How're you going to backup messages? Drag-drop? Auto-archive? Both will not work: IMAP's OST can be purged anytime. Moreover, you will not be able to attach this OST later. Or you're planning to forward all mail using SMTP?
  • < – thims – 2014-02-12T13:58:21.300

    @thims, this is not a problem, i'm only concerned about "old" email messages, all others (calendar, contacts, ...) could live in the exchange account. The "How" depends by the users: some will immediatly archives emails (drag&drop) as soon as they receive them (manually, based on own criteria); some will drag&drop old emails only when the exchange account is full. But either way it's done manually (and i can't think an automated way of doing it: too many criteria). Could you elaborate "IMAP's OST can be purged anytime. Moreover, you will not be able to attach this OST later"? – lelmarir – 2014-02-12T14:30:33.967

    OST is a local cache file. It is not intended to store something permanently. And Outlook can't open OST files natively. If something will happen to user's profile and this will lead the user to re-create the profile or and account, you will loose all OST data. I event don't understand why do you need IMAP if you plan to store archives in local OSTs. This is a much worse way than local PSTs. One more time: if you drag'drop something to IMAP account's storage, it will not be synchronized with a server. IMAP is a one-side (download only) protocol. – thims – 2014-02-12T15:09:02.403

    Ok, now i get it. I was with the assumption that IMAP was bidirection (that i can upload mails) and you say it's not. Searching on google it seem to. If it is as you told (download only) you are right, storing a OST file is a bad idea, but if it is bi-directional it should work shouldn't it? Even if an OST file isn't mean to store mail permanently it should be stable enough to acces emails offline. Can someone confirm if IMAP can upload mails? (or i'll test it in the next days) – lelmarir – 2014-02-12T16:58:10.793

    IMAP is not a bi-directional. All IMAP accounts use SMTP for sending messages. You can see it for yourself: just try to add IMAP account and you'll be forced to configure outbound SMTP server. – thims – 2014-02-12T18:11:01.077

    I don't really need to "send" messages, it would be only a "storage" account, that can't receive or send emails. But you're right, i've tryed with my gmail account, and Outlook forced me to set an SMTP server, but this is not a big problem, i can set up a fake one (i think). I've tryed to transfer some of my emails, and...it's kinda slow, so this is the new problem. Is it becouse of the internet connection? Will it works faster on the local network? I'll update the question with these new items. – lelmarir – 2014-02-12T22:54:26.240