Backup Gmail using Mail.app and IMAP without redundancy

9

2

I don't care for actually using mail app. I use it just for offline access, for eventual quick reading and even more eventually replying. I use mostly the gmail interface.

So I've setup and tuned up it with gmail and everything is working fine. I think I've followed every guide out there... Here's a great one. But I could find nothing about avoiding redundancy.

Well, I can manually do that either by using only POP or by checking off most of my labels out of IMAP. But I do use a lot of labels and I often label messages with more than 1. And I want them on mail app.

Is there anyway to make it keep just 1 copy of repeated messages? Maybe there's a message id or checksum that could be used...

If there isn't a way to do it, be assured I still prefer having the extra messages and "wasting" space rather than not having any.

edit:

I've came across many solutions for finding duplicate files, but they just delete the files. That make things worst because Mail.app will sync it all again.

I've realized it's probably better to keep two accounts setup, POP for backup and IMAP for everything else with removing the "All Mail" from it. That's because if the "All Mail" on the server is deleted for any reason, my "All Mail" local will also get deleted, while POP will keep all files regardless of the server. This doesn't solve the redundancy issue at all, but it doesn't create any new issue as well, and I can even use the search properly, without duplicated results, if I search just on the POP. So it helps optimizing a little bit.

But I still think the best way to solve this issue would be having something such as aamann's Mail Scripts tweaked to hardlinking the duplicates rather than deleting, and optimized to not need to scan everything every time. I'm trying to contact him and see what we can do.

At any pace, I'm still looking for a solution!

cregox

Posted 2010-02-27T15:47:21.187

Reputation: 5 119

Please read the FAQ, SU is not about web services. – None – 2010-03-02T22:48:22.207

Well, I want a solution on my Mac OS. Should I close this question? – cregox – 2010-03-02T23:12:41.697

I forgot to mention @Molly :P – cregox – 2010-03-03T16:15:05.927

dunno, but as of recently posts referring to web services (such as gmail) are getting closed. – None – 2010-03-03T17:23:07.637

If only we could get @Wouter and @Krazy_Kaos ideas together in one nice solution... – cregox – 2010-03-05T00:26:32.473

Regarding my previous answer: I'm sorry, I misunderstood. – dotHTM – 2010-03-08T23:31:06.580

@KioDane It's just fine, no sweat! You didn't need to delete it for me, if you did. ;) – cregox – 2010-03-09T00:04:12.350

@Cawas I deleted it because it was off topic, the wrong answer, and I didn't want to get voted down by anyone. I felt embarrassed that I had glossed over your question without reaching it's point. And while 10 or 15 points of reputation feels good here or there, I notice that losing 2 points for a vote down is seemingly more depressing. Good luck with your question! : D – dotHTM – 2010-03-09T15:01:54.423

Answers

1

Hmmm, I'm not aware of any off-the-shelf product that will let you do this.

However, if you ran something (such as an IMAP server with Maildir) that kept each email in a separate file and you used a filesystem with deduplication...

alex

Posted 2010-02-27T15:47:21.187

Reputation: 185

This is quite off-topic, but please tell me more about that filesystem with deduplication! I think I won't be able to use it yet, tho. – cregox – 2010-03-02T22:07:19.200

Well, there are not some many filesystems that support deduplication. The latest versions of ZFS do, but I hear ZFS is no longer supported in Mac OS X. I guess you could rune ZFS-fuse on Mac OS X, as Fuse works on OS X, but I'm not sure if ZFS-fuse has dedup yet.

Most other deduplication FS are commercial.

As an alternative, you might want to try a filesystem with compression. – alex – 2010-03-03T22:07:35.310

heard of ZFS, didn't know it was that nice. oh well, I guess most of us will still have to wait for a better solution on filesystem just yet. – cregox – 2010-03-05T00:12:27.937

1

I have spent many evenings trying to find a solution that would allow me to use GMail with all it's features (like labels) from within desktop application, but had no luck. So far the best solution I have found is to

Sergiy Belozorov

Posted 2010-02-27T15:47:21.187

Reputation: 1 704

Done that. Not quite a backup solution, but it's great for offline! :) – cregox – 2010-03-02T22:39:10.437

Backup is done by Google already. If by any chance their system will crash, then I believe they will provide a way to restore mail from your offline database. In other words, it is backup solution, but there is no tool that allows you to transfer messages stored in offline database back to GMail. – Sergiy Belozorov – 2010-03-03T10:51:09.103

You really should read more histories on people losing their gmail... Plus, take a look on http://www.dataliberation.org/ I even actually have a 200 GB storage on google, but it doesn't cost too much to play on the safe side.

– cregox – 2010-03-03T15:34:52.217

1

With Maildir one should be able to compare md5sum/sha1sum hashes and replace duplicate messages with hardlinks to the original (at least on Linux).

Wouter

Posted 2010-02-27T15:47:21.187

Reputation:

1Sure. That'd be nice and basically what I wanted. But are you telling me nobody did this before and that I should go and learn how to do it? – cregox – 2010-03-02T22:45:48.360

1

Well, just an idea, would a dupicate file find do the job (I'm assuming you got the mail on eml files, or anyway.... "files"), so if they are redundant, ther content will be exactly the same, and any duplicate file finder would find them

Some duplicate file finders:

Krazy_Kaos

Posted 2010-02-27T15:47:21.187

Reputation: 1 614

That's the idea! I'll check those out soon enough. But it sure would be better it was already done for the Mail.app – cregox – 2010-03-03T20:55:11.587

Sadly duper didn't work (it must have some bug on SL or something) and the other one has no mac version as far as I could tell. :( – cregox – 2010-03-05T00:11:26.330

On another note, I've briefly talked to Jon Kissel through email and he suggested this great solution: http://homepage.mac.com/aamann/Mail_Scripts.html but it would just delete my duplicates and not resolve my issue. I'd like more like hardlinking or something that won't mess the IMAP sync, like letting it get them all back again.

– cregox – 2010-03-05T00:25:32.770

After some google foo (I don't own a MAC), I found this site with lot's of duplicate finders (some free, some shareware): http://search.macupdate.com/search.php?keywords=find+duplicate+files&os=mac

– Krazy_Kaos – 2010-03-05T19:08:02.077

yeah, but finding duplicates and deleting them won't solve my issue - it will create more! Read the comments on the Question. – cregox – 2010-03-07T02:23:23.943