What is __MACOSX folder?

160

25

What are these __MACOSX folders I keep seeing in zip files made by people on OSX? Some take as much as 30% of the file.

What program are producing these __MACOSX folder and how can mac users avoid this mistake?

Yada

Posted 2010-02-03T22:37:02.983

Reputation: 1 841

8They are super-irritating, yes, and usually pointless as the resource forks are so often empty. But at least they're harmless, unlike the non-standard approach Apple have taken to >4GB archive sizes with the built-in OS X stuff, which will confuse any other tool and break again for sufficiently large files. And hey, it could be worse, it could be storing two copies of each file with the same name, one for the data and one for the resource fork, often making it impossible to access either, like pre-OSX Mac used to. Oh Apple, why do you hate standard file formats? – bobince – 2010-02-03T23:01:09.293

3@bobince: actually, resource forks were a very good idea ... at the time. These days, the same effect is achieved by storing resources as individual files, most of which look pretty much like standard file formats. – None – 2010-02-03T23:20:37.483

16Nothing wrong with metadata as such, it's just that Apple have such a knack of making up their own formats and messing up existing formats with gratuitously incompatible extensions! Having the content-type data as metadata is in itself a great thing and it saddens me that OS X is moving towards the Windows hack of file extensions as an alternative. Although this isn't as bad as on Linux, where the filesystem supports storing Content-Type metadata, but no desktops use it, preferring a thoroughly broken mixture of file-extension/name-patterns and content-sniffing (urgh!). Sigh, OSes eh? – bobince – 2010-02-03T23:33:37.563

Has anyone experienced an issue where when ziping and unziping a stale/empty version of file is used from __MACOSX. On a Windows machine the file is empty, on a Mac everything appears fine. If I didn't see it with my own eyes I would not believe it. – Daniel Sokolowski – 2018-05-24T16:02:11.763

@bobince Not entirely harmless. We've just encountered an issue, where Mac created zip files were triggering firewall rules, because of this folder. Re-zipping on windows fixes the issue. – user1751825 – 2019-08-22T04:35:23.930

@bobince: But yes, at least the format they made up for this does not do any real harm, other than slightly cluttering directory listings and wasting essentially 1 inode and 1 block per empty resource fork extracted, unless you use something like NTFS (which will store the file contents in the MFT for such small files), in which case it just wastes the "inode" (MFT entry). – SamB – 2011-02-15T20:52:07.880

10Can be fixed after the fact by zip -d filename.zip __MACOSX/\* – Chris Johnson – 2012-12-02T01:31:23.277

Answers

55

http://www.realsoftware.com/listarchives/gettingstarted/2005-09/msg00328.html

Apple provides built-in capability to ZIP files in OS X 10.3 and higher, and these files are the result of Apple storing Resource Forks safe manner. You would never see these files running OS X 10.3 or higher, but since Windows and other operating systems do not understand this special form of Resource Forks they will appear as you see them.

nickf

Posted 2010-02-03T22:37:02.983

Reputation: 2 081

4It's not just resource forks, anything beyond basic file contents gets put in the AppleDouble file. Apple's moving away from resource forks, but toward things like extended attributes that'll also get stored in the AppleDouble container. – Gordon Davisson – 2010-02-05T02:02:29.390

5Just discovered: if you're on a Mac, using the command line, unzip filename.zip will unpack the __MACOSX/ directory, which you don't want, but open filename.zip will do the right thing. – Edward Falk – 2016-06-22T18:40:08.150

2Empty, meaningless explanation. Just like everything apple. Wtf is a resource fork? oh it's garbage. gotcha! – Ярослав Рахматуллин – 2018-08-18T11:24:13.483

This is a lazy answer that relies solely on the link, which doesn't work anymore. – hmedia1 – 2019-02-13T06:42:48.907

15You make it sound like a feature. .zip files are intentionally lacking in the metadata department. If you want metadata, use a different format, not a Mac. Example of proper zip + metadata implementation: .jar – Zenexer – 2013-08-22T04:11:24.350

16dead link, please fix. – Lucas – 2014-02-02T03:24:52.143

72"since Windows and other operating systems do not understand"--Ugh. I just hate this kind of terminology – Joe Plante – 2014-04-23T02:38:45.677

110

Here's a link that explains it pretty well. I suppose it is a bit late to help Yada, but for posterity.

Explanation of resource fork at Wikipedia

The rest is my opinion:

@nickf: Never seeing these files is not a FEATURE of those OS X versions it is a FLAW.

People produce data, wrap it up, store it on different mediums and so on. They need to know what is needed or what is not needed. Hiding it keeps them in the dark.

The age old bad idea of hiding things from users:

A programmer, concerned with expediency of accomplishing his/her own work, abuses something in the domain of the end user, to make it easy for himself/herself.

In this case he/she stored meta data in the user's data space, he/she then hid it from the user. He/she missed the big picture: The user won't become aware of the hidden details. When he/she packages his/her data and ships it somewhere unanticipated by the programmer, missing parts won't get shipped or unknown parts will arrive which neither the user nor the recipient can explain.

Hiding things from the user is bad.

It assumes the user is stupid, when more accurately it is the programmer being stupid, or lazy.

To be clear, this bad habit is not confined to MAC. It is everywhere. It's a consequence of programmers falling in love with their own schemes and vendors prioritizing their own goals ahead of the needs of the end user.

In brief.

__MACOSX:
weird smelling programmer droppings emerging from under the rug where they were swept.

Programmers and vendors: Please keep things in the open. When you hide them, you make yourself stupid and the user uninformed.

pbernatchez

Posted 2010-02-03T22:37:02.983

Reputation: 1 501

15This answer would be better if it was just an answer. The extended ranting about stupid programmers and lazy users detracts from it. – Kristopher Johnson – 2015-06-19T13:15:41.587

1@pbernatchez Actually, if you stopped to learn about how things looked like and how they evolved, probably you wouldn't leave here your own ranty, arrogant "droppings". Resource forks were a (really nice!) implementation detail pre-Mac OS X and users only found them when interfacing with other systems; since the 90s, Apple has increasingly moved to a world without resource forks, but still bending backwards to keep compatibility. "Store metadata in the user's data space"? WTF? How twistedly do you have to define "metadata" and "user's data space" to say that? You must hate filesystems! – hmijail mourns resignees – 2017-01-20T12:28:04.453

3"Hiding things from the user is bad". Man, you must also hate all kind of user interfaces, and libraries, and abstraction, and... well, any kind of programming and computers more advanced than an abacus. – hmijail mourns resignees – 2017-01-20T12:39:51.463

6This does not answer the question. After reading this answer I still have no idea what metadata is contained in the _MACOSX folder, or what resource forks are. I guess people are upvoting this just because they agree with the rant? – Atte Juvonen – 2017-02-15T13:25:19.283

Here's another link that I think explains resource forks pretty well: http://xahlee.info/UnixResource_dir/macosx.html

– GDP2 – 2017-03-29T19:18:28.880

1While I agree that the emotionally-charged tone is not helpful, I also absolutely agree that creating hidden things that are occasionally needed is a really bad idea, precisely as stated in this answer: users will either (a) not ship hidden files that are needed, or (b) ship hidden files that the recipient can see and neither understand. These files should either be visible, or the data should be embedded in the files in some manner that is flagged as "skippable" by other OS's. Hidden files and directories should be used primarily to protect users, not keep them in the dark. – Mike Williamson – 2018-10-25T01:47:21.253

1Much better than the accepted answer – hmedia1 – 2019-02-13T06:43:35.523

If the wikipedia article explains it well, please quote the most relevant parts in your answer. – Michael P. Bazos – 2019-07-04T11:07:27.767

16

To answer your final question:

how can mac users avoid this mistake?

Mac OS X users can install a 3rd-party archiving utility like Keka, then tell it to not use Resource Forks, then set it as the default compressor.


How to do this with Keka

Tell Keka to not use Resource Forks

  1. Open Keka without a file (From Launchpad, Spotlight, etc.)
  2. Press ⌘ Cmd+, to open Preferences
  3. Select the Compression tab
    Keka "Compression" tab, selected
  4. Check "Exclude Mac resource forks (eg: .DS_Store)"
    A checkbox reading "Exclude Mac resource forks (ex: .DS_Store)"

Make Keka the default compressor

  1. In the same Keka Preferences window
  2. Select the General tab
    Keka "General" tab, selected
  3. Click "Set Keka as default compressor/uncompressor" [sic]
    enter image description here

Ben Leggiero

Posted 2010-02-03T22:37:02.983

Reputation: 424

1This could be improved my adding some information on the last 2 steps, "tell it to not use Resource Forks, then set it as the default compressor." – Steven C. Howell – 2016-02-16T21:17:53.597

@stvn66 Done! Just FYI, though, that's usually outside the scope of these questions, which is why I didn't at first. – Ben Leggiero – 2016-02-16T21:52:59.357

2Downvoting, sorry. I'm not a fan of installing 3rd-party software to fix a problem that can be fixed with the default software. As Chris Johnson pointed out above, zip -d will remove the resource forks from a zipfile. In fact, I think if you use zip in the first place, the resource forks don't get added in the first place. – Edward Falk – 2016-06-22T18:44:56.270

1@EdwardFalk That's fair! This answer was meant to solve the "How do I get it to always behave this way?" problem, not the "How do I get it to behave this way once?" one. – Ben Leggiero – 2016-11-09T14:24:07.180