Is it possible to speed up network filesystem by sth like unionfs, aufs?

Question

I need to speed up slow, large storage with local SSD drive. I figured out I could do this with union filesystems. Here are results with nginx reading data from:

local SSD alone: ~140 transactions/s.
large-slow storage alone: ~25 transactions/s
local SSD aufs-mounted with local dir and empty dir: ~30 transactions/s
local SSD aufs-mounted with local dir and large-slow storage dir: ~30 transactions/s
local SSD overlayfs-mounted with local dir and large-slow storage dir: ~140 transactions/s

As you can see, my bottleneck is aufs. Overlayfs with local+large-slow storage can be as fast as local harddrive but this is because it doesn't allow underlying filesystem to change (so it doesn't suit me).

Do you have any other ideas how to solve this problem?

interesting idea! however, in my case, it doesn't make any difference (most likely cpu is the bottleneck then). — Matt, Jul 31 '13 at 15:44

score 0 · Answer 1 · answered Jul 30 '13 at 18:14

0

Have you looked at CacheFS? If you are using RHEL or a variant - http://www.cyberciti.biz/faq/centos-redhat-install-configure-cachefilesd-for-nfs/

answered Jul 30 '13 at 18:14

Rik Schneider

2,419
14
19

I need to have more control over what's stored in "cache" (eg. every file with ".abc" extension). – Matt Jul 31 '13 at 15:46

Is it possible to speed up network filesystem by sth like unionfs, aufs?

1 Answers1