I am running a server with 24G of RAM. The only thing running here is a MySQL server configured as Master.
When I check the memory via free -m I am getting this:
             total       used       free     shared    buffers     cached
Mem:         24158      24027        131          0        131      23050
Approx. 23G is in cache. Which seems a lot to me.
I also set caching to 0 in the my.cnf
query_cache_size        = 0
How can I check what is exactly cached? 
Also a restart of mysql doesn't clear the cache. A flush tables also didn't help.