Home Server: server virtualisation, what to choose?

I'm looking for virtualisation solutions for storage and OS for a home server. A sort of private cloud where I manage the storage space independently of the VM space.

This question focus on VM/server (or compute instance or server hypervisor) management and what would best suit my needs. (I have another question related to the storage management).

My use cases are:

One physical server
A backup VM server: rsync and other services running.
A personal cloud VM server: a kind of owned dropbox system, à la ownCloud. " users foreseen.
A media VM server: streaming videos and displaying photos.

Here my environment and wishes:

Server: HP Proliant MicroServer with 8 GB RAM (AMD Turion dual core with AMD-V technology)
OS types for the VMs: only Linux (perhaps a *BSD VM in the future)
Linux distributions do not matter, I'm familiar with RHEL, Fedora, Suse, Ubuntu, but any other recommandation will be fine. I can make the jump to *BSD OS if better suited
2-3 hosted VMs are foreseen: backup server, owncloud server and media server (optional). Those are only servers, so no graphical console needed
By VM I mean a virtualised environment like KVM, Xen, etc. or a compute instance like with OpenStack
storage should be "virtualised/cloudified" see my other question. Thin provisionning would be awesome
VM should be able to be migrated to another server in the future if performance cannot be fullfilled anymore by the current server
It does not matter if installation of such setup is complicated as long as management tools allow for relatively easy maintenance
I don't have Windows at home, so solution should be Linux friendly and would be nice to be web based. But native apps are OK too.
System should be easy to enhance: by adding a new server to migrate some of the VMs to it. So it's really a kind of private cloud on which I could run some Linux OS.

I would prefer free (libre, as in a free speech) and open source tools. But it does not have to be free as in a free beer.

So Xen, KVM, VitualBox or OpenStack? Other solutions? What would you recommend?

Huygens

Posted 2012-07-08T11:01:00.287

Reputation: 1 340

I'm going to split this question in two and provide the second link here. As this question could end up with 2 good answers, one for the OS and one for the storage virtualisation, and I can only choose one good answer. – Huygens – 2012-07-09T07:54:13.190

Answers

For a home server setup using Linux exclusively, I would recommend KVM with virt-manager.

These are already included in most Linux distributions, and KVM is ready to use out-of-the-box. Xen and other hypervisors require additional setup.

Virt-manager is a nice gtk+ GUI app which lets you manage your virtual machines through libvirtd (which is also capable of managing Xen and some other hypervisors). It's also capable of managing remote hypervisors, so you need not go to the server machine at all.

Virt-manager is also capable of configuring and using advanced storage such as SAN/iSCSI within the GUI, though if your storage setup gets really exotic, you may have to go edit some config files.

As for distro for the host OS, I personally am using Fedora 17, though you could also use CentOS 6 (though KVM would be a bit older in this case).

This is what it looks like on my desktop managing local and remote virtual machines:

Michael Hampton

Posted 2012-07-08T11:01:00.287

Reputation: 11 744

Can you install Fedora 17 in "server mode", without X Window? Interesting, virt-manager can be used to manage a remote KVM then? – Huygens – 2012-07-11T10:14:58.513

Yes, you can install Fedora as a server without the graphical desktop. This is one of the choices during installation. Also the virt-manager wiki has explanations of how to set up the various remote access methods.

– Michael Hampton – 2012-07-11T16:48:24.330

This could be my final solution. Though I would need two tools. One for managing the host hypervisor (Ajenti seems pretty cool), and then virt-manager for managing the guest VMs. I'm still looking for something a bit more integrated, but I could end up using just that. Thanks! – Huygens – 2012-07-20T21:38:11.960

Huygens (great name btw! I have a cat named Titan :)),

I was wondering if the hardware listed (AMD Turion /w 8GB of RAM) was a planned purchase, or is it a system you already have in your possession? The reason I ask is if you are planning on running 2-3 VMs, with the possibility of adding more in the future, the box does sound slightly under powered IMHO.

Keep in mind I have 0 experience with doing any 'cloud' networking so I do not have a good idea of how resource heavy something like this might be.

Also, why have you eliminated VirtualBox as possible solution? You can create, delete, start, stop, virtual machines from the terminal just as easily as you can from the VirtualBox GUI (see http://www.virtualbox.org/manual/ch08.html).

VirtualBox meets many of your listed requirements (easy to enhance, works well on Linux hosts, can run various Linux guests). I have yet to try to add additional storage to VirtualBox VMs via the command line, but it does not seem like it would be too hard to figure out. And I know there is a web interface available for VirtualBox to allow for administration via your favorite web browser (see http://code.google.com/p/phpvirtualbox/)

Or it could just be I am stuck on VirtualBox. :)

Thanks

Richie

Richie086

Posted 2012-07-08T11:01:00.287

Reputation: 4 299

The hardware is a recent purchase. It should be enough, as (apart from the media server) the VMs are not too demanding. The backup one will be working about 10 minutes every hours and the "owncloud" VM would have 2 users. Both are IO sensitive and required few CPU power. So RAM and good HDD are dimensionning. I did not know VirtualBox add a remote management interface, I will check this out! Good point. – Huygens – 2012-07-09T07:51:41.930

I was kind of impress by this remote interface for VirtualBox. But it does not give me an overview of the host and guests status (apart from running, failed or stopped). It's a good tool though to create and modify a VM. – Huygens – 2012-07-20T21:40:46.183

I would look at openSUSE and try to build off that. Among the many useful things they have is Mirall for owncloud. Theres also projects like WebYast that will help you admin the server remotely, and other storage projects like mediatomb

alpha1

Posted 2012-07-08T11:01:00.287

Reputation: 1 638

Wow cool tool! I'll try it out to see if it has a command line in backend as I don't intend to install a graphical stack on the servers. – Huygens – 2012-07-09T07:57:28.773

WebYaST's goals are ambitious and really interesting, though it is still in early stages. So I have to do some more trial to see if it's already good enough to start with. – Huygens – 2012-07-20T21:50:08.967

I have a lab environment running on old hardware at home. I use OpenFiler to provide the storage and Citrix Xen as the hypervisor. I don't know if OpenFiler supports any sort of thin provisioning but Xen does support thin provisioning in LVM storage over iSCSI.

I haven't tried any other storage servers. I did try VMWare ESXi before settling on Xen but its hardware support didn't include the on-board LAN on the PC that I have re-purposed.

pipTheGeek

Posted 2012-07-08T11:01:00.287

Reputation: 1 217

I probably have to give another go at Xen/XCP. This thin provisionning and management of storage was not obvious. Now looking at the documentation I can see some interesting possibilities. Do you have a link to tutorial on this specific topic (storage management) for XCP? – Huygens – 2012-07-11T11:11:49.347

I haven't retried yet Xen/XCP... Not enough free time. I did though have a look at OpenFiler, but there is too little feee documentation about it and I didn't find it easy to configure after installation. With the available documentation for the bare commands (command line) I find it almost easier. Do you have some recommended online resources? – Huygens – 2012-07-20T21:35:44.070