Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [ceph]

Ceph is a free software storage platform designed to present object, block, and file storage from a single distributed computer cluster.

Ceph is a free software storage platform designed to present object, block, and file storage from a single distributed computer cluster. Ceph's main goals are to be completely distributed without a single point of failure, scalable to the exabyte level, and freely-available.

156 questions
3
votes
1 answer

CTDB Samba failover not highly available

TL;DR Failing a node in a ctdb + samba cluster while interacting with a share interrupts share connection. here and here state there is work in progress to make this possible here states it is already possible with Samba 3.0 (currently using…
Christoph Girstenbrei
  • 41
  • 8
3
votes
2 answers

Should io and cpu intensive servers be separated in kubernetes cluster?

We are designing a new cluster architecture for our web service and are planing to use Ceph object storage and kubernetes for our services. for optimizing our servers We have different options: Use identical servers and run Ceph and our services…
Mehran Akhavan
  • 153
  • 4
3
votes
1 answer

Slow fsync() with ceph (cephfs)

I have built an experimental ceph cluster - 12 nodes, 50 osds, 3 mons, 3 mds, for which I'm trying to run a samba gateway. It seems that when writing lots of small files, the fsync() system calls from samba will routinely block, presumably at the…
kdm
  • 31
  • 3
3
votes
1 answer

Will running Ceph (or similar systems) virtualized degrade its performance?

I am setting up a Ceph cluster. The client is asking for it to be done in virtual machines, one hypervisor / VM per server. Given my previous (minor) experience with virtual machines, I wonder if this will be a problem (hypervisors abstracting…
Turtle V. Rabbit
  • 183
  • 2
  • 8
3
votes
1 answer

Shared and replication filesystem support POSIX

I'm looking for opensource solution that support my use case. I have now 4 node on my cluster network and i need this. Store file system (huge list) Replication my file save on one node and replicate to another one. Shareding my files into 2 parts.…
sweb
  • 451
  • 1
  • 9
  • 27
3
votes
1 answer

ceph - can't start osd on rebooted cluster host

I've rebooted the server (one of ceph's hosts). Started the cluster, but the osd, that's on the host, which was rebooted is down. The osd's # is 2, so when I try: sudo /etc/init.d/ceph start osd.2 it shows: Starting ceph (via systemctl):…
igoryonya
  • 185
  • 1
  • 2
  • 14
3
votes
1 answer

ceph osd down and rgw Initialization timeout, failed to initialize after reboot

Centos7.2, Ceph with 3 OSD, 1 MON running on a same node. radosgw and all the daemons are running on the same node, and everything was working fine. After reboot the server, all osd could not communicate (looks like) and the radosgw does not work…
Tiina
  • 165
  • 2
  • 9
3
votes
1 answer

Make ceph minimize spread of file parts over OSDs

I am considering an option of ceph as distributed filesystem for my home-made MAID (massive array of idle drives). As far as I understand, Ceph oriented for cluster use and spread data evenly over OSDs (with respect to CRUSH maps) and tries to…
gordon-quad
  • 107
  • 1
  • 7
3
votes
1 answer

Ceph OSD always 'down' in Ubuntu 14.04.1

I am trying to install and deploy a ceph cluster. As I don't have enough physical servers, I create 4 VMs on my OpenStack using official Ubuntu 14.04 image. I want to deploy a cluster with 1 monitor node and 3 OSD node with ceph version…
user1802604
  • 131
  • 1
  • 3
3
votes
0 answers

Openstack Nova and Ceph Volume Attachment Issue

I am trying out the volume attachment function at Openstack (version:wallaby) to the server as additional device but failed. The volume backend is ceph which all of the osds are up and healthy. ceph-osd/38* active idle 0 …
ony4869
  • 33
  • 3
3
votes
0 answers

How to create Ceph OSDs on Partitions using cephadm, on ceph-pacific?

In the pacific version of Ceph, OSD creation is not allowing by cephadm on partitions.(We have NvMes with partitions). The command used is: ceph orch daemon add osd : The above command only accepts, disks or lvm, and throws error…
Arun Vinod
  • 41
  • 2
3
votes
1 answer

Ceph e5 handle_auth_request failed to assign global_id after a host outage

I have a small 3-host Ceph cluster with Ubuntu 20.04.1 and Ceph 15.2.5 using docker containers and deployed with cephadm. Yesterday one of the hosts (s65-ceph) had a power outage. The other two hosts continued working for a while but then s63-ceph…
Paolo Celati
  • 71
  • 1
  • 8
3
votes
2 answers

How to best use large NVMe array for VMWare Datastore

I recently acquired a Supermicro SYS-1029P-N32R with 16 14TB NVMe SSD's (Micron 9300 Pro) at work. We have 100 gigabit networking on the box to our VMWare hosts. We've tried using FreeNAS to host ZFS zvol's as iSCSI LUNs, but were unimpressed with…
imichaeldotorg
  • 31
  • 2
3
votes
0 answers

Ceph Rados GW Proxy

I've been given an access key to a Ceph cluster that runs radoswgw to provide S3. The key allows bucket creation, object reading etc. I don't admin the Ceph or radosgw. I have a group of users that want to use the Ceph object store, but need data…
Chris
  • 131
  • 1
2
votes
2 answers

MountVolume.MountDevice failed operation with the given Volume ID already exists

Environment: Kubernetes cluster with 1 master and 3 nodes Ubuntu 18.04.3 LTS (GNU/Linux 4.15.0-66-generic x86_64) (VMWARE VMs) screenshot from dashboard Pod (simple nginx image) cannot be mounted to a specified Volume in Kubernetes cluster with…
Alec
  • 23
  • 1
  • 5
1
2
3
…
10 11