Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [ceph]

Ceph is a free software storage platform designed to present object, block, and file storage from a single distributed computer cluster.

Ceph is a free software storage platform designed to present object, block, and file storage from a single distributed computer cluster. Ceph's main goals are to be completely distributed without a single point of failure, scalable to the exabyte level, and freely-available.

156 questions
1
vote
1 answer

How to setup Ceph radosgw to support multi-tenancy?

What are the best options to setup the Ceph radosgw so it supports separate/independent "tenants"? What I'm after: Ensure isolation between tenants, ie: no overlap/conflict in bucket namespace; something separate radosgw "users" doesn't…
sxc731
  • 297
  • 2
  • 15
1
vote
0 answers

Unable to add initial monitor to Ceph in RHEL

I am trying to set up a Ceph cluster. I have 4 nodes - 1 admin-node, 1 monitor and 2 object storage devices. The installation guide I am using is given at the following location: http://ceph.com/docs/master/start/quick-ceph-deploy/. When I am trying…
Rui Teng
  • 11
  • 2
1
vote
1 answer

Set CRUSHMAP for 3 way on a two node cluster

I have an SSD storage system that contains two nodes with 6 SSD's drives. Not ideal, and so some point I will introduce another node. Right now I'm wanting 3 way replication though. Under a default rule, this won't happen because we only have two…
hookenz
  • 14,132
  • 22
  • 86
  • 142
1
vote
1 answer

After initial deployment Ceph cluster stays in active+degraded state

I've created a small Ceph cluster following quick start guide with one exception, I've used a separate disk for OSDs rather than a folder. Instead of ceph-deploy osd prepare node2:/var/local/osd0 node3:/var/local/osd1 ceph-deploy osd activate…
Swav
  • 189
  • 1
  • 7
1
vote
6 answers

Unable to add initial monitor to Ceph in Ubuntu

I am trying to set up a Ceph cluster. I have 4 nodes - 1 admin-node, 1 monitor and 2 object storage devices. The installation guide I am using is given at the following location: http://ceph.com/docs/master/start/quick-ceph-deploy/. When I am trying…
user3033194
  • 111
  • 1
  • 1
  • 3
1
vote
3 answers

How to mount ceph-fuse automatically with fstab?

# ceph -v ceph version 0.56.3 (6eb7e15a4783b122e9b0c85ea9ba064145958aa5) # repoquery -i ceph Name : ceph Version : 0.56.3 Release : 1.el6 Architecture: x86_64 Size : 26734691 Packager : Fedora Project Group : System…
quanta
  • 50,327
  • 19
  • 152
  • 213
1
vote
0 answers

Computing stripe count for erasure coded storage

I'm setting up a ceph cluster (first time for me) which in the end will be made of ~100 disks spread over 10 hosts. I'm going with a single erasure coded data pool to maximize disk space; my constraints are ~80% efficiency and a fault tolerance of 2…
Nicola Mori
  • 261
  • 1
  • 7
1
vote
0 answers

Ceph RGW: slow `list_bucket` requests

I have a ceph-rgw installation with a large bucket (~60M objects) and 16 osds, the bucket index is sharded into 997 shards. In this environment single directory listing takes more than 30 seconds: $ time rclone lsd t:bucket/non/existent/path/…
Taha Jahangir
  • 2,012
  • 1
  • 15
  • 16
1
vote
1 answer

Ceph: is setting lower "size" parameter on a live pool possible?

I have a 5-node Proxmox cluster using Ceph as the primary VM storage backend. The Ceph pool is currently configured with a size of 5 (1 data replica per OSD per node) and a min_size of 1. Due to the high size setting, much of the available space in…
Matthew U.
  • 13
  • 3
1
vote
1 answer

Recommended values for mon osd down out in ceph

Are there any recommended values for "mon osd down out"? The cluster has 15 nodes and 300 osds. It's running ceph Jewl. The default value in Jewel is 300 seconds. I was wondering, are there any benefits or downsides to changing the default value?
Alex Elshamouty
  • 41
  • 1
1
vote
0 answers

how to sync ceph bucket with scaleway s3 bucket or any s3 bucket for?

i,m trying to sync a ceph cluster to a scaleway s3 bucket i have the secret, access token and https endpoint for my s3 bucket ceph version: mimic i followed the cloud sync module guide at the following link…
moses
  • 83
  • 1
  • 12
1
vote
0 answers

Ceph-ansible: using the OS-SSD as cache

In ceph-ansible, you can specify a disk to be used for databases in the hosts file using the dedicated_devices directory. Example: hosts: stor01.hostname.com devices: ['/dev/sdd', '/dev/sde', '/dev/sdf'] dedicated_devices:…
aphid
  • 111
  • 2
1
vote
0 answers

CEPH cluster became unresponsive: e5 handle_auth_request failed to assign global_id

I've created an Octopus 15.2.4 cluster with 3 monitors and 3 OSDs (6 hosts in total, all ESXi VMs). It lived through a couple of reboots without problem, then I've reconfigured the main host a bit: set iptables-legacy as current option in…
XNRL
  • 65
  • 7
1
vote
1 answer

Can my Ceph nodes have the same hostname?

I have a high availability solution which requires me to have all my nodes using the same hostname. I've been tasked to use ceph cluster storage, but I just reached a dead end. I can't figure out how to configure ceph so that I can use the same…
Malazzar
  • 21
  • 3
1
vote
1 answer

Poor performance with rook, ceph and RBD

I have a k8s cluster on 4 VMs. 1 master and 3 workers. On each of the workers, I use rook to deploy a ceph OSD. The OSDs are using the same disk as the VM Operating System. The VM disks are remote (the underlaying infrastructure is again a Ceph…
Laurentiu Soica
  • 65
  • 1
  • 6
1 2 3
…
10 11