I'm trying to achieve similar thing to raid6 on ceph.
But When I'm creating erasure coded pools (k=3 + m=2(or k=4) ) I always get inactive pgs.
ceph health details are:
HEALTH_WARN Reduced data availability: 128 pgs inactive
PG_AVAILABILITY Reduced data availability: 128 pgs inactive
pg 11.a is stuck inactive for 107.974251, current state unknown, last acting []
pg 11.b is stuck inactive for 107.974251, current state unknown, last acting []
pg 11.c is stuck inactive for 107.974251, current state unknown, last acting []
pg 11.d is stuck inactive for 107.974251, current state unknown, last acting []
pg 11.e is stuck inactive for 107.974251, current state unknown, last acting []
pg 11.f is stuck inactive for 107.974251, current state unknown, last acting []
pg 11.20 is stuck inactive for 107.974251, current state unknown, last acting []
EC profile is:
crush-device-class=
crush-failure-domain=rack
crush-root=default
jerasure-per-chunk-alignment=false
k=4
m=2
plugin=jerasure
technique=reed_sol_van
w=8
also tried with k=3, the same thing happens
Crush rule (for k=4):
{
"rule_id": 1,
"rule_name": "r6pool",
"ruleset": 1,
"type": 3,
"min_size": 3,
"max_size": 6,
"steps": [
{
"op": "set_chooseleaf_tries",
"num": 5
},
{
"op": "set_choose_tries",
"num": 100
},
{
"op": "take",
"item": -1,
"item_name": "default"
},
{
"op": "chooseleaf_indep",
"num": 0,
"type": "rack"
},
{
"op": "emit"
}
]
}
Since everything is fine If not using EC pools, I'm pretty sure I don't understand something, but I'm unable to target my mistake.
To get this error on completely good 8 OSD Cluster I'm just doing:
ceph osd erasure-code-profile set raid6 k=3 m=2
ceph osd pool create r6pool 128 128 erasure raid6
and ceph -s shows this:
ceph -s
cluster:
id: 7635eaf1-df47-4bed-9cef-a3152cb4fa5f
health: HEALTH_WARN
Reduced data availability: 128 pgs inactive
services:
mon: 3 daemons, quorum CephMon1,CephMon3,CephMon2
mgr: CephClient(active)
osd: 9 osds: 8 up, 8 in
data:
pools: 2 pools, 256 pgs
objects: 0 objects, 0B
usage: 8.13GiB used, 31.8GiB / 40.0GiB avail
pgs: 50.000% pgs unknown
128 active+clean
128 unknown
I'll be very gratefull for any help. Thanks.
