ubuntu - CEPH HEALTH_WARN 降级的数据冗余：重新加权后 pgs 过小
问题描述
我们有一个带有 3 个服务器和 15 个 OSD 的 CEPH 设置。两周前，我们收到“2 个 OSD 几乎已满”警告。我们使用以下命令重新加权了 OSD 并重新启动了两个 OSD
ceph osd reweight-by-utilization
重新启动后，我们在过去两周内低于警告
# ceph health detail
HEALTH_WARN Degraded data redundancy: 7 pgs undersized
PG_DEGRADED Degraded data redundancy: 7 pgs undersized
pg 39.7 is stuck undersized for 1398599.590587, current state active+undersized+remapped, last acting [10,1]
pg 39.1e is stuck undersized for 1398600.838131, current state active+undersized, last acting [1,10]
pg 39.2d is stuck undersized for 1398600.848232, current state active+undersized, last acting [10,1]
pg 39.58 is stuck undersized for 1398600.850871, current state active+undersized, last acting [10,1]
pg 39.5f is stuck undersized for 1398600.836724, current state active+undersized, last acting [1,10]
pg 39.79 is stuck undersized for 1398600.848756, current state active+undersized, last acting [10,1]
pg 54.d is stuck undersized for 1398599.590531, current state active+undersized+remapped, last acting [10,1]
# ceph -w
cluster:
id: 2e7201e4-9cdc-41db-a995-4844eb07c255
health: HEALTH_WARN
Degraded data redundancy: 7 pgs undersized
services:
mon: 3 daemons, quorum CEPH001,CEPH002,CEPH003
mgr: CEPH001(active), standbys: CEPH003
osd: 15 osds: 15 up, 15 in; 10 remapped pgs
data:
pools: 11 pools, 1238 pgs
objects: 292.7 k objects, 1.3 TiB
usage: 4.0 TiB used, 41 TiB / 45 TiB avail
pgs: 1223 active+clean
8 active+clean+remapped
5 active+undersized
2 active+undersized+remapped
io:
client: 21 KiB/s rd, 1.1 MiB/s wr, 55 op/s rd, 100 op/s wr
我是 CEPH 的新手，这是预期的行为吗？或者如何解决这个问题？
# ceph osd df
ID CLASS WEIGHT REWEIGHT SIZE USE AVAIL %USE VAR PGS
0 hdd 1.00000 1.00000 3.6 TiB 347 GiB 3.3 TiB 9.31 1.04 287
2 hdd 1.00000 1.00000 3.6 TiB 350 GiB 3.3 TiB 9.39 1.05 266
3 hdd 1.00000 1.00000 3.6 TiB 307 GiB 3.3 TiB 8.25 0.92 255
4 hdd 1.00000 1.00000 3.6 TiB 363 GiB 3.3 TiB 9.75 1.09 286
6 hdd 1.00000 1.00000 3.6 TiB 358 GiB 3.3 TiB 9.61 1.07 274
7 hdd 1.00000 1.00000 3.6 TiB 369 GiB 3.3 TiB 9.91 1.11 270
8 hdd 1.00000 1.00000 3.6 TiB 317 GiB 3.3 TiB 8.51 0.95 242
9 hdd 1.00000 1.00000 3.6 TiB 358 GiB 3.3 TiB 9.62 1.07 254
11 hdd 1.00000 1.00000 3.6 TiB 331 GiB 3.3 TiB 8.88 0.99 277
12 hdd 1.00000 1.00000 3.6 TiB 331 GiB 3.3 TiB 8.89 0.99 269
13 hdd 1.00000 1.00000 3.6 TiB 279 GiB 3.4 TiB 7.49 0.84 260
14 hdd 1.00000 1.00000 3.6 TiB 330 GiB 3.3 TiB 8.85 0.99 276
0 hdd 1.00000 1.00000 3.6 TiB 347 GiB 3.3 TiB 9.31 1.04 287
2 hdd 1.00000 1.00000 3.6 TiB 350 GiB 3.3 TiB 9.39 1.05 266
3 hdd 1.00000 1.00000 3.6 TiB 307 GiB 3.3 TiB 8.25 0.92 255
4 hdd 1.00000 1.00000 3.6 TiB 363 GiB 3.3 TiB 9.75 1.09 286
6 hdd 1.00000 1.00000 3.6 TiB 358 GiB 3.3 TiB 9.61 1.07 274
7 hdd 1.00000 1.00000 3.6 TiB 369 GiB 3.3 TiB 9.91 1.11 270
8 hdd 1.00000 1.00000 3.6 TiB 317 GiB 3.3 TiB 8.51 0.95 242
9 hdd 1.00000 1.00000 3.6 TiB 358 GiB 3.3 TiB 9.62 1.07 254
11 hdd 1.00000 1.00000 3.6 TiB 331 GiB 3.3 TiB 8.88 0.99 277
12 hdd 1.00000 1.00000 3.6 TiB 331 GiB 3.3 TiB 8.89 0.99 269
13 hdd 1.00000 1.00000 3.6 TiB 279 GiB 3.4 TiB 7.49 0.84 260
14 hdd 1.00000 1.00000 3.6 TiB 330 GiB 3.3 TiB 8.85 0.99 276
1 ssd 1.00000 0.95001 447 GiB 5.8 GiB 441 GiB 1.29 0.14 166
5 ssd 1.00000 0.95001 447 GiB 5.8 GiB 441 GiB 1.29 0.14 159
10 ssd 1.00000 0.95001 447 GiB 71 GiB 376 GiB 15.96 1.78 166
0 hdd 1.00000 1.00000 3.6 TiB 347 GiB 3.3 TiB 9.31 1.04 287
2 hdd 1.00000 1.00000 3.6 TiB 350 GiB 3.3 TiB 9.39 1.05 266
3 hdd 1.00000 1.00000 3.6 TiB 307 GiB 3.3 TiB 8.25 0.92 255
4 hdd 1.00000 1.00000 3.6 TiB 363 GiB 3.3 TiB 9.75 1.09 286
6 hdd 1.00000 1.00000 3.6 TiB 358 GiB 3.3 TiB 9.61 1.07 274
7 hdd 1.00000 1.00000 3.6 TiB 369 GiB 3.3 TiB 9.91 1.11 270
8 hdd 1.00000 1.00000 3.6 TiB 317 GiB 3.3 TiB 8.51 0.95 242
9 hdd 1.00000 1.00000 3.6 TiB 358 GiB 3.3 TiB 9.62 1.07 254
11 hdd 1.00000 1.00000 3.6 TiB 331 GiB 3.3 TiB 8.88 0.99 277
12 hdd 1.00000 1.00000 3.6 TiB 331 GiB 3.3 TiB 8.89 0.99 269
13 hdd 1.00000 1.00000 3.6 TiB 279 GiB 3.4 TiB 7.49 0.84 260
14 hdd 1.00000 1.00000 3.6 TiB 330 GiB 3.3 TiB 8.85 0.99 276
0 hdd 1.00000 1.00000 3.6 TiB 347 GiB 3.3 TiB 9.31 1.04 287
2 hdd 1.00000 1.00000 3.6 TiB 350 GiB 3.3 TiB 9.39 1.05 266
3 hdd 1.00000 1.00000 3.6 TiB 307 GiB 3.3 TiB 8.25 0.92 255
4 hdd 1.00000 1.00000 3.6 TiB 363 GiB 3.3 TiB 9.75 1.09 286
6 hdd 1.00000 1.00000 3.6 TiB 358 GiB 3.3 TiB 9.61 1.07 274
7 hdd 1.00000 1.00000 3.6 TiB 369 GiB 3.3 TiB 9.91 1.11 270
8 hdd 1.00000 1.00000 3.6 TiB 317 GiB 3.3 TiB 8.51 0.95 242
9 hdd 1.00000 1.00000 3.6 TiB 358 GiB 3.3 TiB 9.62 1.07 254
11 hdd 1.00000 1.00000 3.6 TiB 331 GiB 3.3 TiB 8.88 0.99 277
12 hdd 1.00000 1.00000 3.6 TiB 331 GiB 3.3 TiB 8.89 0.99 269
13 hdd 1.00000 1.00000 3.6 TiB 279 GiB 3.4 TiB 7.49 0.84 260
14 hdd 1.00000 1.00000 3.6 TiB 330 GiB 3.3 TiB 8.85 0.99 276
0 hdd 1.00000 1.00000 3.6 TiB 347 GiB 3.3 TiB 9.31 1.04 287
2 hdd 1.00000 1.00000 3.6 TiB 350 GiB 3.3 TiB 9.39 1.05 266
3 hdd 1.00000 1.00000 3.6 TiB 307 GiB 3.3 TiB 8.25 0.92 255
4 hdd 1.00000 1.00000 3.6 TiB 363 GiB 3.3 TiB 9.75 1.09 286
6 hdd 1.00000 1.00000 3.6 TiB 358 GiB 3.3 TiB 9.61 1.07 274
7 hdd 1.00000 1.00000 3.6 TiB 369 GiB 3.3 TiB 9.91 1.11 270
8 hdd 1.00000 1.00000 3.6 TiB 317 GiB 3.3 TiB 8.51 0.95 242
9 hdd 1.00000 1.00000 3.6 TiB 358 GiB 3.3 TiB 9.62 1.07 254
11 hdd 1.00000 1.00000 3.6 TiB 331 GiB 3.3 TiB 8.88 0.99 277
12 hdd 1.00000 1.00000 3.6 TiB 331 GiB 3.3 TiB 8.89 0.99 269
13 hdd 1.00000 1.00000 3.6 TiB 279 GiB 3.4 TiB 7.49 0.84 260
14 hdd 1.00000 1.00000 3.6 TiB 330 GiB 3.3 TiB 8.85 0.99 276
0 hdd 1.00000 1.00000 3.6 TiB 347 GiB 3.3 TiB 9.31 1.04 287
2 hdd 1.00000 1.00000 3.6 TiB 350 GiB 3.3 TiB 9.39 1.05 266
3 hdd 1.00000 1.00000 3.6 TiB 307 GiB 3.3 TiB 8.25 0.92 255
4 hdd 1.00000 1.00000 3.6 TiB 363 GiB 3.3 TiB 9.75 1.09 286
6 hdd 1.00000 1.00000 3.6 TiB 358 GiB 3.3 TiB 9.61 1.07 274
7 hdd 1.00000 1.00000 3.6 TiB 369 GiB 3.3 TiB 9.91 1.11 270
8 hdd 1.00000 1.00000 3.6 TiB 317 GiB 3.3 TiB 8.51 0.95 242
9 hdd 1.00000 1.00000 3.6 TiB 358 GiB 3.3 TiB 9.62 1.07 254
11 hdd 1.00000 1.00000 3.6 TiB 331 GiB 3.3 TiB 8.88 0.99 277
12 hdd 1.00000 1.00000 3.6 TiB 331 GiB 3.3 TiB 8.89 0.99 269
13 hdd 1.00000 1.00000 3.6 TiB 279 GiB 3.4 TiB 7.49 0.84 260
14 hdd 1.00000 1.00000 3.6 TiB 330 GiB 3.3 TiB 8.85 0.99 276
0 hdd 1.00000 1.00000 3.6 TiB 347 GiB 3.3 TiB 9.31 1.04 287
2 hdd 1.00000 1.00000 3.6 TiB 350 GiB 3.3 TiB 9.39 1.05 266
3 hdd 1.00000 1.00000 3.6 TiB 307 GiB 3.3 TiB 8.25 0.92 255
4 hdd 1.00000 1.00000 3.6 TiB 363 GiB 3.3 TiB 9.75 1.09 286
6 hdd 1.00000 1.00000 3.6 TiB 358 GiB 3.3 TiB 9.61 1.07 274
7 hdd 1.00000 1.00000 3.6 TiB 369 GiB 3.3 TiB 9.91 1.11 270
8 hdd 1.00000 1.00000 3.6 TiB 317 GiB 3.3 TiB 8.51 0.95 242
9 hdd 1.00000 1.00000 3.6 TiB 358 GiB 3.3 TiB 9.62 1.07 254
11 hdd 1.00000 1.00000 3.6 TiB 331 GiB 3.3 TiB 8.88 0.99 277
12 hdd 1.00000 1.00000 3.6 TiB 331 GiB 3.3 TiB 8.89 0.99 269
13 hdd 1.00000 1.00000 3.6 TiB 279 GiB 3.4 TiB 7.49 0.84 260
14 hdd 1.00000 1.00000 3.6 TiB 330 GiB 3.3 TiB 8.85 0.99 276
1 ssd 1.00000 0.95001 447 GiB 5.8 GiB 441 GiB 1.29 0.14 166
5 ssd 1.00000 0.95001 447 GiB 5.8 GiB 441 GiB 1.29 0.14 159
10 ssd 1.00000 0.95001 447 GiB 71 GiB 376 GiB 15.96 1.78 166
0 hdd 1.00000 1.00000 3.6 TiB 347 GiB 3.3 TiB 9.31 1.04 287
2 hdd 1.00000 1.00000 3.6 TiB 350 GiB 3.3 TiB 9.39 1.05 266
3 hdd 1.00000 1.00000 3.6 TiB 307 GiB 3.3 TiB 8.25 0.92 255
4 hdd 1.00000 1.00000 3.6 TiB 363 GiB 3.3 TiB 9.75 1.09 286
6 hdd 1.00000 1.00000 3.6 TiB 358 GiB 3.3 TiB 9.61 1.07 274
7 hdd 1.00000 1.00000 3.6 TiB 369 GiB 3.3 TiB 9.91 1.11 270
8 hdd 1.00000 1.00000 3.6 TiB 317 GiB 3.3 TiB 8.51 0.95 242
9 hdd 1.00000 1.00000 3.6 TiB 358 GiB 3.3 TiB 9.62 1.07 254
11 hdd 1.00000 1.00000 3.6 TiB 331 GiB 3.3 TiB 8.88 0.99 277
12 hdd 1.00000 1.00000 3.6 TiB 331 GiB 3.3 TiB 8.89 0.99 269
13 hdd 1.00000 1.00000 3.6 TiB 279 GiB 3.4 TiB 7.49 0.84 260
14 hdd 1.00000 1.00000 3.6 TiB 330 GiB 3.3 TiB 8.85 0.99 276
0 hdd 1.00000 1.00000 3.6 TiB 347 GiB 3.3 TiB 9.31 1.04 287
2 hdd 1.00000 1.00000 3.6 TiB 350 GiB 3.3 TiB 9.39 1.05 266
3 hdd 1.00000 1.00000 3.6 TiB 307 GiB 3.3 TiB 8.25 0.92 255
4 hdd 1.00000 1.00000 3.6 TiB 363 GiB 3.3 TiB 9.75 1.09 286
6 hdd 1.00000 1.00000 3.6 TiB 358 GiB 3.3 TiB 9.61 1.07 274
7 hdd 1.00000 1.00000 3.6 TiB 369 GiB 3.3 TiB 9.91 1.11 270
8 hdd 1.00000 1.00000 3.6 TiB 317 GiB 3.3 TiB 8.51 0.95 242
9 hdd 1.00000 1.00000 3.6 TiB 358 GiB 3.3 TiB 9.62 1.07 254
11 hdd 1.00000 1.00000 3.6 TiB 331 GiB 3.3 TiB 8.88 0.99 277
12 hdd 1.00000 1.00000 3.6 TiB 331 GiB 3.3 TiB 8.89 0.99 269
13 hdd 1.00000 1.00000 3.6 TiB 279 GiB 3.4 TiB 7.49 0.84 260
14 hdd 1.00000 1.00000 3.6 TiB 330 GiB 3.3 TiB 8.85 0.99 276
0 hdd 3.63899 1.00000 3.6 TiB 347 GiB 3.3 TiB 9.31 1.04 287
2 hdd 3.63899 1.00000 3.6 TiB 350 GiB 3.3 TiB 9.39 1.05 266
3 hdd 3.63899 1.00000 3.6 TiB 307 GiB 3.3 TiB 8.25 0.92 255
4 hdd 3.63899 1.00000 3.6 TiB 363 GiB 3.3 TiB 9.75 1.09 286
1 ssd 1.00000 0.95001 447 GiB 5.8 GiB 441 GiB 1.29 0.14 166
6 hdd 3.63899 1.00000 3.6 TiB 358 GiB 3.3 TiB 9.61 1.07 274
7 hdd 3.63899 1.00000 3.6 TiB 369 GiB 3.3 TiB 9.91 1.11 270
8 hdd 3.63899 1.00000 3.6 TiB 317 GiB 3.3 TiB 8.51 0.95 242
9 hdd 3.63899 1.00000 3.6 TiB 358 GiB 3.3 TiB 9.62 1.07 254
5 ssd 1.00000 0.95001 447 GiB 5.8 GiB 441 GiB 1.29 0.14 159
11 hdd 3.63899 1.00000 3.6 TiB 331 GiB 3.3 TiB 8.88 0.99 277
12 hdd 3.63899 1.00000 3.6 TiB 331 GiB 3.3 TiB 8.89 0.99 269
13 hdd 3.63899 1.00000 3.6 TiB 279 GiB 3.4 TiB 7.49 0.84 260
14 hdd 3.63899 1.00000 3.6 TiB 330 GiB 3.3 TiB 8.85 0.99 276
10 ssd 1.00000 0.95001 447 GiB 71 GiB 376 GiB 15.96 1.78 166
TOTAL 45 TiB 4.0 TiB 41 TiB 8.96
MIN/MAX VAR: 0.14/1.78 STDDEV: 2.03
# ceph osd tree
ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF
-43 12.00000 pool demognocchi
0 hdd 1.00000 osd.0 up 1.00000 1.00000
2 hdd 1.00000 osd.2 up 1.00000 1.00000
3 hdd 1.00000 osd.3 up 1.00000 1.00000
4 hdd 1.00000 osd.4 up 1.00000 1.00000
6 hdd 1.00000 osd.6 up 1.00000 1.00000
7 hdd 1.00000 osd.7 up 1.00000 1.00000
8 hdd 1.00000 osd.8 up 1.00000 1.00000
9 hdd 1.00000 osd.9 up 1.00000 1.00000
11 hdd 1.00000 osd.11 up 1.00000 1.00000
12 hdd 1.00000 osd.12 up 1.00000 1.00000
13 hdd 1.00000 osd.13 up 1.00000 1.00000
14 hdd 1.00000 osd.14 up 1.00000 1.00000
-40 12.00000 pool demobackup
0 hdd 1.00000 osd.0 up 1.00000 1.00000
2 hdd 1.00000 osd.2 up 1.00000 1.00000
3 hdd 1.00000 osd.3 up 1.00000 1.00000
4 hdd 1.00000 osd.4 up 1.00000 1.00000
6 hdd 1.00000 osd.6 up 1.00000 1.00000
7 hdd 1.00000 osd.7 up 1.00000 1.00000
8 hdd 1.00000 osd.8 up 1.00000 1.00000
9 hdd 1.00000 osd.9 up 1.00000 1.00000
11 hdd 1.00000 osd.11 up 1.00000 1.00000
12 hdd 1.00000 osd.12 up 1.00000 1.00000
13 hdd 1.00000 osd.13 up 1.00000 1.00000
14 hdd 1.00000 osd.14 up 1.00000 1.00000
-37 3.00000 pool demossd
1 ssd 1.00000 osd.1 up 0.95001 1.00000
5 ssd 1.00000 osd.5 up 0.95001 1.00000
10 ssd 1.00000 osd.10 up 0.95001 1.00000
-34 12.00000 pool demosata
0 hdd 1.00000 osd.0 up 1.00000 1.00000
2 hdd 1.00000 osd.2 up 1.00000 1.00000
3 hdd 1.00000 osd.3 up 1.00000 1.00000
4 hdd 1.00000 osd.4 up 1.00000 1.00000
6 hdd 1.00000 osd.6 up 1.00000 1.00000
7 hdd 1.00000 osd.7 up 1.00000 1.00000
8 hdd 1.00000 osd.8 up 1.00000 1.00000
9 hdd 1.00000 osd.9 up 1.00000 1.00000
11 hdd 1.00000 osd.11 up 1.00000 1.00000
12 hdd 1.00000 osd.12 up 1.00000 1.00000
13 hdd 1.00000 osd.13 up 1.00000 1.00000
14 hdd 1.00000 osd.14 up 1.00000 1.00000
-31 12.00000 pool demoglance
0 hdd 1.00000 osd.0 up 1.00000 1.00000
2 hdd 1.00000 osd.2 up 1.00000 1.00000
3 hdd 1.00000 osd.3 up 1.00000 1.00000
4 hdd 1.00000 osd.4 up 1.00000 1.00000
6 hdd 1.00000 osd.6 up 1.00000 1.00000
7 hdd 1.00000 osd.7 up 1.00000 1.00000
8 hdd 1.00000 osd.8 up 1.00000 1.00000
9 hdd 1.00000 osd.9 up 1.00000 1.00000
11 hdd 1.00000 osd.11 up 1.00000 1.00000
12 hdd 1.00000 osd.12 up 1.00000 1.00000
13 hdd 1.00000 osd.13 up 1.00000 1.00000
14 hdd 1.00000 osd.14 up 1.00000 1.00000
-18 12.00000 pool defaultbackup
0 hdd 1.00000 osd.0 up 1.00000 1.00000
2 hdd 1.00000 osd.2 up 1.00000 1.00000
3 hdd 1.00000 osd.3 up 1.00000 1.00000
4 hdd 1.00000 osd.4 up 1.00000 1.00000
6 hdd 1.00000 osd.6 up 1.00000 1.00000
7 hdd 1.00000 osd.7 up 1.00000 1.00000
8 hdd 1.00000 osd.8 up 1.00000 1.00000
9 hdd 1.00000 osd.9 up 1.00000 1.00000
11 hdd 1.00000 osd.11 up 1.00000 1.00000
12 hdd 1.00000 osd.12 up 1.00000 1.00000
13 hdd 1.00000 osd.13 up 1.00000 1.00000
14 hdd 1.00000 osd.14 up 1.00000 1.00000
-17 12.00000 pool backup
0 hdd 1.00000 osd.0 up 1.00000 1.00000
2 hdd 1.00000 osd.2 up 1.00000 1.00000
3 hdd 1.00000 osd.3 up 1.00000 1.00000
4 hdd 1.00000 osd.4 up 1.00000 1.00000
6 hdd 1.00000 osd.6 up 1.00000 1.00000
7 hdd 1.00000 osd.7 up 1.00000 1.00000
8 hdd 1.00000 osd.8 up 1.00000 1.00000
9 hdd 1.00000 osd.9 up 1.00000 1.00000
11 hdd 1.00000 osd.11 up 1.00000 1.00000
12 hdd 1.00000 osd.12 up 1.00000 1.00000
13 hdd 1.00000 osd.13 up 1.00000 1.00000
14 hdd 1.00000 osd.14 up 1.00000 1.00000
-16 12.00000 pool gnocchi
0 hdd 1.00000 osd.0 up 1.00000 1.00000
2 hdd 1.00000 osd.2 up 1.00000 1.00000
3 hdd 1.00000 osd.3 up 1.00000 1.00000
4 hdd 1.00000 osd.4 up 1.00000 1.00000
6 hdd 1.00000 osd.6 up 1.00000 1.00000
7 hdd 1.00000 osd.7 up 1.00000 1.00000
8 hdd 1.00000 osd.8 up 1.00000 1.00000
9 hdd 1.00000 osd.9 up 1.00000 1.00000
11 hdd 1.00000 osd.11 up 1.00000 1.00000
12 hdd 1.00000 osd.12 up 1.00000 1.00000
13 hdd 1.00000 osd.13 up 1.00000 1.00000
14 hdd 1.00000 osd.14 up 1.00000 1.00000
-15 3.00000 pool ssdvolume01
1 ssd 1.00000 osd.1 up 0.95001 1.00000
5 ssd 1.00000 osd.5 up 0.95001 1.00000
10 ssd 1.00000 osd.10 up 0.95001 1.00000
-14 12.00000 pool defaultsata01
0 hdd 1.00000 osd.0 up 1.00000 1.00000
2 hdd 1.00000 osd.2 up 1.00000 1.00000
3 hdd 1.00000 osd.3 up 1.00000 1.00000
4 hdd 1.00000 osd.4 up 1.00000 1.00000
6 hdd 1.00000 osd.6 up 1.00000 1.00000
7 hdd 1.00000 osd.7 up 1.00000 1.00000
8 hdd 1.00000 osd.8 up 1.00000 1.00000
9 hdd 1.00000 osd.9 up 1.00000 1.00000
11 hdd 1.00000 osd.11 up 1.00000 1.00000
12 hdd 1.00000 osd.12 up 1.00000 1.00000
13 hdd 1.00000 osd.13 up 1.00000 1.00000
14 hdd 1.00000 osd.14 up 1.00000 1.00000
-13 12.00000 pool defaultglance01
0 hdd 1.00000 osd.0 up 1.00000 1.00000
2 hdd 1.00000 osd.2 up 1.00000 1.00000
3 hdd 1.00000 osd.3 up 1.00000 1.00000
4 hdd 1.00000 osd.4 up 1.00000 1.00000
6 hdd 1.00000 osd.6 up 1.00000 1.00000
7 hdd 1.00000 osd.7 up 1.00000 1.00000
8 hdd 1.00000 osd.8 up 1.00000 1.00000
9 hdd 1.00000 osd.9 up 1.00000 1.00000
11 hdd 1.00000 osd.11 up 1.00000 1.00000
12 hdd 1.00000 osd.12 up 1.00000 1.00000
13 hdd 1.00000 osd.13 up 1.00000 1.00000
14 hdd 1.00000 osd.14 up 1.00000 1.00000
-1 46.66498 root default
-3 15.55499 host CEPH001
0 hdd 3.63899 osd.0 up 1.00000 1.00000
2 hdd 3.63899 osd.2 up 1.00000 1.00000
3 hdd 3.63899 osd.3 up 1.00000 1.00000
4 hdd 3.63899 osd.4 up 1.00000 1.00000
1 ssd 1.00000 osd.1 up 0.95001 1.00000
-7 15.55499 host CEPH002
6 hdd 3.63899 osd.6 up 1.00000 1.00000
7 hdd 3.63899 osd.7 up 1.00000 1.00000
8 hdd 3.63899 osd.8 up 1.00000 1.00000
9 hdd 3.63899 osd.9 up 1.00000 1.00000
5 ssd 1.00000 osd.5 up 0.95001 1.00000
-10 15.55499 host CEPH003
11 hdd 3.63899 osd.11 up 1.00000 1.00000
12 hdd 3.63899 osd.12 up 1.00000 1.00000
13 hdd 3.63899 osd.13 up 1.00000 1.00000
14 hdd 3.63899 osd.14 up 1.00000 1.00000
10 ssd 1.00000 osd.10 up 0.95001 1.00000
# ceph osd pool ls detail
pool 37 'defaultglance01' replicated size 3 min_size 1 crush_rule 4 object_hash rjenkins pg_num 128 pgp_num 128 last_change 2993 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd
removed_snaps [1~3,7~2e,37~4,41~a,50~4,56~2,5a~2,5d~3,61~1]
pool 38 'defaultsata01' replicated size 3 min_size 1 crush_rule 3 object_hash rjenkins pg_num 200 pgp_num 200 last_change 2971 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd
removed_snaps [1~59]
pool 39 'ssdvolume01' replicated size 3 min_size 1 crush_rule 1 object_hash rjenkins pg_num 150 pgp_num 150 last_change 3005 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd
removed_snaps [1~3]
pool 40 'gnocchi' replicated size 3 min_size 1 crush_rule 5 object_hash rjenkins pg_num 256 pgp_num 256 last_change 1821 flags hashpspool stripe_width 0 application rbd
pool 45 'backup' erasure size 3 min_size 2 crush_rule 6 object_hash rjenkins pg_num 256 pgp_num 256 last_change 2392 flags hashpspool,ec_overwrites,selfmanaged_snaps stripe_width 8192 application rbd
removed_snaps [1~b]
pool 46 'defaultbackup' replicated size 3 min_size 1 crush_rule 7 object_hash rjenkins pg_num 56 pgp_num 56 last_change 2098 flags hashpspool stripe_width 0 application rbd
pool 52 'demoglance' replicated size 3 min_size 1 crush_rule 8 object_hash rjenkins pg_num 16 pgp_num 16 last_change 2848 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd
removed_snaps [1~3,7~1,9~1,b~2]
pool 53 'demosata' replicated size 3 min_size 1 crush_rule 9 object_hash rjenkins pg_num 128 pgp_num 128 last_change 2974 lfor 0/2620 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd
removed_snaps [1~6,8~f,1d~2,20~2]
pool 54 'demossd' replicated size 3 min_size 1 crush_rule 10 object_hash rjenkins pg_num 16 pgp_num 16 last_change 3005 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd
removed_snaps [1~3]
pool 55 'demobackup' replicated size 3 min_size 1 crush_rule 11 object_hash rjenkins pg_num 16 pgp_num 16 last_change 2596 flags hashpspool stripe_width 0 application rbd
pool 56 'demognocchi' replicated size 3 min_size 1 crush_rule 12 object_hash rjenkins pg_num 16 pgp_num 16 last_change 2597 flags hashpspool stripe_width 0 application rbd
ceph 版本 13.2.6 (7b695f835b03642f85998b2ae7b6dd093d9fbce4) 模拟（稳定）
解决方案
我们正在使用crush map，我们的Crush map中提到的OSD池权重是1所以我们用一个重新加权SSD OSD。
#ceph osd reweight <OSD Number> 1
感谢@eblock 的帮助。
推荐阅读
- python - 我想要第 6 列 vlaues 的总和
- react-native - 如何在本机反应中使用 mapbox 标记集群？
- ios - Weex：网页在网页上显示正确，但在 iOS 设备上显示不正确
- javascript - 如何在咖啡脚本中将数组作为参数传递？
- .net - 为什么“功能体”会成为我的应用程序的瓶颈？
- python - 使用 urllib 将数据从 web-scraped JSON 添加到列表
- google-sheets - 在 Google 工作表中，如何获取包括日期在内的多个“位置”
- java - 通过反射找到一个签名不完全已知的方法
- reactjs - 在 Redux 中处理 API 调用而不执行任何操作
- php - Mysql apache2 - phpmyadmin 导入错误（php 7.2）