After a power supply replacement we had a cabling issue which caused some disks to be missing, after debugging and fixing this in the BIOS, on the first boot, the preexisting raid5 volume was split into two foreign configurations - one contained 5 disks, the other contained the 2 remaining disks of the 7 volume raid5 (see below).
We are unable to import the foreign configuratins with perccli /c0/fall import:
Status = Failure
Description = Incomplete foreign configuration
So all disks are there, but somehow the controller thinks it's two different drive groups. Is there a way to recover from this situation and merge the configs into one, or something like that?
----------------------------------------------------------------------------
DG Arr Row EID:Slot DID Type State BT Size PDC PI SED DS3 FSpace TR
----------------------------------------------------------------------------
0 - - - - RAID5 Frgn N 54.571 TB dsbl N N dflt N N
0 0 - - - RAID5 Frgn N 54.571 TB dsbl N N dflt N N
0 0 0 67:0 0 DRIVE Frgn N 9.094 TB dsbl N N dflt - N
0 0 1 67:0 1 DRIVE Frgn N 9.094 TB dsbl N N dflt - N
0 0 2 67:0 2 DRIVE Frgn N 9.094 TB dsbl N N dflt - N
0 0 3 67:0 3 DRIVE Frgn N 9.094 TB dsbl N N dflt - N
0 0 4 - - DRIVE Msng - 9.094 TB - - - - - N
0 0 5 - - DRIVE Msng - 9.094 TB - - - - - N
0 0 6 67:0 5 DRIVE Frgn N 9.094 TB dsbl N N dflt - N
1 - - - - RAID5 Frgn N 54.571 TB dsbl N N dflt N N
1 0 - - - RAID5 Frgn N 54.571 TB dsbl N N dflt N N
1 0 0 - - DRIVE Msng - 9.094 TB - - - - - N
1 0 1 - - DRIVE Msng - 9.094 TB - - - - - N
1 0 2 - - DRIVE Msng - 9.094 TB - - - - - N
1 0 3 - - DRIVE Msng - 9.094 TB - - - - - N
1 0 4 67:0 6 DRIVE Frgn N 9.094 TB dsbl N N dflt - N
1 0 5 67:0 4 DRIVE Frgn N 9.094 TB dsbl N N dflt - N
1 0 6 - - DRIVE Msng - 9.094 TB - - - - - N
----------------------------------------------------------------------------
Foreign VD List :
===============
---------------------------------
DG VD Size Type Name
---------------------------------
0 255 54.571 TB RAID5 RV5
1 255 54.571 TB RAID5 RV5
---------------------------------
Update:
I disconnected the whole expander and booted. This showed all disks in the foreign config (there are a number of single raid1 volumes, too):
-----------------------------------------
DG EID:Slot Type State Size NoVDs
-----------------------------------------
0 - RAID0 Frgn 9.094 TB 1
1 - RAID0 Frgn 10.913 TB 1
2 - RAID0 Frgn 10.913 TB 1
3 - RAID0 Frgn 10.913 TB 1
4 - RAID0 Frgn 9.094 TB 1
5 - RAID0 Frgn 278.875 GB 1
6 - RAID0 Frgn 14.551 TB 1
7 - RAID0 Frgn 16.370 TB 1
8 - RAID0 Frgn 9.094 TB 1
9 - RAID5 Frgn 54.571 TB 1
10 - RAID5 Frgn 54.571 TB 1
-----------------------------------------
I was able to successfully /c0/fall import all. Unfortunately, this ended up in the sdame situation as before, with the other volumes being there and the raid5 being split into two foreign configurations (i.e. importing all foreign configs created tow new foreign configs).
Update 2:
Attaching the disks to a GNU/Linux system shows this, which to me basically says the same thing as the perc controller: there are two raid volumes with 5 and 7 disks. So this seems to be the result of a firmware bug where trhe raid controller actually split the volume group into two dysfunctional ones, and therefore, mergign seems impossible.
Personalities : [raid0] [linear] [multipath] [raid1] [raid6] [raid5] [raid4] [raid10]
md125 : inactive sdi[0]
9765912576 blocks super external:/md127/2
md126 : inactive sdg[1](S) sdf[0](S)
1048576 blocks super external:ddf
md127 : inactive sdm[4](S) sdi[3](S) sdh[2](S) sdk[1](S) sdl[0](S)
2621440 blocks super external:ddf
unused devices:
I'm trying to recover from here, but thew question now is: Can I recreate the array in either the raid controller or GNU/Linux again so the raid controller would recognise the array? Restoring from backup takes a rather long time.
** Update 3:**
Since it was asked for - I don't have the examine/detail info anymore, but here is the dump of what my own tool printed, which gives a bit more structure, and clearly shows how corrupted the info was. The DDF data includes more disks than just the ones in the array, but my tool only dumped info related to the array config I wanted to recover. Note that I have solved my problem by recreating the array after a minor odyssey, so this is just informational.
/dev/sdf
refno 66fee9c8
guid 'ATA 999901019c64177c25b6'
pd 1 6d67850c 'ATA 9999010198734b845e34'
pd 2 2c442eef 'ATA 99990101a3ff6b169fb3'
pd 3 859c2a72 'ATA 9999010140f57d7b1911'
pd 4 2a25447d 'ATA 9999010181a40ea27a38'
pd 5 6db9e402 'SmrtStor P^A^W1^@tfM-8'
pd 6 0176ebaa 'ATA 99990101bd73575777e4'
pd 7 a63ba301 'ATA 999901017d605c6aadf6'
pd 8 5254f474 'ATA 999901014ecf2257f8f4'
pd 9 80e8a86d 'ATA 999901014c775ca92a87'
pd 10 49416c50 'ATA 99990101d79cd13a1e1e'
pd 11 fa44428b 'ATA 9999010198bd2187a552'
pd 12 66fee9c8 'ATA 999901019c64177c25b6'
pd 13 4a94daa9 'ATA 99990101679d1776307e'
part 0
guid 'Dell ^P'
size 117190950912
blocks 19531825152
disk 0 start 0 ref a63ba301
disk 1 start 0 ref 5254f474
disk 2 start 0 ref 80e8a86d
disk 3 start 0 ref 49416c50
disk 4 start 0 ref fa44428b
disk 5 start 0 ref 66fee9c8
disk 6 start 0 ref 4a94daa9
/dev/sdg
refno fa44428b
guid 'ATA 9999010198bd2187a552'
pd 1 6d67850c 'ATA 9999010198734b845e34'
pd 2 2c442eef 'ATA 99990101a3ff6b169fb3'
pd 3 859c2a72 'ATA 9999010140f57d7b1911'
pd 4 2a25447d 'ATA 9999010181a40ea27a38'
pd 5 6db9e402 'SmrtStor P^A^W1^@tfM-8'
pd 6 0176ebaa 'ATA 99990101bd73575777e4'
pd 7 a63ba301 'ATA 999901017d605c6aadf6'
pd 8 5254f474 'ATA 999901014ecf2257f8f4'
pd 9 80e8a86d 'ATA 999901014c775ca92a87'
pd 10 49416c50 'ATA 99990101d79cd13a1e1e'
pd 11 fa44428b 'ATA 9999010198bd2187a552'
pd 12 66fee9c8 'ATA 999901019c64177c25b6'
pd 13 4a94daa9 'ATA 99990101679d1776307e'
part 0
guid 'Dell ^P'
size 117190950912
blocks 19531825152
disk 0 start 0 ref a63ba301
disk 1 start 0 ref 5254f474
disk 2 start 0 ref 80e8a86d
disk 3 start 0 ref 49416c50
disk 4 start 0 ref fa44428b
disk 5 start 0 ref 66fee9c8
disk 6 start 0 ref 4a94daa9
/dev/sdh
refno 4a94daa9
guid 'ATA 99990101974a122c9311'
pd 1 6d67850c 'ATA 99990101be1d53ed8c7d'
pd 2 2c442eef 'ATA 99990101ff58714b7f1b'
pd 3 859c2a72 'ATA 99990101fa3ac0b94ef7'
pd 4 2a25447d 'ATA 999901017e74d11eb6e6'
pd 5 0176ebaa 'ATA 99990101f19b3355ec56'
pd 6 a63ba301 'ATA 99990101f391d36e91f9'
pd 7 5254f474 'ATA 99990101fa6d3d5b6c49'
pd 8 80e8a86d 'ATA 99990101b7ad5947d5c0'
pd 9 49416c50 'ATA 99990101d2e6918871bb'
pd 10 4a94daa9 'ATA 99990101974a122c9311'
pd 11 6db9e402 'SmrtStor P^A^W1^@tfM-8'
part 0
guid 'Dell ^P'
size 117190950912
blocks 19531825152
disk 0 start 0 ref a63ba301
disk 1 start 0 ref 5254f474
disk 2 start 0 ref 80e8a86d
disk 3 start 0 ref 49416c50
disk 6 start 0 ref 4a94daa9
/dev/sdi
refno 49416c50
guid 'ATA 99990101d2e6918871bb'
pd 1 2a25447d 'ATA 999901017e74d11eb6e6'
pd 2 0176ebaa 'ATA 99990101f19b3355ec56'
pd 3 49416c50 'ATA 99990101d2e6918871bb'
pd 4 6db9e402 'SmrtStor P^A^W1^@tfM-8'
part 0
guid 'Dell ^P'
size 117190950912
blocks 19531825152
disk 3 start 0 ref 49416c50
/dev/sdk
refno 80e8a86d
guid 'ATA 99990101b7ad5947d5c0'
pd 1 2a25447d 'ATA 999901017e74d11eb6e6'
pd 2 0176ebaa 'ATA 99990101f19b3355ec56'
pd 3 a63ba301 'ATA 99990101f391d36e91f9'
pd 4 5254f474 'ATA 99990101fa6d3d5b6c49'
pd 5 80e8a86d 'ATA 99990101b7ad5947d5c0'
pd 6 49416c50 'ATA 99990101d2e6918871bb'
pd 7 6db9e402 'SmrtStor P^A^W1^@tfM-8'
part 0
guid 'Dell ^P'
size 117190950912
blocks 19531825152
disk 0 start 0 ref a63ba301
disk 1 start 0 ref 5254f474
disk 2 start 0 ref 80e8a86d
disk 3 start 0 ref 49416c50
/dev/sdl
refno 5254f474
guid 'ATA 99990101fa6d3d5b6c49'
pd 1 2a25447d 'ATA 999901017e74d11eb6e6'
pd 2 0176ebaa 'ATA 99990101f19b3355ec56'
pd 3 a63ba301 'ATA 99990101f391d36e91f9'
pd 4 5254f474 'ATA 99990101fa6d3d5b6c49'
pd 5 80e8a86d 'ATA 99990101b7ad5947d5c0'
pd 6 49416c50 'ATA 99990101d2e6918871bb'
pd 7 6db9e402 'SmrtStor P^A^W1^@tfM-8'
part 0
guid 'Dell ^P'
size 117190950912
blocks 19531825152
disk 0 start 0 ref a63ba301
disk 1 start 0 ref 5254f474
disk 2 start 0 ref 80e8a86d
disk 3 start 0 ref 49416c50
/dev/sdm
refno a63ba301
guid 'ATA 99990101f391d36e91f9'
pd 1 2a25447d 'ATA 999901017e74d11eb6e6'
pd 2 0176ebaa 'ATA 99990101f19b3355ec56'
pd 3 a63ba301 'ATA 99990101f391d36e91f9'
pd 4 5254f474 'ATA 99990101fa6d3d5b6c49'
pd 5 80e8a86d 'ATA 99990101b7ad5947d5c0'
pd 6 49416c50 'ATA 99990101d2e6918871bb'
pd 7 6db9e402 'SmrtStor P^A^W1^@tfM-8'
part 0
guid 'Dell ^P'
size 117190950912
blocks 19531825152
disk 0 start 0 ref a63ba301
disk 1 start 0 ref 5254f474
disk 2 start 0 ref 80e8a86d
disk 3 start 0 ref 49416c50
seq 0 refno a63ba301 dev /dev/sdm
seq 1 refno 5254f474 dev /dev/sdl
seq 2 refno 80e8a86d dev /dev/sdk
seq 3 refno 49416c50 dev /dev/sdi
seq 4 refno fa44428b dev /dev/sdg
seq 5 refno 66fee9c8 dev /dev/sdf
seq 6 refno 4a94daa9 dev /dev/sdh