APPLIES TO

Oracle Database - Enterprise Edition - Version 10.2.0.1 to 12.1.0.1 [Release 10.2 to 12.1]

Oracle Database Cloud Schema Service - Version N/A and later

Oracle Database Exadata Cloud Machine - Version N/A and later

Oracle Cloud Infrastructure - Database Service - Version N/A and later

Oracle Database Backup Service - Version N/A and later

Information in this document applies to any platform.

SYMPTOMS

1) ASM diskgroup cannot be mounted due to the next error

SQL> alter diskgroup reco mount;

Alter diskgroup reco mount

*

ERROR at line 1

ORA-15032: not all alterations performed
ORA-15040: diskgroup is incomplete
ORA-15042: ASM disk "2" is missing from group number "2"

CAUSE

1) Kfed reports

[Oracle@fcomtaep2 disks]$ kfed read ASMRECO03

Kfbh.endian: 0; 0x000: 0x00

Kfbh.hard: 0; 0x001: 0x00

Kfbh.type: 0; 0x002: KFBTYP_INVALID

Kfbh.datfmt: 0; 0x003: 0x00

Kfbh.block.blk: 0; 0x004: blk=0

Kfbh.block.obj: 0; 0x008: file=0

Kfbh.check: 0; 0x00c: 0x00000000

Kfbh.fcn.base: 0; 0x010: 0x00000000

Kfbh.fcn.wrap: 0; 0x014: 0x00000000

Kfbh.spare1: 0; 0x018: 0x00000000

Kfbh.spare2: 0; 0x01c: 0x00000000

7FC18D899400 00000000 00000000 00000000 00000000 [................]

Repeat 27 times

7FC18D8995C0 FEEE0001 0001FFFF FFFF0000 00000FFF [................]

7FC18D8995D0 00000000 00000000 00000000 00000000 [................]

Repeat 1 times

7FC18D8995F0 00000000 00000000 00000000 AA550000 [..............U.]

7FC18D899600 20494645 54524150 00010000 0000005C [EFI PART....\...]

7FC18D899610 BD82BBB3 00000000 00000001 00000000 [................]

7FC18D899620 0FFFFFFF 00000000 00000022 00000000 [........".......]

7FC18D899630 0FFFFFDE 00000000 FD8857E5 42D7B49B [.........W.....B]

7FC18D899640 0901FA87 6B3DB5AA 00000002 00000000 [......=k........]

7FC18D899650 00000080 00000080 FE48EB77 00000000 [........w.H.....]

7FC18D899660 00000000 00000000 00000000 00000000 [................]

Repeat 25 times

7FC18D899800 EBD0A0A2 4433B9E5 B668C087 C79926B7 [......3D..h..&..]

7FC18D899810 5381F6DF 4626F988 0E4F468D D78D3B28 [...S..&F.FO.(;..]

7FC18D899820 000007A1 00000000 0FFFF85F 00000000 [........_.......]

7FC18D899830 00000000 00000000 00720070 006D0069 [........p.r.I.m.]

7FC18D899840 00720061 00000079 00000000 00000000 [a.r.y...........]

7FC18D899850 00000000 00000000 00000000 00000000 [................]

Repeat 186 times

KFED-00322: Invalid content encountered during block traversal: [kfbtTraverseBlock][Invalid OSM block type][][0

2) Above, kfed is reporting that the “ASMRECO03” disk was overlapped by the OS, it shows “EFI PART” which is OS partition metadata:

7FC18D899600 20494645 54524150 00010000 0000005C [EFI PART....\...]

3) The underlying disks associated to the “ASMRECO03” ASMLIB disk was reformatted by root and assigned to the OS filesystem.

4) This action corrupted/destroyed the RECO diskgroup for sure.

SOLUTION

Diskgroup needs to be recreated due to the “ASMRECO03” disk was overlapped by the OS filesystem.

DBRECOVER Recovery Options

For Oracle incidents, start with the DBRECOVER for Oracle trial to verify table visibility, row previews, and export readiness on copied datafiles. For MySQL and InnoDB incidents, DBRECOVER for MySQL is free software and can inspect.ibd files, ibdata1, and database directories locally.

When the case is urgent, preserve the original files first, work from copies, and contact paid emergency support with the database version, platform, error messages, file list, and recovery objective.

Archive ParnassusData Blog Migration Archive