For a half rack we have 7 cells.

Each cell has 12 disks

Each disk contains:

A cell disk which contains:

A number of Grid disks

which each contain an ASM disk.

 

Cell alerts can be raised by Exacheck, check on the cell using cellcli

e.g.

oracle> ssh celladmin@cell01-mgmt

cellcli

cellcli> list alerthistory where alerttype=’stateless’

Clear alerts:

cellcli> alter alerthistory ,,

examinedby=””

ASM details do not appear in “list griddisk” details

CELLCLI> list griddisk DATA_CD_01_ detail
:
available to:
:
CELLCLI> alter cell restart service cellsrv

CELL-02620 – unmapped CELLSRV

DELLCLI> alter cell restart services ms

To list the cells in use run the following against an ASM instance

SQL> select distinct substr(path,3,13) from v$asm_disk;

This will list the IP addresses of the cell servers.

 

 

$ ssh -l root

$ cellcli

cellcli> list cell detail

cellcli> list physicaldisk

cellcli> list celldisk

cellcli> list physicaldisk detail

cellcli> liist celldisk detail

cellcli> liist griddisk detail

cellcli> list alerthistory where alerttype=’stateless’

OR from the db server

$ dcli -g cells -l celladmin cellcli -e list cell detail

 

EXAMPLE 1:
MISSING DISK BECAUSE OF INCORRECT SIZINGS

in ASM

SQL> select group_number, name from v$asm_diskgroup;

1 DATA

2 SYS

3 RECO

 

SQL> select group_number, substr(path,1,15), count(1) from v$asm_disk group by group_number, substr(path,1,15);

GROUP_NUMBER SUBSTR(path,1,15) COUNT

============================

1 o/192.168.10.1 12

1 o/192.168.10.2 12

1 o/192.168.10.3 12

1 o/192.168.10.4 12

1 o/192.168.10.5 12

1 o/192.168.10.6 12

1 o/192.168.10.7 12

2 o/192.168.10.1 12

2 o/192.168.10.2 12

2 o/192.168.10.3 11

2 o/192.168.10.4 12

2 o/192.168.10.5 12

2 o/192.168.10.6 12

2 o/192.168.10.7 12

3 o/192.168.10.1 12

3 o/192.168.10.2 12

3 o/192.168.10.3 12

3 o/192.168.10.4 12

3 o/192.168.10.5 12

3 o/192.168.10.6 12

3 o/192.168.10.7 12

Therefore the SYS group is missing one disk on 192.168.10.3

Run cellcli on that cell server

cellcli> list griddisk

SYS_DG_CD_01_ active

SYS_DG_CD_02_ active

*** disk 3 is missing

SYS_DG_CD_04_ active

etc

Trying to recreate the volume gives errors:

cellcli> create griddisk SYS_DG_CD_03_ cellDisk=CD_03_

CELL-02566: No space for the specified allocation.

Investigating further shows that one of the RECO disks is incorrectly sized:

cellcli> list griddisk RECO_CD_02_ detail

name:RECO_CD_02_

asmDiskgroupName:  RECO

asmDiskName:          RECO_CD_02_

:

size:                       164G (whereas all the others are 105G)

 

RESIZE the disk

SQL> alter diskgroup RECO drop disk RECO_CD_03_;

CELLCLI> drop griddisk RECO_CD_03_

In case of issues whilst its being removed form the disk group try again

CELLCLI> drop griddisk RECO_CD_03_

CELLCLI> create griddisk RECO_CD_03_ cellDisk=CD_03_, size=105G

SQL> alter diskgroup add disk ‘o/192.168.10.3/RECO_CD_03_‘ name RECO_CD_03_;

Now we should be able to create the SYS disk

CELLCLI> create griddisk SYS_DG_CD_03_ cellDisk=CD_03_

SQL> alter diskgroup SYS_DG add disk ‘o/192.168.1.3/SYS_DG_CD_ name SYS_DG_CD_03_;

 

EXAMPLE 2:
RECREATING A DISK REPLACED BY ORACLE ENGINEERS

Create the CELLDISK

CellCLI> CREATE CELLDISK CD_07_ physicalDisk=’nm76dks’

CELL-04527: Cannot complete the creation of cell disk CD_07_wycexacel10mgmt. Received error: CELL-04539: Cannot create Single Disk LUN on physical disk 14:7 because there is already a LUN on this physical disk.

CellCLI> list PHYSICALDISK nm76dks detail

name:                   14:7

deviceId:               21

diskType:               HardDisk

enclosureDeviceId:      14

errMediaCount:          0

errOtherCount:          0

foreignState:           false

luns:                   0_7

makeModel:              “HITACHI HUS1560SCSUN600G”

physicalFirmware:       A6C0

physicalInsertTime:     2012-12-05T10:23:36+00:00

physicalInterface:      sas

physicalSerial:         nm76dks

physicalSize:           558.9109999993816G

slotNumber:             7

status:                 normal

CellCLI> CREATE CELLDISK CD_07_ lun=0_7

CellDisk CD_07_ successfully created

CellCLI> list  CELLDISK CD_07_ detail

name:                   CD_07_

comment:

creationTime:           2012-12-05T13:35:11+00:00

deviceName:             /dev/sdac

devicePartition:        /dev/sdac

diskType:               HardDisk

errorCount:             0

freeSpace:              556.8125G

freeSpaceMap:           offset=32M,size=19.96875G

offset=20.015625G,size=537.84375G

id:                     9b43a158-567e-4071-b267-576305a7f957

interleaving:           none

lun:                    0_7

physicalDisk:           nm76dks

raidLevel:              0

size:                   557G

status:                 normal

 

Create the Griddisks

CellCLI> create griddisk DATA_CD_07_ cellDisk= CD_07_, size=423G

GridDisk DATA_DG_CD_07_ successfully created

 

CellCLI> create griddisk RECO_CD_07_ cellDisk= CD_07_, size=105G

GridDisk RECO_DG_CD_07_ successfully created

 

CellCLI> create griddisk DBFS_DG_CD_07_ cellDisk= CD_07_, size= 29G

GridDisk DBFS_DG_CD_07_wycexacel01mgmt successfully created

The sizes can be found from list existing disks for the same group.

 

Create the ASM disks

Example syntax

SQL> alter diskgroup SYS_DG add disk ‘o/192.168.10.3/SYS_DG_CD_03_‘ name SYS_DG_CD_03_;

Restart the Cell Server when ASM doesn’t appear in “list griddisk” output.

CellCLI> list griddisk DATA_CD_07_ detail

name:                   DATA_CD_07_

availableTo:

cachingPolicy:          default

cellDisk:               CD_07_

comment:

creationTime:           2012-12-05T13:51:14+00:00

diskType:               HardDisk

errorCount:             0

id:                     d875363f-1f96-44a9-8488-9a1ab595e137

offset:                 32M

size:                   423G

status:                 active

CellCLI> alter cell restart services cellsrv

CellCLI> list griddisk DATA_CD_07_ detail

name:                   DATA_CD_07_

asmDiskgroupName:       DATA

asmDiskName:            DATA_CD_07_

asmFailGroupName:      

availableTo:

cachingPolicy:          default

cellDisk:               CD_07_

comment:

creationTime:           2012-12-05T13:51:14+00:00

diskType:               HardDisk

errorCount:             0

id:                     d875363f-1f96-44a9-8488-9a1ab595e137

offset:                 32M

size:                   423G

status:                 active

 

UNMAPPED CELLSRV ERROR

CELL-02620: An unmapped CELLSRV error has occurred. The internale message is: msosscommerr#3.

WORKAROUND:

cellcli> alter cell restart service ms