Oracle Rac - Oracle crsctl commands

In Oracle Real Application Clusters (RAC), the crsctl command-line utility is used to manage and administer Cluster Ready Services (CRS). crsctl provides a wide range of functionalities to manage the Oracle Clusterware.
Here are some commonly used crsctl commands:

To check the health of the clusterware all nodes :
    [grid@tesdb1 ~]$ crsctl check cluster -all
    **************************************************************
    tesdb1:
    CRS-4537: Cluster Ready Services is online
    CRS-4529: Cluster Synchronization Services is online
    CRS-4533: Event Manager is online
    **************************************************************
    tesdb2:
    CRS-4537: Cluster Ready Services is online
    CRS-4529: Cluster Synchronization Services is online
    CRS-4533: Event Manager is online

To display the status of the cluster resources :
    [grid@tesdb1 ~]$ crsctl stat res -t -init
    --------------------------------------------------------------------------------
    Name           Target  State        Server                   State details       
    --------------------------------------------------------------------------------
    Cluster Resources
    --------------------------------------------------------------------------------
    ora.asm
        1        ONLINE  ONLINE       tesdb1                   Started,STABLE
    ora.cluster_interconnect.haip
        1        ONLINE  ONLINE       tesdb1                   STABLE
    ora.crf
        1        ONLINE  ONLINE       tesdb1                   STABLE
    ora.crsd
        1        ONLINE  ONLINE       tesdb1                   STABLE
    ora.cssd
        1        ONLINE  ONLINE       tesdb1                   STABLE
    ora.cssdmonitor
        1        ONLINE  ONLINE       tesdb1                   STABLE
    ora.ctssd
        1        ONLINE  ONLINE       tesdb1                   OBSERVER,STABLE
    ora.diskmon
        1        OFFLINE OFFLINE                               STABLE
    ora.evmd
        1        ONLINE  ONLINE       tesdb1                   STABLE
    ora.gipcd
        1        ONLINE  ONLINE       tesdb1                   STABLE
    ora.gpnpd
        1        ONLINE  ONLINE       tesdb1                   STABLE
    ora.mdnsd
        1        ONLINE  ONLINE       tesdb1                   STABLE
    ora.storage
        1        ONLINE  ONLINE       tesdb1                   STABLE

TO CHECK THE STATUS OF 2 NODE :
    [root@tesdb2 ~]# /u01/app/19c/grid/bin/crsctl stat res -t -init
    --------------------------------------------------------------------------------
    Name           Target  State        Server                   State details       
    --------------------------------------------------------------------------------
    Cluster Resources
    --------------------------------------------------------------------------------
    ora.asm
        1        ONLINE  ONLINE       tesdb2                   Started,STABLE
    ora.cluster_interconnect.haip
        1        ONLINE  ONLINE       tesdb2                   STABLE
    ora.crf
        1        ONLINE  ONLINE       tesdb2                   STABLE
    ora.crsd
        1        ONLINE  ONLINE       tesdb2                   STABLE
    ora.cssd
        1        ONLINE  ONLINE       tesdb2                   STABLE
    ora.cssdmonitor
        1        ONLINE  ONLINE       tesdb2                   STABLE
    ora.ctssd
        1        ONLINE  ONLINE       tesdb2                   OBSERVER,STABLE
    ora.diskmon
        1        OFFLINE OFFLINE                               STABLE
    ora.evmd
        1        ONLINE  ONLINE       tesdb2                   STABLE
    ora.gipcd
        1        ONLINE  ONLINE       tesdb2                   STABLE
    ora.gpnpd
        1        ONLINE  ONLINE       tesdb2                   STABLE
    ora.mdnsd
        1        ONLINE  ONLINE       tesdb2                   STABLE
    ora.storage
        1        ONLINE  ONLINE       tesdb2                   STABLE

Checking status of cluster :
    [grid@tesdb1 ~]$ crsctl check crs
    CRS-4638: Oracle High Availability Services is online
    CRS-4537: Cluster Ready Services is online
    CRS-4529: Cluster Synchronization Services is online
    CRS-4533: Event Manager is online
    Starting and Stopping the Cluster:

    [root@tesdb1 ~]# /u01/app/19c/grid/bin/crsctl stop crs 
    CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'tesdb1'
    CRS-2673: Attempting to stop 'ora.crsd' on 'tesdb1'
    CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on server 'tesdb1'
    CRS-33673: Attempting to stop resource group 'ora.asmgroup' on server 'tesdb1'
    CRS-2673: Attempting to stop 'ora.DATA.dg' on 'tesdb1'
    CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'tesdb1'
    CRS-2673: Attempting to stop 'ora.qosmserver' on 'tesdb1'
    CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'tesdb1'
    CRS-2673: Attempting to stop 'ora.chad' on 'tesdb1'
    CRS-2673: Attempting to stop 'ora.LISTENER_SCAN3.lsnr' on 'tesdb1'
    CRS-2673: Attempting to stop 'ora.cvu' on 'tesdb1'
    CRS-2677: Stop of 'ora.DATA.dg' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.asm' on 'tesdb1'
    CRS-2677: Stop of 'ora.cvu' on 'tesdb1' succeeded
    CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.tesdb1.vip' on 'tesdb1'
    CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.scan2.vip' on 'tesdb1'
    CRS-2677: Stop of 'ora.LISTENER_SCAN3.lsnr' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.scan3.vip' on 'tesdb1'
    CRS-2677: Stop of 'ora.asm' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.ASMNET1LSNR_ASM.lsnr' on 'tesdb1'
    CRS-2677: Stop of 'ora.tesdb1.vip' on 'tesdb1' succeeded
    CRS-2677: Stop of 'ora.scan2.vip' on 'tesdb1' succeeded
    CRS-2677: Stop of 'ora.scan3.vip' on 'tesdb1' succeeded
    CRS-2677: Stop of 'ora.qosmserver' on 'tesdb1' succeeded
    CRS-2677: Stop of 'ora.ASMNET1LSNR_ASM.lsnr' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.asmnet1.asmnetwork' on 'tesdb1'
    CRS-2677: Stop of 'ora.asmnet1.asmnetwork' on 'tesdb1' succeeded
    CRS-33677: Stop of resource group 'ora.asmgroup' on server 'tesdb1' succeeded.
    CRS-2677: Stop of 'ora.chad' on 'tesdb1' succeeded
    CRS-2672: Attempting to start 'ora.qosmserver' on 'tesdb2'
    CRS-2672: Attempting to start 'ora.scan2.vip' on 'tesdb2'
    CRS-2672: Attempting to start 'ora.scan3.vip' on 'tesdb2'
    CRS-2672: Attempting to start 'ora.cvu' on 'tesdb2'
    CRS-2672: Attempting to start 'ora.tesdb1.vip' on 'tesdb2'
    CRS-2676: Start of 'ora.cvu' on 'tesdb2' succeeded
    CRS-2676: Start of 'ora.tesdb1.vip' on 'tesdb2' succeeded
    CRS-2676: Start of 'ora.scan3.vip' on 'tesdb2' succeeded
    CRS-2672: Attempting to start 'ora.LISTENER_SCAN3.lsnr' on 'tesdb2'
    CRS-2676: Start of 'ora.scan2.vip' on 'tesdb2' succeeded
    CRS-2672: Attempting to start 'ora.LISTENER_SCAN2.lsnr' on 'tesdb2'
    CRS-2676: Start of 'ora.LISTENER_SCAN3.lsnr' on 'tesdb2' succeeded
    CRS-2676: Start of 'ora.LISTENER_SCAN2.lsnr' on 'tesdb2' succeeded
    CRS-2676: Start of 'ora.qosmserver' on 'tesdb2' succeeded
    CRS-2673: Attempting to stop 'ora.ons' on 'tesdb1'
    CRS-2677: Stop of 'ora.ons' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.net1.network' on 'tesdb1'
    CRS-2677: Stop of 'ora.net1.network' on 'tesdb1' succeeded
    CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'tesdb1' has completed
    CRS-2677: Stop of 'ora.crsd' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.asm' on 'tesdb1'
    CRS-2673: Attempting to stop 'ora.crf' on 'tesdb1'
    CRS-2673: Attempting to stop 'ora.mdnsd' on 'tesdb1'
    CRS-2677: Stop of 'ora.crf' on 'tesdb1' succeeded
    CRS-2677: Stop of 'ora.mdnsd' on 'tesdb1' succeeded
    CRS-2677: Stop of 'ora.asm' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'tesdb1'
    CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.ctssd' on 'tesdb1'
    CRS-2673: Attempting to stop 'ora.evmd' on 'tesdb1'
    CRS-2677: Stop of 'ora.ctssd' on 'tesdb1' succeeded
    CRS-2677: Stop of 'ora.evmd' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.cssd' on 'tesdb1'
    CRS-2677: Stop of 'ora.cssd' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.gipcd' on 'tesdb1'
    CRS-2673: Attempting to stop 'ora.gpnpd' on 'tesdb1'
    CRS-2677: Stop of 'ora.gpnpd' on 'tesdb1' succeeded
    CRS-2677: Stop of 'ora.gipcd' on 'tesdb1' succeeded
    CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'tesdb1' has completed
    CRS-4133: Oracle High Availability Services has been stopped.

TO START CLUSTER THE PARTICULER NODE :
    [root@tesdb2 ~]# /u01/app/19c/grid/bin/crsctl start crs 
    CRS-4123: Oracle High Availability Services has been started.
    TO STOP ALL THE CLUSTER
    [root@tesdb1 ~]# /u01/app/19c/grid/bin/crsctl stop cluster -all
    CRS-2673: Attempting to stop 'ora.crsd' on 'tesdb2'
    CRS-2673: Attempting to stop 'ora.crsd' on 'tesdb1'
    CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on server 'tesdb2'
    CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'tesdb2'
    CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'tesdb2'
    CRS-33673: Attempting to stop resource group 'ora.asmgroup' on server 'tesdb2'
    CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on server 'tesdb1'
    CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'tesdb1'
    CRS-2673: Attempting to stop 'ora.DATA.dg' on 'tesdb2'
    CRS-2673: Attempting to stop 'ora.cvu' on 'tesdb1'
    CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'tesdb1'
    CRS-2673: Attempting to stop 'ora.chad' on 'tesdb2'
    CRS-2673: Attempting to stop 'ora.qosmserver' on 'tesdb1'
    CRS-2673: Attempting to stop 'ora.chad' on 'tesdb1'
    CRS-2673: Attempting to stop 'ora.LISTENER_SCAN3.lsnr' on 'tesdb1'
    CRS-2677: Stop of 'ora.DATA.dg' on 'tesdb2' succeeded
    CRS-2673: Attempting to stop 'ora.asm' on 'tesdb2'
    CRS-2677: Stop of 'ora.cvu' on 'tesdb1' succeeded
    CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'tesdb2' succeeded
    CRS-2673: Attempting to stop 'ora.tesdb2.vip' on 'tesdb2'
    CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'tesdb2' succeeded
    CRS-2673: Attempting to stop 'ora.scan1.vip' on 'tesdb2'
    CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.scan2.vip' on 'tesdb1'
    CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.tesdb1.vip' on 'tesdb1'
    CRS-2677: Stop of 'ora.LISTENER_SCAN3.lsnr' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.scan3.vip' on 'tesdb1'
    CRS-2677: Stop of 'ora.tesdb2.vip' on 'tesdb2' succeeded
    CRS-2677: Stop of 'ora.scan2.vip' on 'tesdb1' succeeded
    CRS-2677: Stop of 'ora.scan1.vip' on 'tesdb2' succeeded
    CRS-2677: Stop of 'ora.tesdb1.vip' on 'tesdb1' succeeded
    CRS-2677: Stop of 'ora.scan3.vip' on 'tesdb1' succeeded
    CRS-2677: Stop of 'ora.asm' on 'tesdb2' succeeded
    CRS-2673: Attempting to stop 'ora.ASMNET1LSNR_ASM.lsnr' on 'tesdb2'
    CRS-2677: Stop of 'ora.qosmserver' on 'tesdb1' succeeded
    CRS-2677: Stop of 'ora.chad' on 'tesdb2' succeeded
    CRS-2677: Stop of 'ora.chad' on 'tesdb1' succeeded
    CRS-2677: Stop of 'ora.ASMNET1LSNR_ASM.lsnr' on 'tesdb2' succeeded
    CRS-2673: Attempting to stop 'ora.asmnet1.asmnetwork' on 'tesdb2'
    CRS-33673: Attempting to stop resource group 'ora.asmgroup' on server 'tesdb1'
    CRS-2673: Attempting to stop 'ora.DATA.dg' on 'tesdb1'
    CRS-2677: Stop of 'ora.asmnet1.asmnetwork' on 'tesdb2' succeeded
    CRS-33677: Stop of resource group 'ora.asmgroup' on server 'tesdb2' succeeded.
    CRS-2673: Attempting to stop 'ora.ons' on 'tesdb2'
    CRS-2677: Stop of 'ora.DATA.dg' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.asm' on 'tesdb1'
    CRS-2677: Stop of 'ora.ons' on 'tesdb2' succeeded
    CRS-2673: Attempting to stop 'ora.net1.network' on 'tesdb2'
    CRS-2677: Stop of 'ora.net1.network' on 'tesdb2' succeeded
    CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'tesdb2' has completed
    CRS-2677: Stop of 'ora.asm' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.ASMNET1LSNR_ASM.lsnr' on 'tesdb1'
    CRS-2677: Stop of 'ora.crsd' on 'tesdb2' succeeded
    CRS-2673: Attempting to stop 'ora.evmd' on 'tesdb2'
    CRS-2673: Attempting to stop 'ora.storage' on 'tesdb2'
    CRS-2677: Stop of 'ora.storage' on 'tesdb2' succeeded
    CRS-2673: Attempting to stop 'ora.asm' on 'tesdb2'
    CRS-2677: Stop of 'ora.evmd' on 'tesdb2' succeeded
    CRS-2677: Stop of 'ora.ASMNET1LSNR_ASM.lsnr' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.asmnet1.asmnetwork' on 'tesdb1'
    CRS-2677: Stop of 'ora.asmnet1.asmnetwork' on 'tesdb1' succeeded
    CRS-33677: Stop of resource group 'ora.asmgroup' on server 'tesdb1' succeeded.
    CRS-2673: Attempting to stop 'ora.ons' on 'tesdb1'
    CRS-2677: Stop of 'ora.ons' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.net1.network' on 'tesdb1'
    CRS-2677: Stop of 'ora.net1.network' on 'tesdb1' succeeded
    CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'tesdb1' has completed
    CRS-2677: Stop of 'ora.crsd' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.storage' on 'tesdb1'
    CRS-2673: Attempting to stop 'ora.evmd' on 'tesdb1'
    CRS-2673: Attempting to stop 'ora.ctssd' on 'tesdb1'
    CRS-2677: Stop of 'ora.storage' on 'tesdb1' succeeded
    CRS-2677: Stop of 'ora.ctssd' on 'tesdb1' succeeded
    CRS-2677: Stop of 'ora.evmd' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.asm' on 'tesdb1'
    CRS-2677: Stop of 'ora.asm' on 'tesdb2' succeeded
    CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'tesdb2'
    CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'tesdb2' succeeded
    CRS-2673: Attempting to stop 'ora.ctssd' on 'tesdb2'
    CRS-2677: Stop of 'ora.ctssd' on 'tesdb2' succeeded
    CRS-2673: Attempting to stop 'ora.cssd' on 'tesdb2'
    CRS-2677: Stop of 'ora.cssd' on 'tesdb2' succeeded
    CRS-2677: Stop of 'ora.asm' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'tesdb1'
    CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.cssd' on 'tesdb1'
    CRS-2677: Stop of 'ora.cssd' on 'tesdb1' succeeded

Oracle High Availability Services :
    To stop cluster has

    [root@tesdb1 ~]# /u01/app/19c/grid/bin/crsctl stop has
    CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'tesdb1'
    CRS-2673: Attempting to stop 'ora.crf' on 'tesdb1'
    CRS-2673: Attempting to stop 'ora.mdnsd' on 'tesdb1'
    CRS-2673: Attempting to stop 'ora.gpnpd' on 'tesdb1'
    CRS-2677: Stop of 'ora.crf' on 'tesdb1' succeeded
    CRS-2673: Attempting to stop 'ora.gipcd' on 'tesdb1'
    CRS-2677: Stop of 'ora.gipcd' on 'tesdb1' succeeded
    CRS-2677: Stop of 'ora.mdnsd' on 'tesdb1' succeeded
    CRS-2677: Stop of 'ora.gpnpd' on 'tesdb1' succeeded
    CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'tesdb1' has completed
    CRS-4133: Oracle High Availability Services has been stopped.

To can see current settings for Oracle High Availability :
    [root@tesdb1 ~]# /u01/app/19c/grid/bin/crsctl config has
    CRS-4622: Oracle High Availability Services autostart is enabled.

To see the cluster softwareversion :
    [root@tesdb1 ~]# /u01/app/19c/grid/bin/crsctl query crs softwareversion
    Oracle Clusterware version on node [tesdb1] is [19.0.0.0.0]

Disable and enable the clusterware stack :
    [root@tesdb1 ~]# /u01/app/19c/grid/bin/crsctl disable crs
    CRS-4621: Oracle High Availability Services autostart is disabled.
    [root@tesdb1 ~]# 
    [root@tesdb1 ~]# /u01/app/19c/grid/bin/crsctl enable crs
    CRS-4622: Oracle High Availability Services autostart is enabled.


(Oracle Rac - Configuring TAF)