About Me

Fremont, CA, United States

Sunday, October 18, 2009

ASM 11.1 install on RedHat 5 Linux EMC Storage

 ASM 11.1  install on RedHat 5 Linux EMC  Storage

ASM INSTALL :-

 

Red Hat Linux :

Edit system parameter file to make these changes

Checking for rmem_default=4194304; rmem_default=1048576.    Failed <<<<

Checking for rmem_max=4194304; rmem_max=1048576.    Failed <<<<

 

Check complete. The overall result of this check is: Failed <<<<

 

Edit /etc/sysctl.conf file and make these changes and after changes

 

Do as root $/sbin/sysctl –p

 

 

 

 

 

 

ASM INSTALL :

 

If it is cluster ASM Install, make sure that you have installed Cluster and Cluster is functioning properly.

 

ASM Packages are Installed & configured

 

 

In order to see whether Cluster is working properly:

Got to CRS_HOME

Cd /u01/app/oracle/product/crs/11.1/bin

./crsctl check crs

 

[oracle@host1 bin]$ ./crsctl check crs

Cluster Synchronization Services appears healthy

Cluster Ready Services appears healthy

Event Manager appears healthy

[oracle@host1 bin]$

 

 

It should return that CRS looks healthy.

Crs_stat should return ONLINE.

 

 

 

[oracle@host1 database]$ unset ORACLE_HOME

[oracle@host1 database]$ echo $PATH

/u01/app/oracle/product/crs/11.1/bin:/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin:/home/oracle:/home/oracle/bin:/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/home/oracle/bin

[oracle@host1 database]$ export PATH=/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin:/home/oracle:/home/oracle/bin:/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/home/oracle/bin:/sbin

[oracle@host1 database]$ ls

doc install response runInstaller stage welcome.html

 

[oracle@host1 database]$ ./runInstaller

 

 

 

 

 

 

 

 

 

Overall result should be passed, if there are any missing packages, install them before you proceed.

 

 

 

In this case, we are making a disk group for Archive Log.

e.g.

Name: DG_DBNAME_ARCH

 

Click on Change Disk Discovery Path and Enter /dev/oracleasm/disks/ASM*

 

Before you should do this step, if have to configure asmlib.

 

 

 

 

 

 

 

It was due to Linux Firewall . Once sys admin disabled Linux Firewall , error was gone.

 

 

 

 

 

 

 

Node 1:

 

 

 

 

 

 

 

 

 

Subject:  

Oracleasm Createdisk Fails: Device '/dev/emcpoweraxx Is Not A Partition [Failed]

  

Doc ID:

Note:469163.1

Type:  

PROBLEM

  

Last Revision Date:  

04-JUN-2008

Status:  

PUBLISHED

In this qaDocument
  Symptoms
  Cause
  Solution
  References

Applies to:

Linux Kernel - Version: 2.0.3.1
Linux x86-64
Linux x86

Symptoms

oracleasm createdisk fails with

Marking disk "/dev/emcpowera11" as an ASM disk: asmtool: Device "/dev/emcpowera11" is not a
partition
[FAILED]



even though the disk is properly formatted and has the requisite partition

Cause

EMC Powerpath Versions 5.0.1 and 5.1 do not properly support the i/o calls that oracleasm makes




.

Solution

To implement the solution, please execute the following steps:


1. Do the "/etc/init.d/oracleasm createdisk" operation using the "asmtool" command directly:

/usr/sbin/asmtool -C -l /dev/oracleasm -n <volume name> -s /dev/<emc device> -a force=yes

The tool will report:

asmtool: Device "/dev/<emc device>" is not a partition
asmtool: Continuing anyway


2. The permissions of the volume under /dev/oracleasm/disks/ will be "root: root"
Reboot the system to correct this.

3. Further use of the device can now be done normally using the powerpath device name

 

 

** Please Note: These steps need to be done all Nodes :-

  1. Install Oracle ASM Library
  2. Configure ASM

    edit vi /etc/sysconfig/oracleasm and edit ORACLEASM_SCANORDER line like this:

    # ORACLEASM_SCANORDER: Matching patterns to order disk scanning

    ORACLEASM_SCANORDER="/dev/emcpower"

    Edit ORACLEASM_SCANEXCLUDE like this

    # ORACLEASM_SCANEXCLUDE: Matching patterns to exclude disks from scan

    ORACLEASM_SCANEXCLUDE="sd"

  3. Create ASM Device

 

 

ASM Linux Package :-

 

[root@host2 software]# rpm -ivh oracleasm-support-2.0.4-1.el5.i386.rpm

Preparing... ########################################### [100%]

1:oracleasm-support ########################################### [100%]

[root@host2 software]# rpm -ivh oracleasmlib-2.0.3-1.el5.i386.rpm

error: Failed dependencies:

oracleasm >= 1.0.4 is needed by oracleasmlib-2.0.3-1.el5.i386

[root@host2 software]# rpm -ivh oracleasm-2.6.18-92.1.10.el5PAE-2.0.4-1.el5.i686.rpm

Preparing... ########################################### [100%]

1:oracleasm-2.6.18-92.1.1########################################### [100%]

[root@host2 software]# rpm -ivh oracleasmlib-2.0.3-1.el5.i386.rpm

Preparing... ########################################### [100%]

1:oracleasmlib ########################################### [100%]

 

[root@host2 software]# /etc/init.d/oracleasm configure

Configuring the Oracle ASM library driver.

 

This will configure the on-boot properties of the Oracle ASM library

driver. The following questions will determine whether the driver is

loaded on boot and what permissions it will have. The current values

will be shown in brackets ('[]'). Hitting <ENTER> without typing an

answer will keep that current value. Ctrl-C will abort.

 

Default user to own the driver interface []: oracle

Default group to own the driver interface []: dba

Start Oracle ASM library driver on boot (y/n) [n]: y

Fix permissions of Oracle ASM disks on boot (y/n) [y]:

Writing Oracle ASM library driver configuration: [ OK ]

Creating /dev/oracleasm mount point: [ OK ]

Loading module "oracleasm": [ OK ]

Mounting ASMlib driver filesystem: [ OK ]

Scanning system for ASM disks:

[ OK ]

 

 

[root@host2 software]# ls -ltr /dev/emc*

crw-r--r-- 1 root root 10, 62 Sep 9 15:06 /dev/emcpower

brw-r----- 1 root disk 120, 48 Sep 9 15:06 /dev/emcpowerd

brw-r----- 1 root disk 120, 0 Sep 9 15:06 /dev/emcpowera

brw-r----- 1 root disk 120, 64 Sep 9 15:06 /dev/emcpowere

brw-r----- 1 root disk 120, 16 Sep 9 15:06 /dev/emcpowerb

brw-r----- 1 root disk 120, 32 Sep 9 15:06 /dev/emcpowerc

brw-r----- 1 root dba 120, 1 Sep 9 15:06 /dev/emcpowera1

brw-r----- 1 oracle dba 120, 5 Sep 9 15:06 /dev/emcpowera5

brw-r----- 1 oracle dba 120, 3 Sep 9 15:06 /dev/emcpowera3

brw-r----- 1 root disk 120, 4 Sep 9 15:06 /dev/emcpowera4

brw-r----- 1 root dba 120, 2 Sep 9 15:06 /dev/emcpowera2

brw-r----- 1 oracle dba 120, 6 Sep 9 15:06 /dev/emcpowera6

brw-r----- 1 root disk 120, 17 Sep 10 10:30 /dev/emcpowerb1

brw-r----- 1 root disk 120, 49 Sep 10 10:31 /dev/emcpowerd1

brw-r----- 1 root disk 120, 65 Sep 10 10:31 /dev/emcpowere1

[root@host2 software]#

 

You can create ASM devices like this:

/etc/init.d/oracleasm createdisk ASMARCH01 /dev/emcpowera1

 

Where etc/init.d/oracleasm is command name

Createdisk is parameter

ASMARCH01 is name you want to give

/dev/emcpowera1 is real emc device name (emcpowera1 is partition 1 of emcpowera)

 

When you run this command, it gives error:

This error has to do with EMC Powerpath:

 

Oracleasm Createdisk Fails: Device '/dev/emcpoweraxx Is Not A Partition [Failed]

 

In order to create this, you need to run like this:

 

We need to create all ASM devices Archive , DATA etc.

 

[root@host2 sysconfig]# /usr/sbin/asmtool -C -l /dev/oracleasm -n ASMARCH01 -s /dev/emcpower -a force=yes

asmtool: Device "/dev/emcpowerd1" is not a partition

asmtool: Continuing anyway

 

chown -R oracle:dba /dev/oracleasm

chown oracle:dba ASMARCH01

 

Display EMC Powerpath LUN Information :

 

 

 

/sbin/powermt display dev=all

 

 

 

 

 

/usr/sbin/asmtool -C -l /dev/oracleasm -n ASMDATA01 -s /dev/emcpowerh -a force=yes

 

/usr/sbin/asmtool -C -l /dev/oracleasm -n ASMDATA02 -s /dev/emcpowerg -a force=yes

 

/usr/sbin/asmtool -C -l /dev/oracleasm -n ASMDATA03 -s /dev/emcpowerf -a force=yes

 

/usr/sbin/asmtool -C -l /dev/oracleasm -n ASMDATA04 -s /dev/emcpoweri -a force=yes

 

chown -R oracle:dba ASMDA*

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

No comments: