Blog about Oracle, Linux..

Setup a storage server for RAC using Openfiler and iSCSI

June 25th, 2009 . by admin

Download Openfiler

Openfiler http://www.openfiler.com/community/download/
choose: x86 – ISO Image (x86) – Installation ISO image (x86)
download result: file openfiler-2.3-x86-disc1.iso size 314MB


1. Create a virtual machine for Openfiler

Openfiler Server
Name: Openfiler23
Memory: 768 MB
HardDisk: 3GB
Network Adapter 1 Bridget
Network Adapter 2 Host-only


NIC IP address Subnet Gateway Network connection
eth0 Bridged
eth1   Host-only

Map the CD/DVD drive using the ISO file of OpenFiler openfiler-2.3-x86-disc1.iso
Link: How to create a virtual machine


2. Install Openfiler

Steps to install Openfiler with all default:

Screen Action
On VMWare right click machine Openfiler23
-> Power On to start the installation
Boot Screen Press <ENTER> to start the graphical installation
Welcome to rPath Linux Press OK or Skip the media test
Welcome to Openfiler NSA (32-bit PAE) Click Next
Dialog Keyboard Configuration - Choose the appropritate keyboard
– Click Next
Partitioning Setup Accept default automatically partition
.Click Next
.Click Yes when message: Would you like to initialize this drive…
Automatic Partitioning Accept all default
Click next
Disk Setup Accept all default
.Click next
Network Configuration - Select eth0 – Click Button Edit:
  .Deselect ‘Configure using DHCP’
  .Select ‘Activate on boot’
  .IP Address:
  .Click Ok

– Select eth0 – Click Button Edit:
  .Deselect ‘Configure using DHCP’
  .Select ‘Activate on boot’
  .IP Address:
  .Click Ok

– Choose Set the hostname manually: openfiler23.localdomain
– Setting Gateway:
– Click Next

– Message Error With Data: Yout have not specified the field
"Primary DNS"..
– Click Continue


Time Zone Selection - Select your Location
– Click Next
Set Root Password - Specify password for root
– Click Next
About to Install - Click Next

..and reboot
- Openfiler present the Welcome Terminal. Pic01
- Login as root and password specified during the installaltion
- and shutdown immediate with: # shutdown -h now
- Next we want add the shared storage disk



3. Create virtual storage shared disks

For a RAC installation, we need for example:

Overview shared disks
Disk 1 1GB Place for Clusterfile OCR, VotingDisk
Disk 2 5GB Place for database file. ASM volume 1, 2, 3,4
Disk 3 5GB

Link: Howto create virtual shared disks on VMWare

Result: created shared disks

Directory of M:\VM\SharedDisks
06/11/2009  01:08 AM    <DIR>          .
06/11/2009  01:08 AM    <DIR>          ..
06/11/2009  01:03 AM     1,073,741,824 disk1-flat.vmdk
06/11/2009  01:03 AM               396 disk1.vmdk
06/11/2009  01:06 AM     5,368,709,120 disk2-flat.vmdk
06/11/2009  01:06 AM               397 disk2.vmdk
06/11/2009  01:08 AM     5,368,709,120 disk3-flat.vmdk
06/11/2009  01:08 AM               397 disk3.vmdk
   6 File(s) 11,811,161,254 bytes
   2 Dir(s)  23,387,648,000 bytes free


4. Add shared disks to machine openfiler

Right click virtual machine Openfiler23 -> Setting
Dialog Virtual Machine Settings - Click Button Add
Dialog Add Hardware Wizard - Choose Hard Disk
– Click Next
Dialog Select a Disk - Choose Use an existing virtual disk
– Click Next
Dialog Select an Existing Disk - Specify Disk file: M:\VM\SharedDisks\disk1.vmdk
– Click Mode Independent
– Click Finish
– When message ‘Convert existing virtual disk to newer format?’
choose ‘Keep Existing Format’
– Click OK
– Repeat the step to add shared disk2 and 3
Click OK to finish adding shared disk


5. Configure iSSCI storage with Openfiler

Steps to configure Openfiler iSCSI
Starting - Power on machine Openfiler23. Pic01
– From host machine open a browser with address:
– Screen: When Certificate Error: Navigation Blocked. Pic02
– Click Continue to this website (not recommended)
– Login with Username: openfiler. Password=password. Pic03
Enable service iSCSI Pic 04
– Click tab ‘Services’
– Click link ‘Enable’ at row ‘iSCSI target server’
Network Access Configuration - Click tab ‘System’. Scroll down
Specified ips from which can access Openfiler

Name Network/Host Netmask Type
rac1-public Shared
rac1-priv Shared
rac2-public Shared
rac2-priv Shared

Summary: Pic05

Create disk partition - Click tab ‘Volumes’
– Click ‘Block Devices’ on topic box ‘Volumes section’ on the right
– Click link /dev/sdb. Pic06
– Scroll down and click button ‘Create’ .Pic07
– Goback by click ‘Block Devices’ and create partitions for /dev/sdc, /dev/sdd
– Summary Pic08
Create new Volume Group - Click ‘Volume Group’ on topic box ‘Volumes section’ on the right
– Specify Volume Group name, for example: vstorage
– Select all disks. My volume group should contents all 3 disks
– Click ‘Add volume group’
– see: Pic09
Add Volume

- Click ‘Add Volume’ on topic box ‘Volumes section’ on the right
– Scroll down
– Create a volume
– Volume name: ocfs2
– Volume Description: ocr and voting disk
– Required Space(MB): 1024
– Filesystem/Volume type: iSCSI
– Click Create
– see: Pic10

- Repeat the steps to create 4 new volumes: asm1 bis asm4 with size 2.5GB(2560MB)

Volume Name Volume Description Volume Size Volume type
ocfs2 ocr and voting disk 1024MB iSCSI
asm1 asm volume 1 2560MB iSCSI
asm2 asm volume 2 2560MB iSCSI
asm3 asm volume 3 2560MB iSCSI
asm4 asm volume 4 2560MB iSCSI

Summary: Pic11

Create and configure Target

- Click Tab ‘Volumes’.
– Click ‘iSCSI Targets’ on topic box ‘Volumes section’ on the right

Add an iSCSI Target:
– Sub tab: Target Configuration
– Accept generated default Target IQN. Click Add

Mapping LUN
– Sub tab: LUN Mapping
– Click Button Map to map a volume. Pic13
– Map all other volumes!
– Summary: LUN Mapping Pic14

Network ACL
– Click subtab ‘Network ACL’
– Select access ‘Allow’ for all hosts. Click button Update.
– Summary: Pic15