How to provision better storage and enhance cluster deployments on Red Hat OpenShift Service on AWS with Amazon FSx for NetApp ONTAP

Learn how to create container applications and virtual machines on Red Hat® OpenShift® Service on AWS clusters using Internet Small Computer System Interface (iSCSI) volumes with Amazon FSx for NetApp ONTAP. Provision better storage and enhance your cluster deployments.

Authors: Mayur Shetty, Principal Ecosystem Solution Architect, Red Hat and Banu Sundhar, Senior Technical Marketing Engineer, NetApp

Learn how to create container applications and virtual machines on Red Hat® OpenShift® Service on AWS clusters using Internet Small Computer System Interface (iSCSI) volumes with Amazon FSx for NetApp ONTAP. Provision better storage and enhance your cluster deployments.

Authors: Mayur Shetty, Principal Ecosystem Solution Architect, Red Hat and Banu Sundhar, Senior Technical Marketing Engineer, NetApp

Using iSCSI storage for VMs on Red Hat OpenShift Virtualization in ROSA

15 mins

With Red Hat® OpenShift® Virtualization you can run Virtual Machines (VMs) alongside containerized applications on the same Red Hat OpenShift cluster, managing both from a single platform. The ontap-san driver supports the RWX access mode in Block Volume Mode for iSCSI, making it ideal for VM disks and enabling live migration of VMs.

What will you learn?

  • How to install Red Hat OpenShift Virtualization
  • How to deploy and customize VMs using iSCSI storage class

What you need before starting:

Verify you have baremetal nodes as worker nodes in the cluster.

To be able to create VMs, you need to have bare metal nodes on the ROSA cluster.

Figure 1: In the ROSA console under "Nodes" you can see that the c5.metal nodes are being used as the worker nodes.

Figure 1: In the ROSA console under "Nodes" you can see that the c5.metal nodes are being used as the worker nodes.

Install Red Hat OpenShift Virtualization using the Operator

You can install Red Hat OpenShift Virtualization using the OpenShift Virtualization Operator in the Operator hub. Once it is installed and configured, Virtualization will be populated in the UI of the OpenShift Console.

Figure 2: screenshot of the Installed Operators selection, with OpenShift Virtualization highlighted and selected on the bottom left

Figure 2
 

Figure 3: shows the VirtualMachines screen under "Virtualization" with confirmation that there are no VMs running on the cluster

Figure 3: The screen shot above shows that currently there are no VMs running on the cluster.

Deploy a VM using iSCSI storage class

  1. Click on Create VirtualMachine (see Figure X) and select From template.
    Figure 4: screenshot of the Create VirtualMachine dropdown, with "From template" selected
    Figure 4
  2. Select Fedora VM. 
    1. Note: You can choose any OS that has a source available.

      Figure 5: screenshot of Create new VirtualMachine template catalog, highlighting Fedora VM
      Figure 5

Customize the VM

Customize the VM to provide the storage class for the boot disk and create additional disks with the selected storage class.

  1. Click on Customize VirtualMachine.
    Figure 6: screenshot of the Customize VM form, showing Fedora VM with the template default selected under disk source, the start VM after creation box checked yes, and the blue Quick create VM box highlighted in the lower left corner
    Figure 6
     
  2. Click on the Disks tab and click on Edit for the root disk
    Figure 7: screenshot showing the edit options under the disk tab, including name, source, size, drive, interface, and storage class
    Figure 7
  3. Ensure you have selected sc-fsx-san for storage class.
  4. Select Shared Access (RWX) for Access Mode and select Block for Volume Mode. Trident Supports RWX Access mode for iSCSI storage in Volume Mode Block. This setting is a requirement for the PVC of the disks so that you can perform live migration of VMs. Live migration is migration of a VM from one worker node to another for which RWX access mode is required and Trident supports it for iSCSI in Block Volume Mode.
    Figure 8: edit disk form with interface dropdown menu set to VirtIO and storage class set to sc-fsx-san. Shared access (RWX) and volume mode block are also selected.
    Figure 8
    1. Note: If you check the Apply optimized StorageProfile Settings, then it automatically chooses RWX and Volume mode Block. If sc-fsx-san was set as the default storage in the cluster, then this storage class will automatically be picked.
  5. Click Add disk and select empty disk (since this is just an example) and ensure that sc-fsx-san disk is chosen (Figure 9). Make sure the optimized StorageProfile setting is checked. Click Save and then click Create VirtualMachine  (Figure 10). The VM comes to a running state (Figure 11).
    Figure 9: screenshot of Add disk, interface set to VirtIO, storage class sc-fsx-san, and "apply optimized StorageProfile settings" selected
    Figure 9

    Figure 10: screen shot showing the "start this VM after creation" button highlighted above the "create VM" button in lower left
    Figure 10

    Figure 11: screenshot showing the VM fedora-demo is running
    Figure 11
  6. Check the VM pods, PVCs. Verify that PVCs are created using iSCSI storage class and RWX Access modes.
    Figure 12: command # oc get pods, pvc -n demo results in ready, status, restart, and age information
    Figure 12
  7. Verify that a LUN is created in each volume corresponding to the disk PVCs by logging into the FSxN CLI.
    Figure 13: lun show command being run to reflect the vserver path and groups to verify that each volume is corresponding to the correct disk PvCs.
    Figure 13

You have now successfully deployed and customized VMs using iSCSI storage class with Red Hat OpenShift Virtualization!

Previous resource
Using iSCSI storage for container apps on ROSA
Next resource
Conclusion

This learning path is for operations teams or system administrators

Developers may want to check out Transitioning to ROSA HCP on developers.redhat.com. 

Get started on developers.redhat.com

Hybrid Cloud Logo LinkedIn YouTube Facebook Twitter

Products

Tools

Try, buy, sell

Communicate

About Red Hat

We’re the world’s leading provider of enterprise open source solutions—including Linux, cloud, container, and Kubernetes. We deliver hardened solutions that make it easier for enterprises to work across platforms and environments, from the core datacenter to the network edge.

© 2025 Red Hat