How to create and scale 6,000 virtual machines in 7 hours with Red Hat OpenShift Virtualization

In this learning path by Boaz Ben Shabat, learn how to create a large amount of virtual machines for a production infrastructure in less than a weekend’s worth of time. 

In this learning path by Boaz Ben Shabat, learn how to create a large amount of virtual machines for a production infrastructure in less than a weekend’s worth of time. 

Prerequisites for 7-hour large scale production

30 mins

In this scenario, very specific types of hardware and software are utilized to enact such a large scale virtual machine (VM) and pod deployment. Keep in mind that your organization’s needs may vary, but the applications of the software described can overlap in similar situations. 

What will you learn?

  • Specific hardware and software components used during this scenario

What do you need before starting?

Software prerequisites

As part of this exercise, the steps provided will include fine-tuning Red Hat® Ceph® Storage and Red Hat OpenShift® Virtualization. The following software components are necessary for this:

Hardware prerequisites

This deployment scenario utilizes specific hardware for Openshift Container Platform and Red Hat Ceph storage.

OpenShift Container Platform hardware

  • 132 PowerEdge R650
    • CPU: 112 cores (2 Intel(R) Xeon(R) Gold 6330N CPU @ 2.20GHz)
    • Memory: 512 GB (16  Micron MTA36ASF4G72PZ-3G2E7 32GB Ddr4 3200Mhz PC4-25600 Ecc)
    • SSD (root disk): 446.63 GB - 6 Gbps (MICRON SSD  MTFDDAK480TDT)
    • NVME: 3.2 TB (Dell Ent NVMe P5600 MU U.2 

Red Hat Ceph Storage hardware

  • 12 * Dell PowerEdge R750
    • CPU: 40 cores (2* Intel(R) Xeon(R) Gold 6230 CPU @ 2.10GHz)
    • Memory: 384GB ECC RAM (12 * Samsung M393A4K40BB2-CTD 2666 MT/s)
    • SSD Root disk: 1.92 TB (1 *  SEAGATE XS1920LE70134)
    • SSD Disk: 1862GiB - 6 Gbps (20 * SEAGATE XS1920LE70134)
    • NVME disk: 1.8T - 3200 MB/s (4 * Dell Ent NVMe v2 AGN MU U.2 1.6TB)

With these software and hardware components in mind, we will explore a brief overview of the networking architecture for the Ceph and OpenShift clusters. In this example, the clusters are on a private lab VLAN uses the balance-alb bond using 4* 25 GbE ports creating a single 100GbE bond.

A diagram showing a Red Hat Ceph Storage and Red Hat OpenShift clusters connected using 4* 25 GbE ports. All the hosts are going through the same QFX10008 , locally within each rack to a QFX5130 or QFX5200. The QFX5130/QFX5200 connect back to the QFX10008.
A diagram showing a Red Hat Ceph Storage and Red Hat OpenShift clusters connected using 4* 25 GbE ports

Now that the baseline needs are met, we’re ready to dive into this seven-hour journey to mass scaling of virtual machines.

Previous resource
Overview: How to create and scale 6,000 virtual machines in 7 hours with Red Hat OpenShift Virtualization
Next resource
Hour 1 - Network tuning

This learning path is for operations teams or system administrators
Developers may want to check out Foundations of OpenShift on developers.redhat.com. 

Get started on developers.redhat.com

Hybrid Cloud Logo LinkedIn YouTube Facebook Twitter

Products

Tools

Try, buy, sell

Communicate

About Red Hat

We’re the world’s leading provider of enterprise open source solutions—including Linux, cloud, container, and Kubernetes. We deliver hardened solutions that make it easier for enterprises to work across platforms and environments, from the core datacenter to the network edge.