ARO cluster ARM template

Deploy an Azure Red Hat OpenShift cluster and connect it to Azure Arc using an Azure ARM template

The following Jumpstart scenario will guide you on how to use the provided Azure ARM Template to deploy an Azure Red Hat OpenShift cluster and connected it as an Azure Arc cluster resource.

Prerequisites

Clone the Azure Arc Jumpstart repository

git clone https://github.com/microsoft/azure_arc.git

Install or update Azure CLI to version 2.49.0 and above. Use the below command to check your current installed version.
```
az --version
```
Create Azure service principal (SP)

To be able to complete the scenario and its related automation, Azure service principal assigned with the “Owner” role, or “Contributor” and “User Access Administrator” roles are required. To create it, login to your Azure account run the below command (this can also be done in Azure Cloud Shell).
```
az login
subscriptionId=$(az account show --query id --output tsv)
az ad sp create-for-rbac -n "<Unique SP Name>" --role "Contributor" --scopes /subscriptions/$subscriptionId
az ad sp create-for-rbac -n "<Unique SP Name>" --role "User access administrator" --scopes /subscriptions/$subscriptionId
```
For example:
```
az login
subscriptionId=$(az account show --query id --output tsv)
az ad sp create-for-rbac -n "JumpstartArcK8s" --role "Contributor" --scopes /subscriptions/$subscriptionId
az ad sp create-for-rbac -n "JumpstartArcK8s" --role "User access administrator" --scopes /subscriptions/$subscriptionId
```
Output should look like this:
```
{
"appId": "XXXXXXXXXXXXXXXXXXXXXXXXXXXX",
"displayName": "JumpstartArcK8s",
"password": "XXXXXXXXXXXXXXXXXXXXXXXXXXXX",
"tenant": "XXXXXXXXXXXXXXXXXXXXXXXXXXXX"
}
```
NOTE: If you create multiple subsequent role assignments on the same service principal, your client secret (password) will be destroyed and recreated each time. Therefore, make sure you grab the correct password.

NOTE: The Jumpstart scenarios are designed with as much ease of use in-mind and adhering to security-related best practices whenever possible. It is optional but highly recommended to scope the service principal to a specific Azure subscription and resource group as well considering using a less privileged service principal account

Enable subscription with the resource providers for Azure Arc-enabled Kubernetes and Azure Red Hat OpenShift. Registration is an asynchronous process, and registration may take approximately 10 minutes.

az provider register --namespace Microsoft.Kubernetes --wait
az provider register --namespace Microsoft.KubernetesConfiguration --wait
az provider register --namespace Microsoft.ExtendedLocation --wait
az provider register --namespace Microsoft.RedHatOpenShift --wait

You can monitor the registration process with the following commands:

az provider show -n Microsoft.Kubernetes -o table
az provider show -n Microsoft.KubernetesConfiguration -o table
az provider show -n Microsoft.ExtendedLocation -o table
az provider show -n Microsoft.RedHatOpenShift -o table

Check your subscription quota for the DSv3 family.

NOTE: Azure Red Hat OpenShift requires a minimum of 40 cores to create and run an OpenShift cluster.
```
LOCATION=eastus
az vm list-usage -l $LOCATION --query "[?contains(name.value, 'standardDSv3Family')]" -o table
```

Get the Azure Red Hat OpenShift resource provider Id which needs to be assigned with the “Contributor” role.

az ad sp list --filter "displayname eq 'Azure Red Hat OpenShift RP'" --query "[?appDisplayName=='Azure Red Hat OpenShift RP'].{name: appDisplayName, objectId: id}"

Screenshot of Azure resource provider for Aro

Deployment Options and Automation Flow

This Jumpstart scenario provides multiple paths for deploying and configuring resources. Deployment options include:

Azure portal
ARM template via Azure CLI

For you to get familiar with the automation and deployment flow, below is an explanation.

User provides the ARM template parameter values, either via the portal or editing the ARM template parameters file (1-time edit). These parameters values are being used throughout the deployment.
Main azuredeploy ARM template will initiate the deployment of the Azure Red Hat OpenShift cluster and the virtual network.
User edits the environment variables section in the in the az_connect_aro.sh script file (1-time edit). These variables’ values will be used throughout the deployment.
At a high level, the script will then perform the following tasks:
- Install the required Azure Arc-enabled Kubernetes required Azure CLI extension
- Automatically login to Azure using the provided service principal credentials and will create the deployment Azure resource group
- Download and install all the Azure Red Hat OpenShift CLI.
- Onboard the cluster as an Azure Arc-enabled Kubernetes cluster

Deployment Option 1: Azure portal

Click the button and enter values for the the ARM template parameters.

Deployment Option 2: ARM template with Azure CLI

The deployment is using the template parameters file. Before initiating the deployment, edit the azuredeploy.parameters.json file to match your environment.

Screenshot of Azure ARM template

To deploy the ARM template, navigate to the deployment folder and run the below command:

az group create --name <Name of the Azure resource group> --location <Azure Region>
az deployment group create \
--resource-group <Name of the Azure resource group> \
--name <The name of this deployment> \
--template-uri https://raw.githubusercontent.com/microsoft/azure_arc/main/azure_arc_k8s_jumpstart/aro/arm_template/azuredeploy.json \
--parameters <The _azuredeploy.parameters.json_ parameters file location>

For example:

az group create --name Arc-Aro-Demo --location "East US"
az deployment group create \
--resource-group Arc-Aro-Demo \
--name arcarodemo01 \
--template-uri https://raw.githubusercontent.com/microsoft/azure_arc/main/azure_arc_k8s_jumpstart/aro/arm_template/azuredeploy.json \
--parameters azuredeploy.parameters.json

NOTE: It normally takes about ~30-40 minutes for the ARO cluster to deploy.

Once the ARM template deployment is completed, a new Azure Red Hat OpenShift cluster in a new Azure resource group is created.

Connecting to Azure Arc

Now that you have a running Azure Red Hat OpenShift cluster, edit the environment variables section in the included az_connect_aro shell script.
In order to keep your local environment clean and untouched, we will use Azure Cloud Shell (located in the top-right corner of the Azure portal) to run the az_connect_aro shell script against the Aro cluster. Make sure Cloud Shell is configured to use Bash.
After editing the environment variables in the az_connect_aro shell script to match your parameters, save the file and then upload it to the Cloud Shell environment and run it using the . ./az_connect_aro.sh command.

NOTE: The extra dot is due to the script having an export function and needs to have the vars exported in the same shell session as the other commands.
Once the script run has finished, the Aro cluster will be projected as a new Azure Arc-enabled Kubernetes cluster resource.

Logging

For ease of troubleshooting and tracking, a deployment log will be created automatically as part of the script runtime. To view the deployment log use the below command:

cat /home/<USER>/jumpstart_logs/onboardARO.log

Cleanup

To delete the entire deployment, simply delete the resource group from the Azure portal.

Screenshot showing how to delete Azure Arc-enabled Kubernetes resource