Configuring an S3 gateway for the Cyber Backup Cloud service
The S3 gateway for the Cyber Backup Cloud service allows you to use the public cloud service VK Object Storage for storing backups.
As a configuration example, an S3 gateway will be created for the Cyber Backup Cloud service in a high-availability configuration with a storage cluster of three nodes.
- Contact technical support to create an account and an organization tenant for the S3 gateway, and to get the ability to connect partner storages to the tenant.
- Go to the VK Cloud management console.
- Make sure that the project has enough quotas to create a storage cluster of three VMs and three disks of 1 TB each, and that the limits allow this.
- Make sure that the OpenStack client is installed, and authenticate in the project.
- Create a key pair for connecting to the VM over SSH. For example, name it
vk-ssh.
- Create a network without internet access and without a router. In this example:
private-storage-network. - Edit the subnet created for this network, specifying the required parameters. In this example:
- subnet name:
private-storage-subnet; - subnet address:
192.168.0.0/24.
- subnet name:
- Create a network with internet access and a router. In this example:
public-storage-network. - Edit the subnet created for this network, specifying the required parameters. In this example:
- subnet name:
public-storage-subnet; - subnet address:
10.0.0.0/24; - DHCP IP address pool:
10.0.0.10–10.0.0.250.
- subnet name:
-
Create a security group with an easily recognizable name. In this example:
cyber. -
Add inbound traffic rules to it:
- First rule:
- Type:
SSH, - Protocol:
TCP, - Ports:
22, - Remote address:
All IP addresses.
- Second rule:
- Type:
ALL TCP, - Protocol:
TCP, - Ports:
8888, - Remote address:
All IP addresses.
-
Add an outbound traffic rule to the same security group:
- Type:
All protocols and ports, - Remote address:
All IP addresses.
- Type:
-
Download the Cyber Storage image — software that allows you to organize an S3 gateway and store backups from Cyber Backup solutions in public clouds.
-
Import the image using the OpenStack CLI:
openstack image create --progress \--file cyber-storage.qcow2 \--disk-format qcow2 \--container-format bare \Cyber-storage -
Create a virtual machine with the following parameters:
- Operating system: the previously imported
Cyber-storageimage; - Name: any convenient name, in this example —
cb-01; - VM type:
STD3-4-8; - Availability zone: any suitable availability zone;
- Disk size:
250 GB; - Disk type:
SSD; - Network:
public-storage-network; - VM key:
vk-ssh; - Firewall settings:
Default,cyber; - Assign external IP: option enabled.
Wait until the created VM boots up and the login prompt appears.
- Operating system: the previously imported
-
Connect the
private-storage-networknetwork to the VM. When connecting, specify:- a specific IP address from the available range of the
private-storage-subnetsubnet; - the
All allowed(all) security group.
- a specific IP address from the available range of the
-
In the availability zone selected for the VM, create a storage disk with the required size and connect it to the VM. Save the disk name.
-
Create two virtual machines with the following parameters:
- Operating system: the previously imported
Cyber-storageimage; - Name: any convenient names, in this example —
cb-02andcb-03; - VM type:
STD3-4-8; - Availability zone: any suitable availability zone;
- Disk size:
250 GB; - Disk type:
SSD; - Network:
public-storage-network; - VM key:
vk-ssh; - Firewall settings:
Default,cyber— both security groups for each VM; - Assign external IP: option disabled.
Wait until each of the created VMs boots up and the login prompt appears.
- Operating system: the previously imported
-
Connect the
private-storage-networknetwork to the created VMs. When connecting, specify for each VM:- a specific IP address from the available range of the subnet;
- the
All allowed(all) security group.
-
In the selected availability zone, create disks of the same size as for the management node for each VM, and connect the disks to the corresponding VMs. Save the disk names.
-
Connect to the
cb-01virtual machine, using thecloud-userusername and the private key from the previously created key pair. -
Get and save the password for the Cyber Storage management panel:
cat /.initial-admin-passwordSave this password.
-
Go to the Cyber Storage management panel:
- Open the address
<VM_EXTERNAL_IP_ADDRESS>:8888in your browser. - Enter the login
adminand the password you obtained earlier.
- Open the address
-
Go to the Infrastructure → Networks section and rename the
Privatenetwork toPublic. -
Click the Create Network button and create a
Privatenetwork. -
Create a storage cluster:
- Go to the Infrastructure → Servers section.
- Click Create storage cluster.
- Specify the cluster name. For example,
backupcloud. - (Optional) Select the encryption type.
- Click the Create button.
-
Connect additional nodes:
-
Go to the Servers section and click the Connect Server button.
-
Save the IP address and token for connecting the nodes.
-
Connect over SSH to the
cb-02andcb-03VMs one after another, and run the following command on each of them:sudo -i/usr/libexec/init-ifaces/usr/libexec/vstorage-ui-agent/bin/register-storage-node.sh -m <IP_ADDRESS> -t <TOKEN> -
Return to the Cyber Storage management panel and go to the Infrastructure → Servers section. Make sure that the server list contains three nodes:
cb-01,cb-02,cb-03.
-
-
Configure the network interfaces:
-
Click the node name and go to the Network interfaces tab.
-
Change the interface settings:
eth0eth1- Click
for the interface and select Edit.
- Assign the
Publicnetwork to the interface. - Save the changes.
- Click
-
Repeat these steps for each of the nodes.
-
-
Join the additional nodes to the storage cluster:
- Go to the Infrastructure → Servers section.
- For the
cb-02andcb-03nodes, clickone after another and select Join cluster → Apply.
- Wait until all nodes have the "Healthy" status.
-
Assign different traffic types to the networks:
-
Go to the Infrastructure → Servers section.
-
Using the Assign Networks and Assign to networks buttons, assign the following traffic types to the networks.
Private networkPublic networkStorage;Internal management;OSTOR private;Backup (ABGW) private.
-
-
Initialize the disks and assign roles to them:
- Go to the Infrastructure → Servers section.
- Click the
cb-01node name, the Disks tab will open. - Assign roles to the disks:
- for
vda— the Metadata role; - for
vdb— the Storage role.
- for
- Confirm the operation and wait for the node to finish being added to the cluster.
- Repeat the same steps for the
cb-02andcb-03nodes.
-
Get the list of ports of the
public-storage-subnetsubnet. Write down the port IDs of thecb-01,cb-02, andcb-03VMs in this subnet. -
Create a port in the
public-storage-networknetwork and thepublic-storage-subnetsubnet, specifying a specific IP address from the subnet's address pool and the port name. In this example —10.0.0.252.openstack port create -network <NETWORK_ID> -fixed-ip subnet=<SUBNET_ID>,ip-address=10.0.0.252 <PORT_NAME> -
Add this IP address to the list of allowed addresses for the ports of the VMs directed to the
public-storage-subnetsubnet:openstack port set --allowed-address ip-address=10.0.0.252 <CB-01_VM_PORT_ID>openstack port set --allowed-address ip-address=10.0.0.252 <CB-02_VM_PORT_ID>openstack port set --allowed-address ip-address=10.0.0.252 <CB-03_VM_PORT_ID> -
Create a load balancer with the following parameters:
- Load balancer name:
cb-balancer; - Network:
public-storage-network; - Assign external IP: option enabled.
- Load balancer name:
-
Wait for the load balancer to be created and save its external IP address.
-
Add a rule for this load balancer:
-
Create a listener:
openstack loadbalancer listener create --name <LISTENER_NAME> \--protocol TCP --protocol-port 8888 <LOAD_BALANCER_ID> -
Create a balancing pool:
openstack loadbalancer pool create --name <POOL_NAME> \--protocol TCP --lb-algorithm ROUND_ROBIN --listener <LISTENER_NAME> -
Add pool members:
openstack loadbalancer member create --address 10.0.0.252 \--subnet-id <PUBLIC-STORAGE-SUBNET_ID> --protocol-port 8888 <POOL_NAME> -
Create a health check:
openstack loadbalancer healthmonitor create --type TCP \--delay 5 --timeout 3 --max-retries 3 <POOL_NAME>
-
-
Go to the Cyber Storage management panel and open the Settings → Management Server → High Availability section.
-
Select the three created nodes and click the Create high availability configuration button, then click Continue.
-
For the
public-storage-subnetsubnet, specify the virtual IP address10.0.0.252. -
Confirm the configuration creation.
-
Check the availability of the management server at the external IP address of the load balancer by entering
https://<LOAD_BALANCER_EXTERNAL_IP_ADDRESS>:8888in your browser's address bar. -
(Optional) Delete the public IP address assigned to the
cb-01VM. You can now go to the Cyber Storage management panel using the external IP address of the load balancer. -
Add a rule with the following parameters to the previously created load balancer:
- Balancing protocol:
TCP; - Port:
44445; - Apply to the following instances:
cb-01,cb-02,cb-03.
- Balancing protocol:
-
Assign an external domain name to the external IP address of the load balancer.
-
Go to the Cyber Storage management panel.
-
Go to the Services → Backups section and click the Create backup storage button.
-
At the Backup destination step, select Cloud service and click the Next button.
-
At the Servers step, select all nodes for storage and click the Next button.
-
At the Cloud service step:
- Select the object storage type:
AuthV2-compatible (S3). - Enter the VK Object Storage endpoint URL:
https://hb.vkcloud-storage.ruorhttps://hb.ru-msk.vkcloud-storage.ru— for the Moscow region;https://hb.kz-ast.vkcloud-storage.ru— for the Kazakhstan region.
- Enter the bucket name and its access keys.
- Enable the Allow self-signed certificate to the endpoint option.
- Click the Next button.
- Select the object storage type:
-
At the Storage policies step:
- Select the
Nodefailure domain. - Select the redundancy mode that matches your organization's policies.
- Click the Next button.
- Select the
-
At the DNS step:
- Specify the external domain name assigned to the load balancer.
- Make sure that your DNS server configuration matches the example shown in the interface. Change it if necessary.
- Click the Next button.
-
At the Cyberprotect account step:
-
Specify the cloud console URL:
https://ru01-cloud.cyberprotect.ru. -
Enter the login and password for accessing the organization's tenant, obtained from technical support.
-
Click the Next button.
-
-
At the Summary step, review the configuration, click the Create button, and wait for the gateway to be created.
- Log in at
https://ru01-cloud.cyberprotect.ru. - Create users and administrators.
- Delegate the connected gateway for backups in the user settings when creating or editing a user.
- Go to the Clients section.
- Create client tenants in the organization tenant, and specify the new S3 backup storage for them.
- Create a backup in the Cyber Backup Cloud service.
- Make sure that the backup is saved in the VK Object Storage bucket.
A running service infrastructure consumes compute resources. If you no longer need the S3 gateway and the storage cluster, delete them: