Loading audit logs into SIEM ArcSight and searching for events
Using the Cloud Audit service and VK Object Storage, you can configure the transfer of VK Cloud platform audit logs to the ArcSight SIEM system to comply with security policy requirements (PCI DSS, GDPR, 152-FZ). The Cloud Audit service collects security events from VK Cloud cloud services and virtual machines — both from the management layer (who created a bucket, who changed settings) and the data layer — and sends them to ArcSight in CEF (Common Event Format).
The following data is used as an example below:
- IP address of the deployed ArcSight system instance:
192.168.1.100 - ArcSight port for receiving messages:
514 - Connection name:
ArcSight-Production - Data transfer protocol:
TCP over TLS - Test user address:
admin@example.com - Test user IP address:
203.0.113.50
-
Make sure that you have access to the VK Cloud management console with one of the basic roles:
Project Owner,Superadministrator,Project Administrator, orViewer. -
Create an account for the VK Object Storage service, if this has not been done yet:
-
Go to the VK Cloud management console.
-
Select a project.
-
Go to the Object Storage → Accounts section.
-
Click the Add Account or Add button.
-
Set the account name.
-
Click the Create button.
-
In the window that opens, copy and save the access key identifier (Access Key ID) and the secret key (Secret Key).
-
-
Make sure that the ArcSight SIEM system is deployed and available for network connection from VK Cloud.
-
Open the port of your SIEM system to receive messages from VK Cloud. For more details on the required settings, see the official ArcSight documentation.
-
(Optional) Create a bucket in VK Object Storage if you need to store the audit log archive. To ensure log immutability, enable object lock in strict mode (
COMPLIANCE).
-
Go to the VK Cloud management console.
-
Go to the Monitoring → Event Log section.
-
Click the Settings button and go to the SIEM tab.
-
Click the Create Connection button.
-
Specify the connection parameters:
- Name:
ArcSight-Production. - Connection endpoint:
192.168.1.100:514— the IP address of your ArcSight SIEM system and the port opened to receive messages from VK Cloud. - Data transfer protocol: select
TCP over TLSto encrypt the transmitted data. - TLS key: paste the TLS key value from your provider in PEM format.
- Message format: select
CEF (Common Event Format)— the standard format for transferring security events to SIEM systems, including ArcSight. Alternatively, theRAW (Syslog RFC5424)format is available.
- Name:
-
(Optional) Configure message filtering so that only relevant events are sent to ArcSight:
- Disabled — receive information about all events.
- System filters — select events by the Status or Source parameters. Available values:
Send only selected,Send all except. - Custom query — create a filter using the search query language.
-
Click the Create button.
-
Wait for the connection check to complete and click the Activate button.
After the connection is activated in VK Cloud, events will start arriving in ArcSight in CEF format via the TCP over TLS protocol.
To receive events in ArcSight, configure SmartConnector (or a similar receiver) to listen for TCP traffic in CEF format on port 514. The specific steps depend on the ArcSight version and are described in the Micro Focus documentation.
To reduce the amount of transferred data and receive in ArcSight only the events relevant to compliance requirements, configure filtering using the Cloud Audit search query language.
-
Go to the Monitoring → Event Log section.
-
Click the Settings button and go to the SIEM tab.
-
Click
for the
ArcSight-Productionconnection and select Configure. -
In the Filtering Type section, select Custom query and specify a filter. For example, to transfer only events related to VK Object Storage and critical events:
resource.type: "s3" OR severity >= WARNINGAvailable filtering parameters:
ParameterDescriptionactionEvent typeseverityEvent severity:DEFAULT,DEBUG,INFO,NOTICE,WARNING,ERROR,CRITICAL,ALERT,EMERGENCYsource.idEvent source identifiersource.addressIP address of the event sourcesubject.user_idUser identifiersubject.addressUser IP addresssubject.metadata.emailUser emailresource.idResource identifierresource.typeResource typeresource.metadata.service_idService nameresource.metadata.stream_idObject namestatus.codeOperation execution status code -
Click the Save Changes button.
-
Wait for the connection check to complete and click the Activate button.
The Cloud Audit service provides a search query language for searching for suspicious activity in the event log. Use search queries in the VK Cloud management console to investigate incidents identified in ArcSight or to perform independent analysis.
- Go to the Monitoring → Event Log section.
- Click the Search and Filters button.
- In the search field, specify a query and click the Find button.
Examples of search queries for detecting suspicious activity:
To provide reports on compliance with security standards, export the filtered events from the log.
-
Go to the Monitoring → Event Log section.
-
Configure the contents of the list using a search query and filters.
-
(Optional) Sort the list by the event registration time.
-
Click the Download button.
A TSV format file will be downloaded. The entries in the file will be arranged in the order determined by the applied search query, filters, and sorting.
-
Perform any action in VK Cloud — for example, create a test bucket or upload an object to an existing bucket.
-
Go to the Monitoring → Event Log section and make sure the new event has appeared in the log.
-
Check that the event has arrived in ArcSight: open the ArcSight ESM console and find the corresponding entry in CEF format.
-
Make sure that the event parameters (user IP address, action type, time) are displayed correctly in ArcSight.
The created resources are billed. If you no longer need them:
-
Delete the SIEM connection
ArcSight-Productionif it is no longer needed. -
If a bucket was created in VK Object Storage for storing archived logs, delete the bucket. Before deleting, make sure that the data stored in it is no longer needed.