NetApp Data ONTAP Cluster-Mode Activity Auditing Configuration
The Activity Monitor agent employed to monitor NetApp leverages NetApp ONTAP API, and the NetApp FPolicy framework to monitor file system events. This includes both NetApp 7-Mode and Cluster-Mode configurations. For more information about FPolicy read the What are the two parts of the FPolicy solution article.
Activity Monitor requires two communication channels for ONTAP monitoring:
- Activity Monitor Agent connects to ONTAP on port 80 or 443 for access to ONTAP API (ONTAPI/ZAPI or REST API).
- Data LIFs of the SVM connect to Activity Monitor Agent on port 9999 for FPolicy notifications.
The ONTAP API access is mandatory; without the API access the agent will not be able to receive and translate events from FPolicy. Both classic ONTAPI/ZAPI and the new REST API are supported. The agent uses the API to retrieve information about the storage virtual machines (SVM): CIFS settings, list of volumes, list of LIFs. Depending on the configuration, the agent can also retrieve the state of FPolicy to ensure it is enabled; configure FPolicy and register or unregister itself.
The FPolicy framework enables the collection of audit events on the ONTAP side and their transfer to the agent(s) via the designated Data LIFs. Each LIF establishes its own connection with one or several agents and sends notifications as soon as the file transaction occurs. The FPolicy connection is asynchronous and buffered; both ONTAP and Activity Monitor have techniques in place to make sure that connections are alive and working. The connection can be secured using TLS with server or mutual authentication.
FPolicy may have a significant impact on file system throughput, and it is always a best practice to monitor performance when enabling FPolicy.
RECOMMENDED: Create a tailored FPolicy which only collects the desired activity from the environment to limit the scope and impact.
For scale-out and fault tolerance purposes, the product supports a range of deployment options. A single agent can receive events from multiple SVMs. Or events from a single SVM can be distributed among multiple agents. Or a set of SVMs can distribute events among a set of agents. The choice depends on the fault tolerance requirements and the expected event flow. As a rule of thumb, the average load on a single agent should not exceed 5000 events per second.
Starting with ONTAP 9.15.1, the FPolicy Persistent Store provides resilience and predictable latency during scenarios such as network delays or bursts of activity. The feature uses a dedicated volume for each SVM as a staging buffer before events are sent to the agent. FPolicy will automatically create a volume if one does not already exist.
RECOMMENDED: Enable the Persistent Store feature and allow it to create a volume automatically.
Configuration Checklist
Complete the following checklist prior to configuring the activity monitoring of NetApp Data ONTAP Cluster-Mode devices. Instructions for each item of the checklist are detailed within the following sections.
Checklist Item 1: Plan Deployment
-
Gather the following information:
-
Names of the SVM(s) to be monitored
- FPolicy is configured for each SVM separately
- This should be the SVM(s) hosting the CIFS or NFS shares(s) to be monitored
-
Credentials to access ONTAP to provision a role and account.
-
Desired functionality level:
- Manual. A user configures FPolicy manually and ensures it stays enabled.
- Enable and Connect FPolicy. The product ensures that FPolicy stays enabled and connected all the time. RECOMMENDED.
- Configure FPolicy. The product configures FPolicy automatically and ensures it stays enabled and connected all the time. RECOMMENDED.
-
Volumes or shares on each SVM to be monitored
- Limiting the FPolicy to select volumes or shares is an effective way to limit the performance impact of FPolicy
-
Successful/failed file operations to be monitored
- Limiting the FPolicy to specific file operations is an effective way to limit the performance impact of FPolicy
-
IP Address of the server(s) where the Activity Monitor Agent is deployed
-
API enabled in ONTAP: the classic ONTAPI/ZAPI or the new REST API
- The product supports the REST API for ONTAP 9.13.1 and above.
- Volume names and sizes to be used as a Persistent Store for each SVM. This is recommended.
- The product supports the Persistent Store feature for ONTAP 9.15.1 and later.
- At least one local tier (aggregate) is assigned to the SVM.
-
Encryption and Authentication protocol for FPolicy connection
- No Authentication (default)
- TLS, server authentication (the SVM authenticates the agent)
- TLS, mutual authentication (both the SVM and the agent authenticate each other)
-
Persistent Store provides resilience and predictable latency in scenarios such as network delays or bursts of activity events.
It uses a dedicated volume for each SVM as a staging buffer before the events are sent to Activity Monitor Agent.
Checklist Item 2: Provision ONTAP Account
-
Permission names depend on the API used, ONTAPI/ZAPI or REST API.
-
The case of domain and username created during the account provisioning process must match exactly to the credentials provided to the activity agent for authentication to work.
-
The credential associated with the FPolicy used to monitor activity must be provisioned with access to (at minimum) the following CLI or API commands, according to the level of collection desired:
-
Manual, Collect Activity Events Only (Least Privilege)
-
ONTAPI/ZAPI
version
– Readonly accessvolume
– Readonly accessvserver
– Readonly access
-
REST API
/api/cluster
– Readonly access/api/protocols/cifs/services
– Readonly access/api/storage/volumes
– Readonly access/api/svm/svms
– Readonly access
-
-
Employ the “Enable and connect FPolicy” Option (Less Privilege) – RECOMMENDED
-
ONTAPI/ZAPI
version
– Readonly accessvolume
– Readonly accessvserver
– Readonly accessnetwork interface
– Readonly accessvserver fpolicy disable
– All accessvserver fpolicy enable
– All accessvserver fpolicy engine-connect
– All access
-
REST API
/api/cluster
– Readonly access/api/protocols/cifs/services
– Readonly access/api/storage/volumes
– Readonly access/api/svm/svms
– Readonly access/api/network/ip/interfaces
– Readonly access/api/protocols/fpolicy
– All access
-
-
Employ the “Configure FPolicy” Option (Automatic Configuration of FPolicy) – RECOMMENDED
-
ONTAPI/ZAPI
version
– Readonly accessvolume
– Readonly accessvserver
– Readonly accessnetwork interface
– Readonly accessvserver fpolicy
– All accesssecurity certificate install
– All access (only if FPolicy uses a TLS connection)
-
REST API
/api/cluster
– Readonly access/api/protocols/cifs/services
– Readonly access/api/storage/volumes
– Readonly access/api/svm/svms
– Readonly access/api/network/ip/interfaces
– Readonly access/api/protocols/fpolicy
– All access/api/security/certificates
– All access (only if FPolicy uses a TLS connection)
-
-
Access Analyzer Integration requires the addition of the following CLI command:
security login role show-ontapi
– Readonly access
-
Checklist Item 3: Configure Network
-
Agent must be able to connect to ONTAP API via a management LIF on ports HTTP (80) or HTTPS (443)
- NetApp firewall policy may need to be modified.
- LIF's service policy may need to be modified to include
management-https
ormanagement-http
services. - Either of these ports is required. Activity Monitor requires ONTAP API access.
-
ONTAP cluster nodes, which serve the SVM, must be able to connect to the agent on port 9999.
- LIFs' service policy may need to be modified to include
data-fpolicy-client
service. - Each data serving node should have its own LIF with the
data-fpolicy-client
service. - The default port 9999 can be changed in the agent's settings.
- LIFs' service policy may need to be modified to include
Checklist Item 4: Configure FPolicy
-
Remember: all FPolicy objects and SVM names are case sensitive.
-
FPolicy must be configured for each SVM to be monitored.
-
If using TLS, … authentication options, generate needed certificates and PEM files
-
Select method:
-
Configure FPolicy Manually – If you want to exclude certain volumes or shares; a tailored FPolicy decreases the impact on NetApp.
- Required when the FPolicy account is provisioned for either Least Privileged or Less Privilege permission model
- If using TLS, … authentication options, set authentication
-
Allow the Activity Monitor to create an FPolicy automatically
- If using TLS, … authentication options, set authentication
- This option is enabled using the Configure FPolicy. Create or modify FPolicy objects if needed checkbox for each monitored SVM.
- It monitors file system activity on all volumes and shares of the SVM.
- FPolicy configuration is automatically updated to reflect the Activity Monitor configuration.
- Requires a Privileged Access credential be provided.
-
-
Enable the Persistent Store to increase the resilience and control the latency in case of network outages or bursts of activity
Checklist Item 5: Activity Monitor Configuration
- Deploy the Activity Monitor Agent to a Windows server.
- Configure the Agent to monitor the SVM.