NetApp ONTAP 9.8 – FlexCache Hands-on Setup (NFS and SMB)

To follow up on my prior blog covering FlexCache features, best practices and use cases, below is a hands-on example in my VSIM lab. The lab will create an origin volume and two caches, local and remote. The lab will also show how to setup a cache from a mirrored readonly volume, management of caches and reporting examples.

There are two clusters, “cmode-prod” and “cmode-single“.

There are two data SVMs

source_unix” on cmode-prod that serves both nfs and cifs on LIF IPs 192.168.150.110 and .111

dest_async” on cmode-single that serves both nfs and cifs on LIF IP 192.168.150.201

1     FlexCache Origin Configuration (NFS and SMB)

1.1      FlexCache Origin Volume Create

  • FlexCache is a “set and forget” feature
  • Origin can be a FlexVol or FlexGroup
  • We will use the exsting “source_unix” SVM for the origin
  • We will create two FlexCache Volumes in the next two sections (one local, one remote)
  • NFS export policies are already created, so we only create a CIFS share for multi-protocol access

cmode-prod

Set nfs 64-bit identifiers for FlexGroups

vserver nfs modify -vserver source_unix -v3-64bit-identifiers enabled   # “y” twice

Create origin (source) volume (we will create a FlexGroup for this origin)

volume create  -vserver source_unix -volume origin -size 50t -space-guarantee none -security-style unix -junction-path /origin -policy data -aggr-list cmode_prod_01_aggr3_SSD,cmode_prod_02_aggr3_SSD -aggr-list-multiplier 2   # “y” confirm

volume show -vserver source_unix -is-constituent true

To avoid invalidations on files that are cached when there is only a read at the origin, turn off last accessed time updates on the origin volume (when you create the cache in the next section, this is automatic for the cache)

volume modify -vserver source_unix -volume origin -atime-update false

Create a CIFS share

cifs share create -vserver source_unix -share-name origin -path /origin

Enable Block Level Invalidate (disabled by default) on the Origin

flexcache origin config show

flexcache origin config modify -origin-volume origin -is-bli-enabled true

flexcache origin config show

1.2      FlexCache Origin Volume Mount NFS

NFS Client

Mount the source_unix volume

mount 192.168.150.110:/origin origin

LS the mount 

ls -l origin/

Make Directories

mkdir origin/dir1

mkdir origin/dir2

mkdir origin/dir3

Create files

touch origin/file1.txt

echo “new file” >> origin/file1.txt

cat origin/file1.txt

touch origin/dir1/dir1file.txt

touch origin/dir2/dir2file.txt

touch origin/dir3/dir3file.txt

ls -l origin/dir1

ls -l origin/dir2

ls -l origin/dir3

1.3      FlexCache Origin Volume SMB Share

  • The sourceunix (cmode-prod source) and destasync (cmode-single mirror) CIFS servers were already created and joined to the lab2.local domain
    • cifs server create -vserver vserver -cifs-server netbiosname -domain lab2.local

Windows Server

Task bar search “Windows PowerShell”, right click and “Run as administrator

PS C:>  prompt

net use o: \\sourceunix\origin

PS C:\Users\Administrator> net use o: \\sourceunix\origin

The command completed successfully.

dir o:

PS C:\Users\Administrator> dir o:

    Directory: o:\

Mode                LastWriteTime         Length Name

—-                ————-         —— —-

d—–        11/8/2020   9:53 AM                dir1

d—–        11/8/2020   9:53 AM                dir2

d—–        11/8/2020   9:53 AM                dir3

-a—-        11/8/2020  10:32 AM             15 file1.txt

Create a new file

New-Item -ItemType file o:file1SMB.txt

PS C:\Users\Administrator> New-Item -ItemType file o:file1SMB.txt

    Directory: o:\

Mode                LastWriteTime         Length Name

—-                ————-         —— —-

-a—-        11/8/2020  10:36 AM              0 file1SMB.txt

dir o:

PS C:\Users\Administrator> dir o:

    Directory: o:\

Mode                LastWriteTime         Length Name

—-                ————-         —— —-

d—–        11/8/2020   9:53 AM                dir1

d—–        11/8/2020   9:53 AM                dir2

d—–        11/8/2020   9:53 AM                dir3

-a—-        11/8/2020  10:32 AM             15 file1.txt

-a—-        11/8/2020  10:36 AM              0 file1SMB.txt

cmode-prod

vserver cifs session show

vserver locks show

2     FlexCache Cache Configuration (same Cluster, same SVM)

2.1      FlexCache Volume Create (same Cluster, same SVM)

  • No cluster or SVM peering is needed since intra-cluster and intra-SVM
    • A different SVM in the same cluster would require an SVM peer
  • You can create the FlexCache with the -aggr-list option so it creates the prescribed number of constituents
    • List aggregates for constituents (-aggr-list)
  • You can also let FlexGroup autoselect (-auto-provision-as)
  • The option -aggr-list-multiplier determines how many constituent volumes are being used per aggregate listed in the -aggr-list option
  • Number of constituents recommended proportion to the size of the FlexCache volume
    • FlexCache volume < 100GB = 1 member volume
    • FlexCache volume > 100GB < 1TB = 2 member volumes
    • FlexCache volume > 1TB < 10TB = 4 member volumes
    • FlexCache volume > 10TB < 20TB = 8 member volumes
    • FlexCache volume > 20TB = the default number of member volumes (use -auto-provision-as flexgroup)

cmode-prod

Create the FlexCache Volume

flexcache create -vserver source_unix -volume cache1 -auto-provision-as flexgroup -origin-volume origin -size 5TB -origin-vserver source_unix -junction-path /cache1 -space-guarantee none

Modify the export policy (this can also be set on create with -policy above)

volume modify -vserver source_unix -volume cache1 -policy data

Create CIFS share

cifs share create -vserver source_unix -share-name cache1 -path /cache1

Show the Cache

volume flexcache show

volume flexcache origin show-caches

Show the cache connection (connected, disconnected or unknown)

volume flexcache connection-status show     # confirm connected

2.2      FlexCache Volume NFS Mount (same Cluster, same SVM)

NFS Client

Mount the source_unix cache volume

mount 192.168.150.111:/cache1 cache1

LS the cache

ls -l cache1/                 # file1.txt is there

Append the file1.txt file to the cache that will write to the origin

echo “new line cache1” >> cache1/file1.txt

Create a new file on the cache that will write to both cache and origin

touch cache1/file2.txt

cat the updated file from both locations

cat cache1/file1.txt

cat origin/file1.txt

LS both origin and cache1 which match

ls -l origin/

ls -l cache1/

2.3      FlexCache Volume SMB Share (same Cluster, same SVM)

Windows Server

Task bar search “Windows PowerShell”, right click and “Run as administrator

PS C:>  prompt

net use p: \\sourceunix\cache1

PS C:\Users\Administrator> net use p: \\sourceunix\cache1

The command completed successfully.

dir p:

PS C:\Users\Administrator> dir p:

    Directory: p:\

Mode                LastWriteTime         Length Name

—-                ————-         —— —-

d—–        11/8/2020   9:53 AM                dir1

d—–        11/8/2020   9:53 AM                dir2

d—–        11/8/2020   9:53 AM                dir3

-a—-        11/8/2020  10:40 AM             31 file1.txt

-a—-        11/8/2020  10:36 AM              0 file1SMB.txt

-a—-        11/8/2020  10:57 AM              0 file2.txt

Show the file contents of the updated file earlier in Linux origin and cache

gc o:\file1.txt

gc p:\file1.txt

Create a new file in the cache which also writes to origin

New-Item -ItemType file p:file2SMB.txt

PS C:\Users\Administrator> New-Item -ItemType file o:file2SMB.txt

    Directory: p:\

Mode                LastWriteTime         Length Name

—-                ————-         —— —-

-a—-        11/8/2020  11:07 AM              0 file2SMB.txt

Show the files to see they are in both cache and origin

dir p:

dir o:

cmode-prod

vserver cifs session show

vserver locks show

2.4      FlexCache Volume SMB File Locking

Run Open Office or Excel or similar to create a file that will be locked

Create and save a a spreadsheet in \\sourceunix\cache1             

  • Untitled1.ods is created below

Open the file you created on the origin \\sourceunix\origin

  • You will see a message the the file is open for editing on the cache1 share to show file locking is enforced

3     FlexCache Cache Configuration (different Cluster, different SVM)

3.1      FlexCache Volume Create (different Cluster, different SVM)

  • Both cluster peering and SVM peering are required and these are already setup between the clusters and SVMs
  • We will use the cmode-single cluster SVM named dest_async which is already peered with the source  cluster cmode-prod SVM named source_unix
  • We would setup Intercluster LIFs, cluster peering and SVM (vserver) peering if not setup already
  • We must modify the existing vserver peer for SnapMirror to allow for FlexCache using the “flexcache” type
  • We will use the “default” export policy which is already open for mount

cmode-single

Confirm Peering

cluster peer show                                            # cmode-prod is peered to cmode-single

vserver peer show                                           # dest_async is peered to source_unix

vserver peer show -vserver dest_async          # FlexCache is not peered

Add the FlexCache to the SVM peer

vserver peer modify -vserver dest_async -peer-vserver source_unix -applications snapmirror,flexcache

vserver peer show -vserver dest_async

Create the FlexCache Volume

flexcache create -vserver dest_async -volume cache2 -auto-provision-as flexgroup -origin-volume origin -size 5TB -origin-vserver source_unix -junction-path /cache2 -space-guarantee none

Create CIFS share

cifs share create -vserver dest_async -share-name cache2 -path /cache2

Show the Cache

volume flexcache show

volume flexcache origin show-caches

Show the cache connection (connected, disconnected or unknown)

volume flexcache connection-status show     # confirm connected

cmode-prod

Show the caches from the origin

volume flexcache origin show-caches

Show the cache connection (connected, disconnected or unknown)

volume flexcache connection-status show     # confirm connected

3.2      FlexCache Volume NFS Mount (different Cluster, different SVM)

NFS Client

Mount the source_unix cache volume

mount 192.168.150.201:/cache2 cache2

LS the cache

ls -l cache2/                 # all origin, cache1 and cache2 files are the same

Append the file

echo “new line cache2” >> cache2/file1.txt

Create a new file on the caches that will write to both cache and origin

touch cache2/file3.txt

Cat the updated file from all 3 locations

cat cache2/file1.txt

cat cache1/file1.txt

cat origin/file1.txt

LS the origin and both caches which are the same in all 3 locations

ls -l origin/

ls -l cache1/

ls -l cache2/

3.3      FlexCache Volume SMB Share (different Cluster, different SVM)

Windows Server

Task bar search “Windows PowerShell”, right click and “Run as administrator

PS C:>  prompt

Map the drive with the IP

net use q: \\192.168.150.201\cache2

PS C:\Users\Administrator> net use q: \\192.168.150.201\cache2

The command completed successfully.

dir q:

    Directory: q:\

Mode                LastWriteTime         Length Name

—-                ————-         —— —-

d—–        11/8/2020   9:53 AM                dir1

d—–        11/8/2020   9:53 AM                dir2

d—–        11/8/2020   9:53 AM                dir3

-a—-        11/8/2020  11:10 AM             47 file1.txt

-a—-        11/8/2020  10:36 AM              0 file1SMB.txt

-a—-        11/8/2020  10:57 AM              0 file2.txt

-a—-        11/8/2020  11:07 AM              0 file2SMB.txt

-a—-        11/8/2020  11:11 AM              0 file3.txt

Show the file contents of the updated file earlier in Linux origin and cache

gc o:\file1.txt

gc p:\file1.txt

gc q:\file1.txt

Create a new file in the cache which also writes to origin

New-Item -ItemType file q:file3SMB.txt

PS C:\Users\Administrator> New-Item -ItemType file o:file3SMB.txt

    Directory: q:\

Mode                LastWriteTime         Length Name

—-                ————-         —— —-

-a—-        11/8/2020  11:19 AM              0 file3SMB.txt

Show the files to see they are in both cache and origin

dir q:

dir p:

dir o:

cmode-single

vserver cifs session show

vserver locks show

4     Client Cleanup

4.1      Linux NFS Client

NFS Client

unmount the source_unix cache volume

umount origin

umount cache1

umount cache2

4.2      Windows Client

Windows Server

Task bar search “Windows PowerShell”, right click and “Run as administrator

PS C:>  prompt

net use O: /DELETE

net use P: /DELETE

net use Q: /DELETE

5     FlexCache from a SnapMirror Secondary Origin (9.8+)

5.1      FlexCache Volume Create (same dest Cluster, same SVM)

cmode-single

Show an existing mirrored volume in the dest_async SVM

snapmirror show -vserver dest_async

                                                                       Progress

Source            Destination Mirror  Relationship   Total             Last

Path        Type  Path        State   Status         Progress  Healthy Updated

———– —- ———— ——- ————– ——— ——- ——–

source_unix:home XDP dest_async:home_dr_async Snapmirrored Idle – true –

Create the FlexCache Volume

flexcache create -vserver dest_async -volume cachemirror -auto-provision-as flexgroup -origin-volume home_dr_async -size 1TB -origin-vserver dest_async -junction-path /cachemirror -space-guarantee none

Create CIFS share to the origin and cache

cifs share create -vserver dest_async -share-name originmirror -path /home_dr_async

cifs share create -vserver dest_async -share-name cachemirror -path /cachemirror

Show the Cache

volume flexcache show

volume flexcache origin show-caches

Show the cache connection (connected, disconnected or unknown)

volume flexcache connection-status show     # confirm connected

5.2      FlexCache Volume NFS Mount (Origin Mirror)

NFS Client

Mount the origin volume

mount 192.168.150.201:/home_dr_async origin

LS the cache

ls -l origin/                   # 6 files from prior labs

Append a file – this FAILS since it is a readonly mirror

echo “new line origin” >> origin/file1.txt         FAILS

Create a new file  – this FAILS since it is a readonly mirror

touch origin/file7.txt                                        FAILS

5.3      FlexCache Volume NFS Mount (Cache)

NFS Client

Mount the cache volume

mount 192.168.150.201:/cachemirror cache1

LS the cache

ls -l cache1/                 # 6 files from prior labs

Append a file – this FAILS since it is a readonly mirror

echo “new line cache1” >> cache1/file1.txt 2>&1     FAILS

Create a new file  – this FAILS since it is a readonly mirror

touch cache1/file7.txt                                      FAILS

Cat and LS

cat cache1/file1.txt

ls -l cache1/

5.4      FlexCache NFS Cleanup

NFS Client

Unmount

umount origin/

umount cache1/

5.5      FlexCache Volume SMB Share (Origin Mirror)

Windows Server

Task bar search “Windows PowerShell”, right click and “Run as administrator

PS C:>  prompt

Map the drive with the IP

net use o: \\192.168.150.201\originmirror

PS C:\Users\Administrator> net use o: \\192.168.150.201\originmirror

The command completed successfully.

dir o:

    Directory: o:\

Mode                LastWriteTime         Length Name

—-                ————-         —— —-

-a—-        11/6/2020   3:25 PM              0 file1.txt

-a—-        11/6/2020   3:25 PM              0 file2.txt

-a—-        11/6/2020   3:25 PM              0 file3.txt

-a—-        11/6/2020   3:26 PM              0 file4.txt

-a—-        11/6/2020   3:26 PM              0 file5.txt

-a—-        11/6/2020   3:26 PM              0 file6.txt

5.6      FlexCache Volume SMB Share (Cache)

Windows Server

Task bar search “Windows PowerShell”, right click and “Run as administrator

PS C:>  prompt

Map the drive with the IP

net use p: \\192.168.150.201\cachemirror

PS C:\Users\Administrator> net use p: \\192.168.150.201\cachemirror

The command completed successfully.

dir p:

    Directory: p:\

Mode                LastWriteTime         Length Name

—-                ————-         —— —-

-a—-        11/6/2020   3:25 PM              0 file1.txt

-a—-        11/6/2020   3:25 PM              0 file2.txt

-a—-        11/6/2020   3:25 PM              0 file3.txt

-a—-        11/6/2020   3:26 PM              0 file4.txt

-a—-        11/6/2020   3:26 PM              0 file5.txt

-a—-        11/6/2020   3:26 PM              0 file6.txt

5.7      FlexCache Volume SMB Cleanup

Windows Server

Task bar search “Windows PowerShell”, right click and “Run as administrator

PS C:>  prompt

net use O: /DELETE

net use P: /DELETE

6     FlexCache Management

6.1      Synchronizing properties of a FlexCache volume from an origin volume

  • Some of the volume properties of the FlexCache volume must always be synchronized with those of the origin volume. If the volume properties of a FlexCache volume fail to synchronize automatically after the properties are modified at the origin volume, you can manually synchronize the properties.
  • The following volume properties of a FlexCache volume must always be synchronized with those of the origin volume
    • Security style (-security-style)
    • Volume name (-volume-name)
    • Maximum directory size (-maxdir-size)
    • Minimum read ahead (-min-readahead)

cmode-prod

volume flexcache sync-properties -vserver source_unix -volume cache1

cmode-single

volume flexcache sync-properties -vserver dest_async -volume cache2

6.2      Updating the configurations of a FlexCache relationship

  • After events such as volume move, aggregate relocation, or storage failover, the volume configuration information on the origin volume and FlexCache volume is updated automatically. In case the automatic updates fail, an EMS message is generated and then you must manually update the configuration for the FlexCache relationship
  • If you want to update the configurations of a FlexCache volume, you must run the command from the origin volume. If you want to update the configurations of an origin volume, you must run the command from the FlexCache volume
  • Syntax
    • volume flexcache config-refresh -peer-vserver peer_svm -peer-volume peer_volume_to_update -peer-endpoint-type [origin | cache]

cmode-prod

volume flexcache config-refresh -peer-vserver dest_async -peer-volume cache2 -peer-endpoint-type cache

6.3      AutoGrow the Cache

  • Autogrow might be a good option to use on the FlexCache to conserve space. You might consider using autogrow when you don’t know what the working set size is or if you must be conservative with space on the FlexCache cluster
  • Set the maximum autogrow size to between 10% and 15% of the origin
  • Autogrow is only triggered at a certain threshold. By default, this threshold is 85%. When a particular constituent reaches 85% full, then it is grown to a specific number calculated by ONTAP. Also, the eviction threshold is 90%. So, if there is an ingest rate (first read from origin, which writes it to cache) of greater than 5%, then grow and evict loops could result in undesirable behavior

cmode-single

volume autosize -vserver dest_async -volume cache2 -maximum-size 10TB -mode grow

vol autosize -vserver dest_async -volume cache2

6.4      File Locking (origin)

  • File locking is done on the origin volume
  • A lock on a cache is passed back to the origin
  • Locks are not stored on the cache

cmode-prod and cmode-single

vserver locks show                 # we should see no locks

vserver cifs session show

6.5      Pre-populate the cache from ONTAP (9.8+)

  • Prepopulate reads files only and crawls through directories 
  • The is-recursion flag applies to the entire list of directories passed to prepopulate 
  • Syntax
    • volume flexcache prepopulate -cache-vserver vserver_name -cache-volume -path-list path_list -is-recursion true|false

cmode-single

Prepopulate a FlexCache volume with a single directory path for prepopulation


flexcache prepopulate start -cache-vserver dest_async -cache-volume cache2 -path-list /dir1



Prepopulate a FlexCache volume with a list of several paths for prepopulation

flexcache prepopulate start -cache-vserver dest_async -cache-volume cache2 -path-list /dir1,/dir2,/dir3

Display the number of files read

job show                      # -id job_ID -ins

97     FlexCache prepopulate job for volume “cache2” in Vserver “dest_async”. cmode-single cmode-single-01 Success

       Description: FLEXCACHE PREPOPULATE JOB

98     FlexCache prepopulate job for volume “cache2” in Vserver “dest_async”. cmode-single – Queued

       Description: FLEXCACHE PREPOPULATE JOB

6.6      Pre-populate the cache from the NFS client

  • Use ONTAP “flexcache preopulate start” as best practice if 9.8 or higher
  • Preload the data using the “find” command in a specific directory. You can run this command with either a dot (.) in the <dir> to run it from the current directory, or you can give it a specific directory
  • Usually, the command also warms the directory listings. If it does not, you can also run ls -R <dir> and replace the <dir> with the same information in the find command
  • ONTAP 9.8 adds pre-populate by specifying a directory which needs to be pre-populated at a cache location

Pre-9.8 from a client

NFS client

Mount source_unix cache volume

mount 192.168.150.201:/cache2 cache2

LS the cache

ls -l cache2/                 

NFS client find command on each cache mount

find cache2 -type f -print -exec sh -c “cat {} > /dev/null” \;

Cleanup

umount cache2/

6.7      Pre-populate the cache from the Windows SMB client

  • Use ONTAP “flexcache preopulate start” as best practice if 9.8 or higher
  • Powershell

Pre-9.8 from a client

Windows Server

Task bar search “Windows PowerShell”, right click and “Run as administrator

PS C:>  prompt

Map the drive with the IP

net use q: \\192.168.150.201\cache2

PS C:\Users\Administrator> net use q: \\192.168.150.201\cache2

The command completed successfully.

dir q:

    Directory: q:\

Mode                LastWriteTime         Length Name

—-                ————-         —— —-

d—–        11/8/2020   9:53 AM                dir1

d—–        11/8/2020   9:53 AM                dir2

d—–        11/8/2020   9:53 AM                dir3

-a—-        11/8/2020  11:10 AM             47 file1.txt

-a—-        11/8/2020  10:36 AM              0 file1SMB.txt

-a—-        11/8/2020  10:57 AM              0 file2.txt

-a—-        11/8/2020  11:07 AM              0 file2SMB.txt

-a—-        11/8/2020  11:11 AM              0 file3.txt

-a—-        11/8/2020  11:19 AM              0 file3SMB.txt

powershell command to read all files to the cache for dir1

Measure-Command {Get-ChildItem -Path Q:\dir1 -Recurse -File | ForEach-Object { $name = $_.FullName; Get-Content $name } > $NUL | Out-Default}

Days              : 0

Hours             : 0

Minutes           : 0

Seconds           : 0

Milliseconds      : 47

Ticks             : 473697

TotalDays         : 5.48260416666667E-07

TotalHours        : 1.315825E-05

TotalMinutes      : 0.000789495

TotalSeconds      : 0.0473697

TotalMilliseconds : 47.3697

Cleanup

net use Q: /DELETE

6.8      Disconnected Mode (Read Only) LS disable

  • Origin behavior
    • Reads are supported
    • Write to new files are supported
    • Writes to existing files, if not cached outbound yet, are written
    • Writes to files after a TTL timeout are allowed 9.6+ (Disconnected mode TTL and resync)
  • Cache behavior
    • Reads are supported
    • Reads for data that has not been cached time out
    • Writes to the FlexCache time out
    • An ls command only works if there was an ls or equivalent command performed on that directory before the disconnection.  A directory is just another inode. If it has been cached, it is served. If it has not been cached, it is not served
      • Disabling “ls” when disconnected at the cache is a best practice we will turn off below

cmode-single

Change FlexGroup behavior to prevent ls hanging in disconnected mode.  Set the following bootarg to revert the RAL or FlexGroup behavior to previous so that the “ls” command does not hang in disconnected mode **requires a reboot**

node run cmode-single-01 “priv set diag; flexgroup set fast-readdir=false persist”

reboot

6.9      Delete a FlexCache Relationship

cmode-single

Offline and FlexCache Delete (not volume delete)

volume offline -vserver dest_async -volume cache2  # “y

volume flexcache delete -vserver dest_async -volume cache2

cmode-prod

Clean up on the origin volume

  • Run when the cache is orphaned
    • This command only needs to be run if “volume flexcache delete” fails on the FlexCache cluster and prompts you to run this command. The cache configuration will be deleted and cannot be reestablished for the cache relationship between origin of a FlexCache volume “origin” in Vserver “source_unix” and FlexCache volume “cache2” in Vserver “dest_async”.
    • Running this command unless guided by the “volume flexcache delete” command or NetApp Support can lead to unwanted outcomes.
  • When you run the volume flexcache origin cleanup-cache-relationship command, the FlexCache relationship is deleted and cannot be reestablished
  • This command will fail with ”Error: command failed: entry doesn’t exist” because the cache deleted above without issue

set diag                       # confirm “y”

volume flexcache origin cleanup-cache-relationship -origin-volume origin -origin-vserver source_unix -cache-vserver dest_async -cache-volume cache2

confirm “y”

Error: command failed: entry doesn’t exist  (this was expected since already deleted)

set admin

7     FlexCache Performance and Reporting

7.1      FlexCache Statistics

cmode-prod

set diag           # required for waflremote and debug

Show Commands

flexcache show

flexcache origin show

flexcache origin config show

debug smdb table nflexcache_origin_config show

flexcache show -instance

df -aggregates -autosize

df -autosize -V

volume show-footprint 

volume show-space

aggregate show-space

Average latencies per I/O operation for FlexCache

qos statistics workload latency show -iterations 100

FCache Hits with Statistics show-periodic

statistics show-periodic -interval 1

Show inodes showing up and evicting show per constituent

vol explore -format dir -scope cache1__0001./

vol explore -format dir -scope cache1__0002./

Start Statistics

statistics start -sample-id workload_cache -object waflremote

Show WAFL remote

statistics show -object waflremote -sample-id workload_cache

Show spinhi

statistics show -object spinhi -counter spinhi_flexcache* -raw

statistics show -object spinnp_replay_cache -instance spinnp_replay_cache -counter * -raw true

Cache misses (look at “fc_miss”)

statistics show -sample-id workload_cache -counter read_io_type

FlexCache Delays

statistics show -sample-id workload_cache -instance *FLEXCACHE*

Performance Histogram and cache evictions

statistics show -object waflremote -counter fc_retrieve_hist -raw

Show Cache Evictions

statistics show waflremote -counter scrub_need_freespace -raw

Stop and Delete Statistics

statistic stop -sample-id workload_cache

statistics samples delete -sample-id workload_cache

set adv

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s