Identify Amazon Redshift data warehouse clusters with high disk usage and scale them horizontally to prevent any issues triggered by insufficient disk space and improve their I/O performance. The default threshold value set for Redshift high disk usage is 90% as any value above this could negatively affect cluster stability and performance.
The AWS CloudWatch metric utilized to detect Redshift clusters with high disk space usage is:
PercentageDiskSpaceUsed – the percent of disk space used. (Units: Percent).
This rule can help you work with the AWS Well-Architected Framework.
This rule resolution is part of the Conformity Security & Compliance tool for AWS.
efficiency
Detecting AWS Redshift clusters with high disk space usage is very important when these clusters are used in production as this can help you take immediate actions and scale out (resize) them in order to respond to data warehousing capacity and performance needs.
Note: You can change the default threshold value (90%) for this rule on Cloud Conformity console and set your own value for high disk space usage to configure the storage limits for your Redshift clusters.
Audit
To identify existing AWS Redshift clusters with high disk space usage, provisioned in your AWS account, perform the following:
Remediation / Resolution
The scale-out (resize) process will just add new nodes to your cluster as is not possible yet to increase the Redshift node(s) disk size. To resize an AWS Redshift cluster in order to increase its storage capacity, perform the following actions:
Note: As example, this section will demonstrate how to scale out a Redshift cluster by resizing it from a single node cluster to a multi-node cluster.References
- AWS Documentation
- Amazon Redshift Clusters
- Amazon Redshift Metrics and Dimensions
- Tutorial: Resizing Clusters in Amazon Redshift
- Tutorial: Using the Resize Operation to Resize a Cluster
- AWS Command Line Interface (CLI) Documentation
- redshift
- describe-clusters
- modify-cluster
- cloudwatch
- get-metric-statistics