Learn about the Amazon Redshift Integration.

This page provides an overview of what you can do with the Amazon Redshift integration. The documentation pages only for a limited number of integrations contain the setup steps and instructions. If you do not see the setup steps here, navigate to the Operations for Applications GUI. The detailed instructions for setting up and configuring all integrations, including the Amazon Redshift integration are on the Setup tab of the integration.

  1. Log in to your Operations for Applications instance.
  2. Click Integrations on the toolbar, search for and click the Amazon Redshift tile.
  3. Click the Setup tab and you will see the most recent and up-to-date instructions.

Amazon Web Services Integration

The Amazon Web Services integration is full-featured implementation offering pre-defined dashboards and alert conditions and is fully configurable.

Dashboards

Operations for Applications provides Amazon Web Services overview dashboards Summary, Pricing, and Billing and the service-specific dashboards for the following products:

  • AWS: ALB
  • AWS: API Gateway
  • AWS: Auto Scaling
  • AWS: CloudFront
  • AWS: Cloud Search
  • AWS: CloudTrail
  • AWS: DMS
  • AWS: Direct Connect
  • AWS: DynamoDB
  • AWS: EBS
  • AWS: EC2
  • AWS: ECS (cAdvisor)
  • AWS: ECS
  • AWS: ECS (Fargate)
  • AWS: EFS
  • AWS: ELB
  • AWS: EMR
  • AWS: Elastic Beanstalk
  • AWS: ElastiCache
  • AWS: Elasticsearch
  • AWS: Elastic Transcoder
  • AWS: FSx
  • AWS: IoT Core
  • AWS: IAM Access Key Age
  • AWS: Kinesis Data Stream
  • AWS: Kinesis Firehose
  • AWS: KMS
  • AWS: Lambda
  • AWS: OpsWorks
  • AWS: RDS
  • AWS: Redshift
  • AWS: Route53
  • AWS: S3
  • AWS: SNS
  • AWS: SQS

Summary Dashboard

From the Summary dashboard you can easily navigate to all other AWS dashboards.

images/db_aws_summary.png

Alerts

The Amazon Web Services integration dashboards contains pre-defined alert conditions embedded as queries in charts contained in the dashboards. For example:

images/alert_condition.png

To create the alert, click the Create Alert link under the query and configure the alert properties (notification targets, condition checking frequency, etc.).

Metrics Configuration

Operations for Applications ingests Amazon Web Services metrics using the CloudWatch, CloudTrail, and AWS service APIs. For details on the metrics and how to configure ingestion, see AWS Metrics Integration.

Metrics Information

You can see the information about the metrics and dimensions which are published to CloudWatch via different AWS services on the AWS CloudWatch metrics doc site. Click a link below to see the detailed metrics information per service:

Add an Amazon Cloud Integration

Setting up an Amazon cloud integration requires establishing a trust relationship between Amazon and VMware Aria Operations for Applications.

You start by granting Operations for Applications read-only access to your Amazon account or by giving limited access.

Then, you register the integration by providing the necessary information. See AWS Integration Overview for information about setting up and managing the AWS Cloud integration.

Set Up AWS CloudWatch Logs

You can use an AWS Lambda function to ingest CloudWatch logs to Operations for Applications. CloudWatch provides data and actionable insights to monitor your applications and respond to system-wide performance changes. It also helps you optimize resource utilization and get a unified view of operational health. CloudWatch collects monitoring and operational data in the form of logs, metrics, and events, providing a unified view of AWS resources, applications, and services that run on AWS and on-premises servers. You can use CloudWatch to detect anomalous behavior in your environments, set alarms, visualize logs and metrics side by side, take automated actions, troubleshoot issues, and discover insights to keep applications running smoothly. To understand more about CloudWatch, see the Amazon CloudWatch documentation.

Install the Wavefront Proxy

The Wavefront proxy is required to send logs from your systems to Operations for Applications. If you have not already done so, install a Wavefront proxy in your AWS environment.

  • If your Operations for Applications service is onboarded to VMware Cloud services, install Wavefront proxy version 13.0 or later.
  • If your Operations for Applications service is not onboarded to VMware Cloud services, install Wavefront proxy version 12.2 or later.

Create an AWS Lambda Function

  1. Log in to the AWS Management Console, search for Lambda, and select it.
  2. Click Applications on the left and click the Create Application button.
  3. Click the Serverless application tab, search for VMware-Log-Insight-Cloud, and select it.
  4. Scroll down and in the Application settings section in the bottom right, provide the Wavefront proxy details.
    • In the APIToken text box, enter log-integration-token.
    • In the APIUrl text box, enter the Wavefront proxy URL.
    • In the NameOfFunction text box, enter a meaningful name for the Lambda function.
  5. Click Deploy.
  6. Add a trigger from the CloudWatch log stream.
    • Navigate to your Lambda function and click it.
    • Click the Add trigger button and from the drop-down menu select CloudWatch Logs.
    • Select the CloudWatch Logs Log group that serves as the event source.
    • Give the filter a meaningful name and click Add.

      Once you create the trigger, your function starts sending logs from CloudWatch to our service. It takes a few minutes for the CloudWatch logs to show up.

View the AWS CloudWatch Logs

View logs in the Logs Browser. It takes a few minutes for the CloudWatch logs to show up.

Alerts

  • EC2 Instance CPU Usage Too High:Alert reports when the EC2 instance CPU utilization constantly exceeds the defined limit.
  • EC2 Instance Status Check Failed:Alert reports when the EC2 status check constantly fails.
Metric Name Description
aws.redshift.commitqueuelength Number of transactions waiting to commit at a given point in time.
aws.redshift.concurrencyscalingactiveclusters Number of concurrency scaling clusters that are actively processing queries at any given time.
aws.redshift.cpuutilization Percentage of CPU utilization. For clusters, this metric represents an aggregation of all nodes (leader and compute) CPU utilization values.
aws.redshift.databaseconnections Number of database connections to a cluster.
aws.redshift.healthstatus Indicates the health of the cluster.
aws.redshift.maintenancemode Indicates whether the cluster is in maintenance mode.
aws.redshift.networkreceivethroughput Rate at which the node or cluster receives data.
aws.redshift.networktransmitthroughput Rate at which the node or cluster writes data.
aws.redshift.percentagediskspaceused Percent of disk space used.
aws.redshift.readiops Average number of disk read operations per second.
aws.redshift.readlatency Average amount of time taken for disk read I/O operations.
aws.redshift.readthroughput Average number of bytes read from disk per second.
aws.redshift.totaltablecount Number of user tables open at a particular point in time. This total doesn’t include Amazon Redshift Spectrum tables.
aws.redshift.wlmqueuelength Number of queries waiting to enter a workload management (WLM) queue.
aws.redshift.wlmrunningqueries Number of queries running from both the main cluster and concurrency scaling cluster per WLM queue.
aws.redshift.writeiops Average number of write operations per second.
aws.redshift.writelatency Average amount of time taken for disk write I/O operations.
aws.redshift.writethroughput Average number of bytes written to disk per second.