AWS CloudWatch Metric Aggregations
- Overview
- How the Plain Metric Name Is Chosen
- Metrics by Namespace
AWS/AmazonMQAWS/ApiGatewayAWS/ApplicationELBAWS/AthenaAWS/AutoScalingAWS/CloudFrontAWS/DynamoDBAWS/EBSAWS/EC2AWS/ECSAWS/EFSAWS/ELBAWS/ESAWS/FirehoseAWS/FSxAWS/GlueAWS/KafkaAWS/KinesisAWS/LambdaAWS/NATGatewayAWS/NetworkELBAWS/RDSAWS/RedshiftAWS/Route53AWS/S3AWS/SNSAWS/SQSECS/ContainerInsights
- Extending the Defaults
AWS CloudWatch delivers each metric as a bundle of statistics in a single record: sum, count, minimum, and maximum, with average derived as sum / count.
Rather than keep every statistic for every metric, Kloudfuse takes an opinionated view of which one statistic best represents each metric.
This page lists those selections.
CloudWatch sends these metrics already aggregated — Kloudfuse never receives a raw metric stream to accumulate. Every metric on this page is therefore ingested as a gauge. The one exception is the _samplecount series, which is a counter.
|
Overview
For every metric that Kloudfuse special-cases:
-
One statistic is chosen as the main metric and is stored under the plain, suffix-less name.
-
Any other statistics worth keeping are stored as separate series, with the aggregation appended as a suffix (for example,
_maximum). -
A metric that Kloudfuse does not special-case keeps only its CloudWatch
sum, stored under the plain name.
This means the plain metric name and a suffixed variant are not two views of the same number.
The plain name is whichever statistic is marked main.
For example, aws.ec2.cpuutilization is the average CPU utilization: because average is the main statistic, there is no separate _average series, and the maximum is published separately as aws.ec2.cpuutilization_maximum.
CloudWatch metrics reach Kloudfuse through the Metrics Stream and Kinesis Firehose path described in AWS CloudWatch Metrics Integration.
A metric that does not appear on this page keeps only its CloudWatch sum, stored under the plain name.
|
How the Plain Metric Name Is Chosen
Kloudfuse stores the main statistic under the plain metric name and appends a suffix to every additional statistic it keeps. The suffix names are:
| CloudWatch statistic | Suffix on the series | Notes |
|---|---|---|
main (the chosen statistic) |
(none) |
Stored under the plain, suffix-less metric name. |
|
|
|
|
|
|
|
|
Renamed for consistency. |
|
|
Renamed for consistency. |
|
|
Renamed for consistency. |
|
|
Percentiles pass through; |
The raw CloudWatch metric name is normalized into the Kloudfuse metric name shown in the tables below:
-
If Kloudfuse defines an explicit override for the metric, that name is used as-is. For example,
AllocatedStorageunderAWS/RDSbecomestotal_storage_space. -
Otherwise the name is converted to snake case as follows: a trailing
Countis dropped;-,.,, and%are removed; and an underscore is inserted between a lowercase letter and a following uppercase letter or digit. Consecutive capitals (acronyms) stay together, soCPUUtilizationbecomescpuutilizationwhileDatabaseConnectionsbecomesdatabase_connections.
The full metric name also carries the normalized namespace as a prefix, following the aws.<namespace>.<name> convention. For example, CPUUtilization under AWS/EC2 becomes aws.ec2.cpuutilization. See AWS CloudWatch Metrics Integration.
Metrics by Namespace
In the Metric column, the CloudWatch metric name is shown on top, with the Kloudfuse metric name in parentheses beneath it. The parenthesized name is what appears in the Metrics Explorer in the Kloudfuse UI, prefixed with the namespace — for example, CPUUtilization appears as aws.ec2.cpuutilization.
The remaining columns show the statistic stored under the plain (suffix-less) name and any additional suffixed series that are also emitted.
Jump to a service from the table of contents, or use your browser’s find (Ctrl+F / Cmd+F) to locate a metric.
sum (default) means Kloudfuse does not mark a main statistic, so the plain metric is the CloudWatch default sum.
The same metric name can map to a different statistic in a different namespace. For example, ReadLatency is the average under AWS/RDS but the sum under AWS/ES. Always match on the namespace as well as the metric name.
|
AWS/AmazonMQ
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AWS/ApiGateway
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AWS/ApplicationELB
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
AWS/Athena
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AWS/AutoScaling
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
AWS/CloudFront
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AWS/DynamoDB
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AWS/EBS
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
AWS/EC2
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AWS/ECS
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AWS/EFS
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AWS/ELB
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AWS/ES
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AWS/Firehose
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AWS/FSx
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AWS/Glue
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AWS/Kafka
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AWS/Kinesis
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AWS/Lambda
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AWS/NATGateway
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AWS/NetworkELB
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AWS/RDS
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AWS/Redshift
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AWS/Route53
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
AWS/S3
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AWS/SQS
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
ECS/ContainerInsights
| Metric (explorer name) | Main | Also emitted (suffixed) |
|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Extending the Defaults
The selections on this page are Kloudfuse defaults.
Through the additionalCloudWatchMetricAggregations setting in the Helm configuration, a deployment can keep additional statistics for a metric, or change which statistic is stored under the plain metric name.
Add the setting under ingester.config.aggregator.metric in your custom-values.yaml file.
Each list entry configures one statistic for one metric, with these fields:
namespace-
The raw CloudWatch namespace, such as
AWS/EC2orAWS/EBS. name-
The raw CloudWatch metric name, such as
CPUUtilization. Use the CloudWatch name (the top name in each row of the tables above), not the normalized Kloudfuse name. aggregation-
The CloudWatch statistic to configure, written as its short name:
sum,average,min,max, orcount, plus percentiles such asp99when the metric stream carries them. Writeminandmax, notminimumormaximum, andcount, notsamplecount; these are renamed only in the emitted series name (see How the Plain Metric Name Is Chosen), not in this field. Use one of these short tokens exactly; do not use CloudWatch’s own capitalized statistic names such asAverageorSampleCount. An unrecognized value, or an entry with noaggregationat all, is silently ignored. isMain-
Optional; defaults to
false. Whenfalse, the statistic is kept as an additional, suffixed series. Whentrue, the statistic becomes the main metric, stored under the plain, suffix-less name, replacing the previous main. See Changing the Main Statistic.
Keeping Additional Statistics
Keeping an additional statistic is most useful for a metric that Kloudfuse does not special-case.
Such a metric keeps only its CloudWatch sum, stored under the plain name (see the TIP in Overview).
Adding an aggregation for it makes Kloudfuse also keep that statistic as a separate, suffixed series, so a custom metric can carry, for example, its average and max in addition to the default sum.
Leave isMain unset (or false) for these entries:
ingester:
config:
aggregator:
metric:
# additionalCloudWatchMetricAggregations - Keep extra CloudWatch
# statistics for a metric, in addition to the Kloudfuse defaults.
additionalCloudWatchMetricAggregations:
- namespace: AWS/EC2
name: CPUUtilization
aggregation: average
- namespace: AWS/EC2
name: CPUUtilization
aggregation: max
- namespace: AWS/EBS
name: VolumeReadBytes
aggregation: averageEach statistic you add is stored as a separate series, with the aggregation appended as a suffix following the rules in How the Plain Metric Name Is Chosen: average becomes _average, max becomes _maximum, min becomes _minimum, and count becomes _samplecount.
The plain, suffix-less metric name is unchanged.
| If a statistic you request is already the metric’s main statistic, or is already emitted for that metric per the tables above, the entry has no additional effect. |
Entries can also be written in compact, inline form, which keeps the list readable when you are configuring many metrics across several namespaces:
ingester:
config:
aggregator:
metric:
additionalCloudWatchMetricAggregations:
- {namespace: AWS/EC2, name: CPUUtilization, aggregation: max}
- {namespace: AWS/SQS, name: ApproximateAgeOfOldestMessage, aggregation: average}
- {namespace: AWS/ELB, name: Latency, aggregation: p99}
- {namespace: AWS/RDS, name: ReadLatency, aggregation: max}
- {namespace: AWS/Lambda, name: Duration, aggregation: min}
- {namespace: AWS/DynamoDB, name: ConsumedReadCapacityUnits, aggregation: sum}Changing the Main Statistic
By default, the statistic stored under the plain, suffix-less name is whichever one the tables above mark as main; for a metric that Kloudfuse does not special-case, that default is the CloudWatch sum.
Set isMain: true on an aggregation to store that statistic under the plain name instead.
How many entries you need depends on whether Kloudfuse already special-cases the metric.
For a metric that Kloudfuse does not special-case (it defaults to sum only), a single entry with isMain: true is enough:
ingester:
config:
aggregator:
metric:
additionalCloudWatchMetricAggregations:
- namespace: My/CustomNamespace
name: MyCustomMetric
aggregation: average
isMain: trueFor a metric that Kloudfuse already special-cases (one whose main is already a chosen statistic in the tables above), supply two entries: one to demote the current main with isMain: false, and one to promote the new main with isMain: true.
For example, to make max the main statistic for AWS/EC2 CPUUtilization (whose default main is average):
ingester:
config:
aggregator:
metric:
additionalCloudWatchMetricAggregations:
# Demote the current main; it is then emitted as _average.
- namespace: AWS/EC2
name: CPUUtilization
aggregation: average
isMain: false
# Promote max; it is then stored under the plain name.
- namespace: AWS/EC2
name: CPUUtilization
aggregation: max
isMain: true
Promote a new main only while also demoting the current one. If two statistics for the same metric are both marked isMain: true, they are both treated as main and the result is undefined. Always pair a promotion (isMain: true) with a demotion (isMain: false) when the metric already has a main statistic in the tables above.
|
Promoting a statistic to the main metric drops the CloudWatch sum, because sum is only the default main. To keep sum as well, add an entry for it with isMain: false; it is then emitted as _sum.
|
After editing custom-values.yaml, apply the change with a Helm upgrade:
helm upgrade --install kfuse oci://us-east1-docker.pkg.dev/mvp-demo-301906/kfuse-helm/kfuse \
-n kfuse \
--version <VERSION> \ (1)
-f custom-values.yaml| 1 | Replace <VERSION> with a valid Kloudfuse release value. See Release Notes for the latest release. |
See AWS CloudWatch Metrics Integration for CloudWatch ingestion setup, and Relabel Rules for other ingestion-time metric configuration.
