Create an APM alert
While similar to standard metric alerts, we designed APM alerts to monitor features of APM metrics. With APM alerts, you can set alerts at the service level for metrics: number of hits, errors, and various latency indicators.
To create an APM alert, complete these tasks:
Begin defining an APM alert
-
In the Alerts interface, click (Create New Alert).
-
In the initial interface for creating alerts, Kloudfuse guides you to select the appropriate alert type.
Choose APM.
-
The Create APM Alert interface appears.
Choose the detection method
APM alerts have these detection options:
- Threshold alert
-
select
- Anomaly detection
-
select
Pick a service and trigger type
Specify the service you plan to monitor, and its trigger.
-
Select the (Service name), from the (Pick a service) drop-down.
Depending on the service and its configuration, the system displays its labels.
-
(Pick labels):
-
Select a label from the next drop-down.
-
Choose the comparison operator:
- =~
-
Regex expression equal
- !~
-
Regex expression not equal
- !=
-
Not equal
- =
-
Equal (default)
-
Finally, select one of the possible values from the last drop-down in the grouping.
-
-
Choose (Trigger type) from the drop-down. The default is Request per Second, and other options are p50 Latency, p75 Latency, p90 Latency, p95 Latency, p99 Latency, Error rate, Min latency, Max latency, Average latency, and APDEX.
-
Click the initial text field to select a metric from the drop-down.
-
The chart of the metric over the time period appears.
You can proceed with these optional configurations:
Work with filters
-
To add a new filter, select a label and add it to the metric view.
Next to the (From) tag, click the (Add) icon.
-
In the expanded view, click the first (Select) option, and choose the new label from the drop-down.
-
Choose the comparison operator:
- =~
-
Regex expression equal
- !~
-
Regex expression not equal
- !=
-
Not equal
- =
-
Equal (default)
-
Finally, click the second (Select) option, and choose the label value from the drop-down.
-
To add another filter, click the (Add) icon, and specify the new label.
Remember that the filter selections combine using AND logic.
-
To remove a filter, click the (Delete) icon that corresponds to the label/value pair that you plan to remove.
-
The filter no longer appears on the page.
Work with aggregations
-
In the aggregation section, click avg, and select another aggregation calculation from the drop-down.
-
The chart changes to show the newly selected aggregation of results.
-
To aggregate over another dimension, in the metrics selector specify the aggregation by clicking Select, and choosing another metric option from the drop-down.
-
To remove the aggregation, in the aggregation section click the (Remove) icon.
Work with functions
-
To add a new function to the graph, click the (Sigma) icon at the end of the query specification.
-
In the drop-down, either search for a function name, or select an existing function category, and then pick the function name.
-
Configure the parameters of the function, if any.
-
To remove a function, click (Remove function) icon, next to the function you want to drop.
Work with queries
-
To add a query, click (Add Query).
-
Notice that a new query (B) appears under query (A), and it is a duplicate.
This is intentional, and makes it is easier to perform calculations across the time series retrieved by the two queries.
-
Change the selected filter in query (B).
-
To remove one of the queries, click the (Remove) icon that corresponds the to query you plan to remove.
Add formula
You can combine metrics over facets or labels into formulas, to get additional insights.
-
To add a formula, click (Add Formula).
-
The empty formula option appears in interface as line (1), under the query lines.
-
Type the formula in the text box next to label (1).
-
To remove a formula, click (Delete) icon that corresponds to the formula you plan to remove.
-
The formula is no longer in the interface.
Set condition
There are some differences in the process of setting the alerting condition, depending on the detection method.
-
Define the condition
-
Threshold Alert
-
Anomaly Detection
-
From the first drop-down, select the condition function: Mean, Min, Max (default), Sum, Count, or Last.
-
From the second drop-down, select the comparison operator: above (default), below, equal to, not equal to, above or equal to, or below or equal to.
-
[Optional] In the text box, specify the unit of the measurement.
-
In the third (last) drop-down, specify the time interval: 5 minutes, 10 minutes, 15 minutes, 30 minutes, 1 hour, 2 hours, 4 hours, 1 day, 2 days, 1 week, or 1 month.
-
In the text entry field, specify the percentage of time above or below the threshold.
-
In the first drop-down, specify the time interval: 5 minutes, 10 minutes, 15 minutes, 30 minutes, 1 hour, 2 hours, 4 hours, 1 day, 2 days, 1 week, or 1 month.
-
In the third drop-down, select the algorithm.
Kloudfuse implements basic, agile, robust, and agile-robust algorithms for anomaly detection. Depending on the algorithm, set these options:
- Basic
-
- Window
-
(time interval): 1 minutes, 2 minutes, 5 minutes, 10 minutes, 15 minutes, 30 minutes, 1 hour, 2 hours, 3 hours, 6 hours, 12 hours, or 1 day.
- Bound
-
1 (default), 2, or 3.
- Band
-
upper, lower, or both
- Agile
-
- Bound
-
1 (default), 2, or 3.
- Band
-
upper, lower, or both
- Robust
-
- Window
-
(time interval): 1 minute, 2 minutes, 5 minutes, 10 minutes, 15 minutes, 30 minutes, 1 hour, 2 hours, 3 hours, 6 hours, 12 hours, or 1 day.
- Bound
-
1 (default), 2, or 3.
- Seasonality
-
Hourly (default), Daily, or Weekly.
- Band
-
upper, lower, or both
- Agile-robust
-
- Seasonality
-
None, Hourly, Monthly, or Quarterly.
- Bound
-
1 (default), 2, or 3.
- Band
-
upper, lower, or both
-
-
Expand the Configure no data and error handling option.
- No data
-
What to do when data is missing.
In the first drop-down, select one of the options: Alerting, No data, or OK (default).
- Error handling
-
What to do when there is an execution error, or a timeout.
In the second drop-down, select one of the options: Alerting, OK, or Error (default).
Add details
-
In the Folder name drop-down, select one of the folders.
Alternatively, click the (Create new folder) icon.
Then, in the Create Folder dialog, specify Folder name, and click (Create new folder).
-
In Rule name, specify the name of your rule.
-
[Optional] In Title, enter the title of your rule.
-
[Optional] In Runbook URL, enter the location of the runbook that specifies how to handle the alert.
-
[Optional] Under Desription, specify the purpose of the rule, what conditions it should catch, and so on.
-
[Optional] Under Custom labels, click (plus), and specify the custom label name, and its value.
To add more custom labels, click (plus), and specify more custom labels.
To remove a custom label, click (Trash) next to it.
-
[Optional] Under Custom annotations, click (plus), and specify the custom annotation name, and its value.
To add more custom annotations, click (plus), and specify more custom annotations.
To remove a custom annotation, click (Trash) next to it.
Use annotations to show different alerts and their visualizations.
Add contacts
Choose contact points
-
Choose one or more of the existing contacts from the drop-down, so they can receive the alert.
-
To remove a contact you previously selected from the alert notification, click (Delete) icon on their tile.
-
To remove all contacts that you previously selected, click the (Delete) icon on the right side of the drop-down.
Create new contact points
-
Click (Create New Contact Points).
-
Kloudfuse opens the Create Contact points interface.
Specify, configure, test, and save new contact points. See Alerts contact points for details.
Create rule
-
To finalize, click (Create Rule).
-
Depending on your choice of calculation when you Set condition (, , , , and so on) Kloudfuse generates a Confirm Query Selection dialog.
-
In the Confirm Query Selection dialog, click (Confirm and Create)
-
You get a confirmation message.