Rate Control for RUM stream ingestion
You can customize an ingestion rate control mechanism that enables you to limit the amount of ingested logs data.
Navigate to RUM Rate Control
-
Follow the steps in Navigate to Rate Control Policy Management.
-
In the list of streams, hover over the Logs stream, and click the
(Edit) icon.
Configure RUM Rate Control
To add or change the ingestion rate control for RUM, configure the rate control in the RUM - Rate Control interface:
- Stream Type
-
The default stream type is RUM.
- Ingestion Rate
-
Specify the number of RUM events per second.
The default is 100 RUM events per second.
This represents the maximum number of items that Kloudfuse can ingest for the stream, per second.
- Burst
-
The maximum number of RUM events that Kloudfuse can ingest from a single burst.
The default is 6000 RUM events.
To enable bursting while maintaining average rates, we recommend that you modify the burst size to match your business needs:
burst=rate
-
Set the burst equal to the rate to ensure that Kloudfuse ingests up to
1
second’s worth of traffic at the same time. burst=rate * N
-
Set the burst equal to a multiple of the rate to ensure that Kloudfuse ingests
N
seconds' worth of traffic at the same time.
- Default Percentage
-
The percentage of quota set for the RUM stream, as a whole.
You can split this into defined classes; see Split the stream allocation. Be sure to adjust this value to compensate for the allocations to custom classes.
The initial value of this default class is 100%.
Click (Save Rate Control) to finalize the rate control assignment to the stream.
After splitting the percentage, the RUM stream definition may look like this. The Events Drop Percentage (1hr) changes over time.
Split the stream allocation
At a more granular level, you can split the percentage quota of your RUM stream into distinct classes.
-
Complete the steps in Manage Classes.
-
Complete the steps in Add Classes.
Click (Save Rate Control) to finalize the rate control assignment to the stream.
Manage Classes
To use classes, you must first define them. Click Manage Classes:
In the Rate Control Manage Classes page, proceed to define the classes.
-
Ensure that you select the correct Stream Type. Each stream type has its own classes.
-
Click
(Add Class).
-
Name the class. For example, Class 1.
-
Specify at least one filter for the class:
- Key
-
The label name that can be extracted from, or assigned to, the stream. For example, availability-zone.
- Value
-
The value of the key. For example, us-west-2c.
You can use a regex pattern to define a value. This results in multiple possible value matches.
-
[Optional]
To add another filter to the class definition, click
(Add filter).
Order: Kloudfuse evaluates the rules in order, top-down.
Combination: When a class definition has multiple
key:value
filter pairs, Kloudfuse combines them usingAND
logic. -
To delete a filter from a class, click the
(Delete) icon next to the filter definition.
-
To add more class definitions, click
(Add Class).
-
To delete a class, click the
(Delete) icon next to the class name.
-
Click
to finalize class definition for rate control on that data stream.
Add Classes
To assign percentages to classes, click (Add Class):
-
From the Class drop-down, select an existing class.
-
Assign a percentage.
-
Continue adding as many classes as required.
The total assigned percentage cannot exceed 100%.
The Default Percentage applies to the streams that don’t match the defined classes and selected classes. So if the total for the named classes adds up to 90%, then the Default Percentage can have a maximum value of 10%.