You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: pipeline/outputs/opentelemetry.md
+17Lines changed: 17 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -105,6 +105,7 @@ pipeline:
105
105
|`logs_uri`| Specify an optional HTTP URI for the target OTel endpoint. |`/v1/logs`|
106
106
|`match`| Set a tag pattern to match records that output should process. Exact matches or wildcards (for example `*`). |_none_|
107
107
|`match_regex`| Set a regular expression to match tags for output routing. This allows more flexible matching compared to wildcards. |_none_|
108
+
|`metrics_max_datapoints`| Set the maximum number of metric data points per OTLP export request. Fluent Bit splits a metrics payload that exceeds this value into multiple export requests. `0` disables the limit and sends each payload as a single request. Negative values are rejected at startup. See [Metrics batching](#metrics-batching). Supported in v5.1.3 or later. |`0`|
108
109
|`metrics_uri`| Specify an optional HTTP URI for the target OTel endpoint. |`/v1/metrics`|
109
110
|`net.connect_timeout`| Set maximum time allowed to establish a connection, this time includes the TLS handshake. |`10s`|
110
111
|`net.connect_timeout_log_error`| On connection timeout, specify if it should log an error. When disabled, the timeout is logged as a debug message. |`true`|
@@ -163,6 +164,22 @@ pipeline:
163
164
|`traces_uri`| Specify an optional HTTP URI for the target OTel endpoint. |`/v1/traces`|
164
165
|`workers`| The number of [workers](../../administration/multithreading.md#outputs) to perform flush operations for this output. |`0`|
165
166
167
+
## Metrics batching
168
+
169
+
Some OTLP receivers reject export requests that carry too many metric data points. Set `metrics_max_datapoints` to cap the number of data points in a single request. When a metrics payload exceeds the limit, Fluent Bit splits it into several export requests and sends them in order.
170
+
171
+
By default, `metrics_max_datapoints` is `0`, which disables splitting and sends each metrics payload as one request.
172
+
173
+
When splitting is active and one of the requests fails after an earlier request in the same payload already succeeded, Fluent Bit logs a warning similar to the following and doesn't retry:
174
+
175
+
```text
176
+
metric payload partially succeeded (2/5 batches); skipping retry to avoid resending accepted data
177
+
```
178
+
179
+
Fluent Bit skips the retry because a retry sends the whole payload again, which would duplicate the data points the receiver already accepted. The data points in the remaining requests are dropped. If a request fails before any request in the payload succeeds, Fluent Bit retries the payload as usual.
180
+
181
+
Choose a value that your receiver accepts without needing frequent splits. A value that's too low increases the number of requests and the chance of a partial send.
182
+
166
183
## Get started
167
184
168
185
The following example exports log records generated by the dummy plugin, host metrics collected by the node exporter metrics plugin, and traces generated by the event type input. It uses OTLP/HTTP over TLS.
0 commit comments