Skip to content

Commit e71cf43

Browse files
committed
out_bigquery: add documentation for configurable buffer_size option
Signed-off-by: Tsubasa Miyamoto <tsubasa.miyamoto@gmail.com>
1 parent 8353f70 commit e71cf43

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

pipeline/outputs/bigquery.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -45,6 +45,7 @@ Fluent Bit streams data into an existing BigQuery table using a service account
4545
| `provider_id` | GCP workload identity provider. Used to construct the full resource name of the identity provider. Currently only AWS accounts are supported. | _none_ |
4646
| `google_service_account` | The email address of the Google service account to impersonate. The workload identity provider must have permissions to impersonate this service account, and the service account must have permissions to access Google BigQuery resources ( `write` access to tables) | _none_ |
4747
| `workers` | The number of [workers](../../administration/multithreading.md#outputs) to perform flush operations for this output. | `0` |
48+
| buffer_size | Sets the upper limit for the HTTP client buffer size (in bytes) when reading API responses from BigQuery. The buffer grows dynamically as needed until it reaches this limit; if a response exceeds this size, any additional data is discarded and a warning is logged. | `4192` |
4849

4950
See Google's [official documentation](https://cloud.google.com/bigquery/docs/reference/rest/v2/tabledata/insertAll) for further details.
5051

0 commit comments

Comments
 (0)