Skip to content

Commit c626388

Browse files
committed
out_bigquery: add documentation for configurable buffer_size option
Signed-off-by: Tsubasa Miyamoto <tsubasa.miyamoto@gmail.com> clarify buffer_size is a fixed-size allocation
1 parent a0023a6 commit c626388

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

pipeline/outputs/bigquery.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -60,6 +60,7 @@ You must configure workload identity federation in GCP before using it with Flue
6060
| provider\_id | GCP workload identity provider. Used to construct the full resource name of the identity provider. Currently only AWS accounts are supported. | |
6161
| google\_service\_account | Email address of the Google service account to impersonate. The workload identity provider must have permissions to impersonate this service account, and the service account must have permissions to access Google BigQuery resources (e.g. `write` access to tables) | |
6262
| workers | The number of [workers](../../administration/multithreading.md#outputs) to perform flush operations for this output. | `0` |
63+
| buffer_size | Sets the HTTP client buffer size (in bytes) for reading API responses from BigQuery. This is a fixed-size allocation; responses larger than this size will trigger a warning. | `4192` |
6364

6465
See Google's [official documentation](https://cloud.google.com/bigquery/docs/reference/rest/v2/tabledata/insertAll) for further details.
6566

0 commit comments

Comments
 (0)