Google BigQuery connection reference
Learn about the fields used to create an Google BigQuery connection with ThoughtSpot DataFlow.
Here is a list of the fields for a Google BigQuery connection in ThoughtSpot DataFlow. You need specific information to establish a seamless and secure connection.
Connection properties
- Connection name
-
Name your connection. Mandatory field.
- Example:
-
GoogleBigQueryConnection
- Connection type
-
Choose the Google BigQuery connection type. Mandatory field.
- Example:
-
Google BigQuery
- Project id
-
The identification number given to particular project, always unique. Mandatory field.
- Example:
-
myproject-1234
- Authentication type
-
It can be either Service Account or Access Tokens. Mandatory field.
- Example:
-
Service Account
- Valid Values:
-
Service Account, Access Token
- Default:
-
Service Account
- Service Account key/Access Token
-
Provide the Service Account key when authentication type is selected as Service account and token when access token is selected as authentication type. Mandatory field.
- Example:
-
ABCDEFGH245HIJK
- Query priority
-
Specify the time duration to run the query and it can be either Interactive or Batch. Optional field.
- Example:
-
BATCH
- Valid Values:
-
INTERACTIVE, BATCH
- Default:
-
BATCH
- Other notes:
-
In Advanced configuration
- Cloud storage location
-
Provide the GCS bucket and object location details.
- Example:
-
gs://GCS bucket/object location
- Other notes:
-
In Advanced configuration
- Staging database
-
Specify the name of the staging database. Optional field.
- Example:
-
testdb
- Other notes:
-
In Advanced configuration
- Staging database project ID
-
Specify the unique identification number given to staging database. Optional field.
- Example:
-
phrasal-indexer-12345
- Other notes:
-
In Advanced configuration
- Use proxy
-
If required, to use a proxy, select the check box. Use Proxy and provide the details Optional field.
- Other notes:
-
In Advanced configuration
- Host
-
Specify the hostname or the IP address of the BigQuery system. Optional field.
For proxy authentication only.- Example:
-
www.example.com
- Port
-
Specify the port associated to the BigQuery system. Optional field.
For proxy authentication only.- Example:
-
1234
- Protocol
-
It can be either http or https. Optional field.
For proxy authentication only.- Example:
-
http
- Valid Values:
-
http, https
- Default:
-
http
Sync properties
- Column delimiter
-
Specify the column delimiter character. Mandatory field.
- Example:
-
1
- Valid Values:
-
Any printable ASCII character, or the decimal value for an ASCII character.
- Default:
-
The delimiter specified in sync
- Enclosing character
-
Specify if the text columns in the source data needs to be enclosed in quotes. Optional field.
- Example:
-
DOUBLE
- Valid Values:
-
DOUBLE, SINGLE, NULL
- Default:
-
SINGLE
- Escape character
-
Specify the escape character if using a text qualifier in the source data. Optional field.
- Example:
-
\"
- Valid Values:
-
\\, any ASCII character
- Default:
-
\"
- Fetch size
-
Specify the number of rows to fetch at one time, and process in memory. To fetch all rows, specify 0 rows. Optional field.
- Example:
-
1000
- Valid Values:
-
1000, 10, 100. 100000, any numeric value
- Default:
-
10
- Allow large resultset
-
If enabled, allows query results that are larger in size. Optional field.
- Example:
-
FALSE
- Valid Values:
-
TRUE
- Default:
-
FALSE
- Max ignored rows
-
Abort the transaction after encountering 'n' ignored rows. Optional field.
- Example:
-
0 - Valid Values:
-
Any numeric value
- Default:
-
0
- tsload options
-
Specifies the parameters passed with the
tsloadcommand, in addition to the commands already included by the application. The format for these parameters is:<param_1_name> = <param_1_value>- Example:
-
date_time_format = %Y-%m-%d date_format = %Y-%m-%d;time_format = %H:%M:%S - Valid Values:
-
null_value = NULL max_ignored_rows = 0 - Default:
-
max_ignored_rows = 0
Related information
