Google BigQuery connection reference

Learn about the fields used to create a Google BigQuery connection with ThoughtSpot DataFlow.

Here is a list of the fields for a Google BigQuery connection in ThoughtSpot DataFlow. You need specific information to establish a seamless and secure connection.

Connection properties

Connection name

Name your connection. Mandatory field.

Example:

GoogleBigQueryConnection

Connection type

Choose the Google BigQuery connection type. Mandatory field.

Example:

Google BigQuery

Project id

The identification number given to particular project, always unique. Mandatory field.

Example:

myproject-1234

Authentication type

It can be either Service Account or Access Tokens. Mandatory field.

Example:

Service Account

Valid Values:

Service Account, Access Token

Default:

Service Account

Service Account key/Access Token

Provide the Service Account key when authentication type is selected as Service account and token when access token is selected as authentication type. Mandatory field.

Example:

ABCDEFGH245HIJK

Query priority

Specify the time duration to run the query and it can be either Interactive or Batch. Optional field.

Example:

BATCH

Valid Values:

INTERACTIVE, BATCH

Default:

BATCH

Other notes:

In Advanced configuration

Cloud storage location

Provide the GCS bucket and object location details.

Example:

gs://GCS bucket/object location

Other notes:

In Advanced configuration

Staging database

Specify the name of the staging database. Optional field.

Example:

testdb

Other notes:

In Advanced configuration

Staging database project ID

Specify the unique identification number given to staging database. Optional field.

Example:

phrasal-indexer-12345

Other notes:

In Advanced configuration

Use proxy

If required, to use a proxy, select the checkbox. Use Proxy and provide the details Optional field.

Other notes:

In Advanced configuration

Host

Specify the hostname or the IP address of the BigQuery system. Optional field.
For proxy authentication only.

Example:

www.example.com

Port

Specify the port associated to the BigQuery system. Optional field.
For proxy authentication only.

Example:

1234

Protocol

It can be either http or https. Optional field.
For proxy authentication only.

Example:

http

Valid Values:

http, https

Default:

http

Sync properties

Column delimiter

Specify the column delimiter character. Mandatory field.

Example:

1

Valid Values:

Any printable ASCII character, or the decimal value for an ASCII character.

Default:

The delimiter specified in sync

Enclosing character

Specify if the text columns in the source data needs to be enclosed in quotes. Optional field.

Example:

DOUBLE

Valid Values:

DOUBLE, SINGLE, NULL

Default:

SINGLE

Escape character

Specify the escape character if using a text qualifier in the source data. Optional field.

Example:

\"

Valid Values:

\\, any ASCII character

Default:

\"

Fetch size

Specify the number of rows to fetch at one time, and process in memory. To fetch all rows, specify 0 rows. Optional field.

Example:

1000

Valid Values:

1000, 10, 100. 100000, any numeric value

Default:

10

Allow large resultset

If enabled, allows query results that are larger in size. Optional field.

Example:

FALSE

Valid Values:

TRUE

Default:

FALSE

Max ignored rows

Abort the transaction after encountering 'n' ignored rows. Optional field.

Example:

0

Valid Values:

Any numeric value

Default:

0

tsload options

Specifies the parameters passed with the tsload command, in addition to the commands already included by the application. The format for these parameters is:

<param_1_name> = <param_1_value>
Example:
date_time_format = %Y-%m-%d
date_format = %Y-%m-%d;time_format = %H:%M:%S
Valid Values:
null_value = NULL
max_ignored_rows = 0
Default:
max_ignored_rows = 0

Related information