Amazon Redshift DataFlow connection reference

Learn about the fields used to create an Amazon Redshift connection with ThoughtSpot DataFlow.

Here is a list of the fields for an Amazon Redshift connection in ThoughtSpot DataFlow. You need specific information to establish a seamless and secure connection.

Connection properties

Connection name

Name your connection. Mandatory field.

Example:

AmazonRedshiftConnection

Connection type

Choose the Amazon Redshift connection type. Mandatory field.

Example:

Amazon Redshift

Host

Specify the hostname or the IP address of the Redshift system. Mandatory field.

Example:

example.com

Port

Specify the port associated to the Redshift system Mandatory field.

Example:

1234

Default:

5439

User

Specify the user to connect to Amazon Redshift. This user must have data access privileges. Mandatory field.

Example:

userdi

Password

Specify the password for the User.

Mandatory field.

Example:

pswrd234%!

Database

Collection of information that is organized so that it can be easily accessed, managed and updated. Mandatory field.

Example:

database

Enter password/ Fetch password from vault

Select whether to enter password or fetch and use the password you have stored in external vault providers (e.g AWS Secrets Manager). Mandatory field.

Default:

Enter password

Vault provider

Select the name of your external vault provider. Mandatory field.

Default:

AWS Secrets Manager

Other notes:

Option appears when you select “Fetch password from vault.” Requires Identity & Access Manager (IAM) role and DataFlow should be on Amazon Elastic Compute Cloud (Amazon EC2).

Secrets Manager Region

Region of the AWS account where secret manager is defined. Mandatory field.

Other notes:

Option appears when you select “Fetch password from vault.”

Secret Name or ARN

If user trying to access using two different accounts, then the value to be given here is a fully qualified Amazon Resource Name (ARN) of the secret. Mandatory field.

Other notes:

Option appears when you select “Fetch password from vault.” Use Secret Name or ARN for assuming role from different account. Requires ARN for secret name field.

Remote role ARN

If user trying to access using two different accounts, then the value to be given here is a remote role Amazon Resource Name (ARN) where secret manager is not defined. Optional field.

Other notes:

Option appears when you select “Fetch password from vault.”

Key name in secret

Key name given for the secret, to get its value. Mandatory field.

Other notes:

Option appears when you select “Fetch password from vault.”

JDBC options

Specify the options associated with the JDBC URL.

Optional field.

Example:
jdbc:sqlserver://[serverName[\instanceName][:portNumber]]
Other notes:

Advanced configuration.

Sync properties

Column delimiter

Specify the column delimiter character. Mandatory field.

Example:

1

Valid Values:

Any printable ASCII character or decimal value for ASCII character

Default:

1

Enclosing character

Specify if the text columns in the source data needs to be enclosed in quotes. Optional field.

Example:

DOUBLE

Valid Values:

SINGLE, DOUBLE

Default:

DOUBLE

Other notes:

This is required if the text data has newline character or delimiter character.

Escape character

Specify the escape character if using a text qualifier in the source data. Optional field.

Example:

\"

Valid Values:

Any ASCII character

Default:

\"

Fetch size

Specify the number of rows to be fetched at a time and processed in memory. If the value specified is zero then, all rows are extracted at once. Mandatory field.

Example:

1000

Valid Values:

Any numeric value

Default:

1000

TS load options

Specifies the parameters passed with the tsload command, in addition to the commands already included by the application. The format for these parameters is:

--<param_1_name> <optional_param_1_value>
--<param_2_name> <optional_param_2_value>

Optional field.

Example:
--max_ignored_rows 0
Valid Values:
--null_value ""
--escape_character ""
--max_ignored_rows 0
Default:
--max_ignored_rows 0