Estimated reading time: 20 minutes

ThoughtSpot version 5.0 is now available. This release includes the features and issues shown here.

Supported upgrade paths

If you are running one of the following releases, you can upgrade to this release directly.

  • 4.4.1.x to 5.0
  • 4.5. to 5.0
  • 4.5.1.x to 5.0

(This includes any hotfixes or customer patches on these branches.)

If you are running a different version, you need to do a multiple pass upgrade. First, upgrade to one of the above versions, and then to this release.

5.0 New Features and Functionality

SearchIQ

SearchIQ is a different search experience that understands more natural, speech-like search language than the current search function. For example, a user could search for “What was my top selling product last month?”, instead of having to type “top 1 product by sales last month”. You can also speak your search using the voice-to-text capability of your operating system.

You can easily teach SearchIQ your language as you use it. Over time, it gets smarter about how to interpret terms that don’t come directly from column names or values. In order to give it time to learn, the best practice recommendation is to enable SearchIQ for a small group of users. Over time you can roll it out to larger groups as SearchIQ learns what your users search for the most.

SearchIQ is turned off by default, but you can enable it by asking ThoughtSpot Support to turn it on for your cluster. For each group that should have access to the SearchIQ experience, you’ll need to grant them the “Can use experimental features” permission.

Worksheet filters

You can now add filters to a worksheet to limit the set of data it contains. This is useful when you have underlying tables that store more data than necessary for the types of analyses the worksheet is intended for. You can also use worksheet filters to provide data security when you have different groups of users that are trying to access different types of data without relying on row level security.

Search response to Enter key

The way the system responds to the user typing the Enter key has changed. The system can now resolve an exact match even if there are other partial matches or the suggestions have not returned from the server yet. These changes result in a more natural search experience that allows advanced users to get search results quicker.

Improvements in the visualization configuration workflow and design

Switching from table to chart is now a toggle button rather than two separate icons. To change the chart type, you now use a separate button. This makes changing the chart type more intuitive.

The chart configuration icons now appear in a vertical panel, to the right of the visualization. This provides a cleaner look, and more real estate to display the visualization. The more information icon has also been moved to this panel. The style icon has been added for easy access to setting display properties, including colors.

Exclude filters

When defining a filter for a column or worksheet, you can now choose values to exclude as well as to include. In past releases, it was difficult to create a "not equals" filter. Now you can define an exclude filter in any of these ways:

  • by choosing from a list of values
  • by adding a bulk exclude filter
  • by using != operator in the search bar

Search ranking

The rules that determine the ranking of search suggestions have been adjusted to more closely match what most users expect. For example, suggestions that match what you've typed so far can move up in the suggestion ranking, but not down. Suggestions that match the beginning of what you're typing appear higher than ones that have a match in the middle of a phrase. These changes make suggestions more useful and the search experience more intuitive.

Flexible aggregations

The 5.0 release introduces flexible aggregations to enable you to aggregate measures using filters and aggregation dimensions that might be different from the ones that are used in the search. For example, you might need to compare yearly sales against the monthly sales for each product category or you might need to compare against the total sales of only active products.

Flexible Joins in Worksheets

This version of ThoughtSpot introduces flexible join types to give you more options and an easier workflow to model joins between tables, views, and worksheets and within worksheets.

You can now specify the join type separately for each join between tables in a worksheet. You can also create generic relationships between tables without leaving the worksheet creation workflow within the ThoughtSpot application.

In past versions, there were several limitations on joins:

  1. It was hard to see the effective schema when creating or editing a worksheet.
  2. You could only specify one type of join (inner, outer, etc.) per worksheet, and that join type would be applied to all table joins in the worksheet.

This limited the use of worksheets such that they couldn’t be applied to some use cases. For example, sometimes two tables in a worksheet required a full outer join between them, while two others required an inner join. Now you can create this type of worksheet, and all the joins to support it, in a single workflow.

Now you can specify join type for each relationship in a worksheet, using one of these types:

  • Full outer join
  • Left outer join
  • Right outer join
  • Inner join

In ThoughtSpot, the fact or source table is the “left” table, and the dimension (target or destination) table is the “right” table. You can now easily see which is the left table and which is the right table when you’re setting up the join types.

Added the ability to add custom Help links

When users click the help icon, they see a list of links. You can now add your own links to this list. This allows you to include documentation specific to your company, such as information about the data available in ThoughtSpot, where to get support internally, or company-specific training.

You can also edit existing links, change icons, or remove items from the help listing altogether.

Style customization options are enabled by default

In the past, to enable style customization—colors, fonts, and custom logo—you had to contact ThoughtSpot Support. With this release, style customization features are enabled by default for users with the Administrator privilege. If you want to disable these settings, contact ThoughtSpot Support.

Support for IPSec between cluster nodes

With 5.0, you can encrypt traffic between various ThoughtSpot cluster nodes. However, by default the encryption of traffic between ThoughtSpot nodes is disabled. When required to enable on a specific cluster, contact ThoughtSpot Support. ThoughtSpot can enable encryption of traffic between ThoughtSpot nodes to allow this feature to automatically work on Amazon Web Services (AWS), Google Cloud Platform (GCP), OnPrem, or Microsoft Azure.

Embedded Search API

The Embedded Search API enables searching directly from an external application or web page to pull data from ThoughtSpot. When using this API, you can access data stored in ThoughtSpot directly. You do not need to save a search result to a pinboard and then reference it using the visualization’s URL. This embedded search is useful when you want to allow an application to pull data directly from ThoughtSpot in an ad hoc fashion. To have the Embedded Search API functionality turned on, contact ThoughtSpot Support.

URL links in data values can now open in the same tab or iFrame

In past versions, clicking a URL link in an answer would open the URL in a new tab. Similarly, for an answer embedded in an iFrame, clicking on a URL opened it in a new tab. This is still the default behavior, but you can configure ThoughtSpot to open the link in the same context where it appears.

Now you can change a cluster-wide setting to make links open in the same context (iFrame or tab) in which they appear. With this configuration, if the ThoughtSpot answer is embedded in an iFrame, clicking the URL will open it within the same iFrame. If you are using the ThoughtSpot application the link will open in the same tab.

This setting applies to an entire ThoughtSpot instance. So if it is set to open URLs in the same tab, all URL links whether in the application or in an embedded visualization will open in place. Contact ThoughtSpot Support if you would like them to change this setting for you.

Patch support for updates

The 5.0 release adds support for applying patches using the tscli command. With this patch support, you do not need to upgrade the entire cluster when there is a bug fix, security fix, or minor feature you want to install. It also provides the ability to apply or rollback a patch and to see any patches that have been applied cluster-wide or listed out by service. To see the list of patches applied currently on a cluster, run the following commands:

tscli patch ls

To see a list of all patches that have ever been applied, including any that were rolled back, issue the command:

tscli patch ls --applied

Additional command flags allow you to see the listing by service or to view all patch rollbacks.

To install a patch, contact ThoughtSpot Support.

Pinboard Instant Insights

With the 5.0 release, you can now automatically view the executive summary of insights for each SpotIQ Pinboard visualizations. Use the magic wand icon (at the top right corner) to see instant insights of your data. The instant insights are generated based on the analysis of visualizations and tables which are pinned on to your pinboard.

Note that the instant insights are cached. It means if you ran SpotIQ analysis on a pinboard to generate insights, you do not need to rerun SpotIQ analysis.

Ability to include or exclude values

Filters on columns, pinboards, and worksheets now give you the ability to include or exclude values. In past releases, you could only choose values to include. This change makes it easy to see all values except for one or more values. Bulk filters also work with exclude.

When selecting a filter from a list of values, the null value is now available for filtering. You can choose to include or exclude the null value. This allows you to easily see where null (missing) values exist in the data. This can be helpful when looking for dirty or incomplete data.

Change the color on single color charts

When a chart consists of a single color, you can now change the color. To do this, select the chart style icon to the right of the chart. Under the Color section, use the color picker to choose which color to use for the chart.

Stacked bar chart

Stacked bar chart, a new chart type, is the equivalent of stacked column charts, but with a horizontal orientation. Some types of data are easier to understand when shown in a stacked bar rather than a stacked column chart.

Latest updates to table formatting

Tables have a new look! The new table formatting makes data more accessible to see because the columns are sized better, text wraps more cleanly, and there is additional white space between rows. To adjust the column width, try clicking and dragging between columns.

Data Push API

The Data Push API allows you to open a web page in the context of the ThoughtSpot application. This third party web page will then have access to the results of the ThoughtSpot search from which it was invoked. This is useful when you want to initiate an action in another application based on the result of a search in ThoughtSpot. An example of pushing data to another system to trigger an action would be where you do a search to find customers who are coming due for renewal of their contract in the next month. You could then trigger an action that brings up a web page from an external billing system. The billing system could be set up to read the data (list of names, emails, products, and renewal dates) from ThoughtSpot. The billing system might then add the price, generate an invoice for each customer, and send it out via email. To have the Data Push API functionality turned on, contact ThoughtSpot Support.

Custom R scripts on search results

The ability to add custom R scripts is now available as part of the Search page. In previous releases, custom R scripts were an option only on SpotIQ custom analysis. Starting in version 5.0, given R privileges, you can create and run R scripts on search results (answers),leverage ThoughtSpot provided scripts, share scripts as templates, and share R visualizations as answers and pinboards. End users with privileges can run pre-built R scripts on top of their search results.

Introducing Materialized Views

Views are new in version 5.0, and they are similar to aggregated worksheets or search saved as a worksheet. With this release, views can be materialized to provide better performance. After creating a view, you can choose to materialize the view, which helps precompute the view and store it in memory along with the data. You can refresh the view manually or on a set schedule to keep it in synch with the underlying tables as their data is refreshed. Note: Once materialized, a view does not respect row-level security. So all users of the view will be able to see all the data it contains.

New Language support

Starting in the 5.0 release, the following new locales are supported on the UI including support for language keywords that can be used in the search bar:

  • French-France
  • French-Canada
  • Spanish-Latin American
  • Chinese-Simplified
  • Portuguese-Brazil

SpotIQ Automated Insights on the homepage

On the homepage, there is now a section called Did You Know?, which shows insights found by SpotIQ. To find these insights, SpotIQ runs many analyses of the data used in recent searches. The results which are most likely to contain useful insights are included in this section. This helps users get more value from their data and learn about areas where you may want to do further exploration.

New Leaderboard pinboard

The out-of-the-box pinboard called TS Stats: System Information and Usage now contains leaderboard visualizations. These show which users are most active, and what kinds of things they're doing in ThoughtSpot.

Some of the new visualizations show:

  • Which users were most active in the last month
  • Which pinboards are viewed most often
  • Which users have initiated the most all-time ad-hoc searches
  • Which users have been active today
  • Number of monthly active users (MAU)

This leaderboard increases engagement within your user community and helps you identify the people who are the most skilled and frequent ThoughtSpot users.

New default snapshot policy

This release includes a new default snapshot policy. Three snapshots are taken over 4-hour intervals in the course of a day. And 4 daily snapshots are taken. This provides continuity over the long weekends in many countries by ensuring snapshots on Saturday, Sunday, Monday, and Tuesday.

Learn ThoughtSpot in GA

The Learn option from the main menu has moved from a BETA to a GA feature. Learn uses replay to teach users how to perform search with ThoughtSpot.

Related answers

Related Answers now appear as cards at the bottom of the search results. This is less distracting when searching and makes these saved searches stand out as distinct from search suggestions.

Localized date format supported in search filters

The search bar now accepts dates in the format used by the user browser's locale setting. For example, European locales accept dates using formats like DD-MM-YYYY. The US locale accepts dates using formats like MM-DD-YYYY.

Fiscal calendar in date formulas

Several date functions now support the ability to indicate either a fiscal or Gregorian calendar (calendar) on which to base date calculations. If no calendar type is specified, formulas default to standard Gregorian, with the year starting in January.

5.0 Fixed Issues

A problem was resolved where changes to metadata resulted in rebuilding the search index, even though the data had not changed.

A problem was resolved where a search was returning an unexpected answer, because the last aggregation performed during execution was doing a MIN() rather than a SUM().

A problem was resolved where timeouts were causing a cluster crash in some cases when a right outer join was used.

A problem was resolved where the space allocation chart was not getting updated.

Notes for older versions