Manage the Dremio Connector

This applies to: Visual Data Discovery

The Symphony Dremio connector lets you access the data available in Dremio from supported versions of MySQL and MS SQL Server data stores using the Symphony client. The Symphony Dremio connector supports Dremio Community and Enterprise Editions version 4.1 through 4.8.

Before you can establish a connection from Symphony to Dremio storage, a connector server needs to be installed and configured. See Manage Connectors and Connector Servers for general instructions and Connect to Dremio for details specific to the Dremio connector.

After the connector has been set up, you can create data source configurations that specify the necessary connection information and identify the data you want to use. See Manage Visual Data Discovery Data Source Configurations for more information. After data sources are configured, they can be used to create dashboards and visuals from your data. See Create Data Discovery Dashboards.

Feature Support

Connector support for specific features is shown in the following table.

Key: Y - Supported; N - Not Supported; N/A - not applicable

Feature Supported?
Admin-Defined Functions N
Box Plots Y
Custom SQL Queries N
Derived Fields (Row-Level Expressions) N
Distinct Counts Y
Fast Distinct Values N/A
Group By Multiple Fields Y
Group By Time Y
Group By UNIX Time Y
Histogram Floating Point Values Y
Histograms Y
Kerberos Authentication N
Last Value Y
Live Mode and Playback Y
Multivalued Fields N/A
Nested Fields N/A
Partitions N/A
Pushdown Joins for Fusion Data Sources N
Schemas Y
Text Search N/A
TLS N
User Delegation N
Wildcard Filters Y
Wildcard Filters, Case-Insensitive Mode Y
Wildcard Filters, Case-Sensitive Mode N

Connect to Dremio

The Dremio JDBC driver 3.0.6 is used by and included in the Dremio connector. Driver drop-in is supported, so you can replace this JDBC driver if you want. By default, the Dremio connector uses port 8142.

To create a Dremio connector, you must provide three parameters:

  • The JDBC URL in a format supported by Dremio:

     jdbc:dremio:direct=<DREMIO_COORDINATOR>:<JDBC_PORT>[;schema=<OPTIONAL_SCHMEMA>]

    or

    jdbc:dremio:zk=<ZOOKEEPER_QUORUM>:<ZK_PORT>[;schema=<OPTIONAL_SCHEMA>]

  • A valid user name

  • A valid password.

Live Mode and Playback Considerations

Dremio supports reflections instead of indices. For more information about Dremio reflections, see https://docs.dremio.com/acceleration/. Because Dremio does not support indices, Symphony cannot accurately determine which date and number fields are playable, so it treats all date and time fields as playable, by default. Consequently, use livemode and playback judiciously when you are working with large data sets. Switch playback and live mode on only for visuals you know that the corresponding SQL queries are covered by a reflection and can be accelerated.

If you don't use Dremio reflections and are concerned that the default playability of all date and number fields might be misused and impact performance, you can switch this feature off using the connector configuration property: metadata.detection.mark-all-date-and-int-fields-playable. Valid values are true (on) and false (off). The default setting for this property is true.