Skip to content

Creating a Query

A Query is a request for specific data, executed through commands such as SQL statements, which enables the manipulation of data with Integrated Data Lake. Each time a Query is created, an associated job is automatically generated. For more information on jobs, refer File Ingestion Jobs or Query execution jobs.

Note

To perform SQL-like operations, Data Contextualization makes use of the spark.sql module.

Query details

The following types of Queries are supported:

  • Physical Query: The Query created using schemas and its properties present in registry is called a physical Query. The user is allowed to form a valid SQL statement using schema and its properties.

  • Business Query: The Query created using classes and its properties present in ontology is called a business Query. The user is allowed to form a valid SQL statement using class or classes and its properties. Business Queries use the underlying mappings provided in the semantic models to Query data from multiple sources of data.

Queries (both physical and business) in Data Contextualization can be Static or Dynamic in type.

  • Static Query: A Static Query contains parameters of which the value of parameters are defined at the time of creation. The value of any parameter cannot be modified at the time of execution.

  • Dynamic Query: A Dynamic Query contains parameters of which value can provided at the time of execution for column names in the selected clause. Dynamic queries help users to create multiple execution requests on a single Query.

For more information on Queries, refer Creating Native SQL based query.

Procedure

To create a Query, follow these steps:

  1. From the left navigation, click "Queries" and then click "Create Query".
  2. Select the Query type.
  3. Enter the general details and SQL Statement.
  4. Enable the toggle option option to select Dynamic Query, otherwise Static Query is used by default.
  5. Click "Confirm".

Create Query

Result

A Query is successfully created.

Query result


Last update: January 22, 2024