Semantic Data Interconnect (SDI) Semantic Modelling Service¶
Semantic Data Interconnect (SDI) Semantic Modelling Service provides end-to-end capability to import/create, update or delete entire ontological/Semantic model.
It provides set of APIs that allow you to perform different actions on nodes and edges. It uses graph database technology to store entity relationships that are provided by users.
Application Users can access the REST APIs using REST Client. To access Semantic service APIs, you require role/access of SDI admin, SDI semantic user or technical user.
For accessing this service, you need to have the respective roles listed in SDI roles and scopes.
Access to SDI Semantic Modelling Service APIs are protected by MindSphere authentication methods, using OAUTH credentials.
A graph can only two types of entities, Nodes and Edges. SDI has defined different types of nodes (knowledge points) and edges (relationships) which helps users to create a semantic model as per their domains. SDI provides some basic types of nodes and edges called global system node types. Global nodes and edges conform to Owl (Ontology web language) standard. SDI semantic model consists of namespaces, classes, schemas, class properties and schema properties, mappings between class properties and schema properties and property relations between properties of different classes.
List of global type of nodes and edges is as listed below:
Namespace: Namespace is related to a specific domain. It is highest in hierarchy in ontology/semantic model created in SDI. Semantic models are identified by namespace and ontology ID in SDI.
Class: Class denotes a business entity. There can be multiple classes associated to a single namespace. A class node consists of name and description. There cannot be 2 classes of same name within a namespace.
Property: Property/attribute is related to business class or schema. There are of two types of properties, class property and schema property. Every schema/class may have multiple properties associated with it.
Schema: Schema represents physical schema table or logical group header.
Mapping: Mapping represents an edge or relation between business property with one or more schema properties. It can be of functional mappings or key mapping type. Key mapping is the direct mapping between the class property and one or more schema properties. Functional mapping represents a class property as an entity that is calculated based on some arithmetic operation on one or more schema columns.
In case of one-to-many key mappings, the SDI system creates an Auto INNER join between different mapped schema properties. This is done in order to find the similarity between different diverse schemas.
Propertyof: Propertyof is an edge or relation between a business class with one or more class properties. Similar relationship also exists between schema and schema properties.
PropertyRelations: PropertyRelations is an edge or relation between one class property with one or more class properties. There can be one-to-one or one-to-many property relations types.
Scope: Scope is an edge or relation between namespace and class. It is defined by default when any class is created within a namespace.
The example below explains the mapping types:
- Consider a semantic model that consists of two schemas Items and Occurrences.
- The defined columns for Items schema: itemId, itemName and force, and for Occurrences schema: itemId and position.
- The model also has a class ‘Part’ with properties partNumber, torque and itemName.
- Class property partNumber has a keyMapping with itemId column of both the schemas. Class property torque is calculated as the multiplication of force and position columns of ‘Items’ and ‘Occurrences’ schemas respectively.
- Torque property has a functional mapping with force and position columns with mapping function as product (multiplication).
SDI provides CRUD (Create, Read, Update, Delete) functionalities for entire ontologies (consisting of
mappings, etc) corresponding to a
namespace. If a user has already defined ontologies, it can be saved with ontology jobs.
Users can also optionally import an existing ontological model supported with Web Ontology Language (Owl) file format extensions.
The following are APIs provided as a part of SDI semantic APIs:
- API to upload Ontology Jobs and retrieve API to get current status of Ontology Jobs. Users can create or update ontologies in JSON or Owl specified formats.
- API to retrieve status of Ontology Jobs
- API to retrieve or delete ontology based on ontology ID.
- API to infer semantic models based on selected schemas.
- API to retrieve list of ontologies in a tenant.
The following approaches can be used to create a semantic model in SDI:
Import/Create Semantic Model: When the Data Analyst/semantic modeler has created a Semantic model, SDI provides the ability to optionally import the Semantic model as a starting point. SDI supports Owl or JSON file format to import Semantic model. It can be accessed by REST API with POST method to upload ontology Jobs.
Infer Semantic Model: SDI leverages extracted schema to infer correlation of data from multiple systems and provides a recommended Semantic model. User can provide a list of schemas to create Semantic model and the Infer Semantic Model API will provide inferred Semantic model. These inferred models can be retrieved based on namespace provided by user during inference of model. This ability to infer the Semantic model reduces the investment in skillset, time and resources needed by significant amount and provides an extremely value-added starting point for the Data Analyst. It can be accessed by REST API with POST method to Infer Semantic models.
- SDI currently supports Owl file format generated from open source tool web protégé. For details to form Owl file supported by SDI refer How to create semantic models.
- Currently, SDI semantic service supports querying with key mapping type. Semantic queries involving namespace with functional mapping is not supported.
- The SDI does not allow special character such as * within attribute or class name.
- Maximum concurrent request for SDI is restricted to 30 for each tenant.
- Maximum Semantic models that can be stored in SDI is 100 for each tenant.
- Maximum size of each Semantic model can comprise of 500 classes, 2000 properties, 1000 mappings, 1000 property relations.
An enterprise has data from PLM, ERP, CRM and HRM systems. To understand and maintain relationships between various attributes, enterprise can use Semantic Services by SDI and create a unified data model view on SDI. Various semantic queries can be built once mapping between business attributes and physical schemas is completed. SDI Semantic services will manage all the relationships, mappings and business properties for all schema properties. Finally, Semantic queries created will be associated with queryid. This queryid can directly be queried with GET query results API method. SDI will internally pick up mapping done in semantic model and provide queried results for semantic/business values.
- SDI Data Query
- SDI Data Management
- Creating dashboard apps with SDI
- Creating Query using SDI
- How to create Native SQL query
- How to create JSON based query
- How to create executionJobs for dynamic query
- Creating Semantic Models using SDI APIs
- Integrated Data Lake Service
Any questions left?
Except where otherwise noted, content on this site is licensed under the MindSphere Development License Agreement.