Cinchy Platform Documentation
Cinchy v5.6
Cinchy v5.6
  • Data Collaboration Overview
  • Release Notes
    • Release Notes
      • 5.0 Release Notes
      • 5.1 Release Notes
      • 5.2 Release Notes
      • 5.3 Release Notes
      • 5.4 Release Notes
      • 5.5 Release Notes
      • 5.6 Release Notes
  • Getting Help
  • Cinchy Glossary
  • Frequently Asked Questions
  • Deployment Guide
    • Deployment Installation Guides
      • Deployment Planning Overview and Checklist
        • Deployment Architecture Overview
          • Kubernetes Deployment Architecture
          • IIS Deployment Architecture
        • Deployment Prerequisites
          • Single Sign-On (SSO) Integration
            • Enabling TLS 1.2
            • Configuring ADFS
            • AD Group Integration
      • Kubernetes Deployment Installation
        • Disabling your Kubernetes Applications
        • Changing your File Storage Configuration
        • Configuring AWS IAM for Connections
        • Using Self-Signed SSL Certs (Kubernetes Deployments)
        • Deploying the CLI (Kubernetes)
      • IIS Deployment Platform Installation
    • Upgrade Guides
      • Upgrading Cinchy Versions
        • Cinchy Upgrade Utility
        • Kubernetes Upgrades
          • v5.1 (Kubernetes)
          • v5.2 (Kubernetes)
          • v5.3 (Kubernetes)
          • v5.4 (Kubernetes)
          • v5.5 (Kubernetes)
          • v5.6 (Kubernetes)
          • Upgrading AWS EKS Kubernetes Version
          • Updating the Kubernetes Image Registry
          • Upgrading AKS (Azure Kubernetes Service)
        • IIS Upgrades
          • v4.21 (IIS)
          • v4.x to v5.x (IIS)
          • v5.1 (IIS)
          • v5.2 (IIS)
          • v5.3 (IIS)
          • v5.4 (IIS)
          • v5.5 (IIS)
          • v5.6 (IIS)
      • Upgrading from v4 to v5
  • Guides for Using Cinchy
    • User Guides
      • Overview of the Data Browser
      • The Admin Panel
      • User Preferences
        • Personal Access Tokens
      • Table Features
      • Data Management
      • Queries
      • Version Management
        • Versioning Best Practices
      • Commentary
    • Builder Guides
      • Best Practices
      • Creating Tables
        • Attaching Files
        • Columns
        • Data Controls
          • Data Entitlements and Access Controls
          • Data Erasure
          • Data Compression
        • Formatting Rules
        • Indexing and Partitioning
        • Linking Data
        • Table and Column GUIDs
        • System Tables
      • Deleting Tables
        • Restoring Tables, Columns, and Rows
      • Saved Queries
      • CinchyDXD Utility
        • Building the Data Experience (CinchyDXD)
        • Packaging the Data Experience (CinchyDXD)
        • Installing the Data Experience (CinchyDXD)
        • Updating the Data Experience (CinchyDXD)
        • Repackaging the Data Experience (CinchyDXD)
        • Reinstalling the Data Experience (CinchyDXD)
      • Multi-Lingual Support
      • Integration Guides
    • Administrator Guide
    • Additional Guides
      • Monitoring and Logging on Kubernetes
        • Grafana
        • Opensearch Dashboards
          • Setting up Alerts
        • Monitoring via ArgoCD
      • Maintenance
      • System Properties
      • Enable Data At Rest Encryption
      • MDQE
      • Application Experiences
        • Network Map
          • Custom Node Results
          • Custom Results in the Network Map
        • Setting Up Experiences
  • API Guide
    • API Overview
      • API Authentication
      • API Saved Queries
      • ExecuteCQL
      • Webhook Ingestion
  • CQL
    • The Basics of CQL
      • CQL Examples
      • CQL Functions Master List
      • CQL Statements Overview
        • Cinchy DML Statements
        • Cinchy DDL Statements
      • Cinchy Supported Functions
        • Cinchy Functions
        • Cinchy System Values
        • Cinchy User Defined Functions
          • Table-Valued Functions
          • Scalar-Valued Functions
        • Conversion Functions
        • Date and Time Types and Functions
          • Return System Date and Time Values
          • Return Date and Time Parts
          • Return Date and Time Values From Their Parts
          • Return Date and Time Difference Values
          • Modify Date and Time Values
          • Validate Date and Time Values
        • Logical Functions
        • Mathematical Functions
        • String Functions
        • Geometry and Geography Data Type and Functions
          • OGC Methods on Geometry & Geography Instances
          • Extended Methods on Geometry & Geography Instances
        • Full Text Search Functions
        • Connections Functions
        • JSON Functions
  • Meta Forms
    • Introduction to Meta-Forms
    • Meta-Forms Deployment Installation Guide
      • Deploying Meta-Forms (Kubernetes)
      • Deploying Meta-Forms (IIS)
    • Forms Data Types
    • Meta-Forms Builders Guides
      • Creating a Dynamic Meta-Form (Using Tables)
      • Creating a Dynamic Meta-Form Example (Using Form Designer)
      • Adding Links to a Form
      • Rich Text Editing in Forms
  • Data Syncs
    • Getting Started with Data Syncs
    • Installation & Maintenance
      • Prerequisites
      • Installing Connections
      • Installing the Worker/Listener
      • Installing the CLI and the Maintenance CLI
    • Building Data Syncs
      • Types of Data Syncs
      • Common Design Patterns
      • Sync Behaviour
      • Columns and Mappings
        • Calculated Column Examples
      • Listener Configuration
      • Advanced Settings
        • Filters
        • Parameters
        • Auth Requests
        • Request Headers
        • Post Sync Scripts
        • Pagination
      • Batch Data Sync Example
      • Real-Time Sync Example
      • Scheduling a Data Sync
      • Connection Functions
    • CLI Commands List
    • Error Logging and Troubleshooting
    • Supported Data Sync Sources
      • Cinchy Event Broker/CDC
        • Cinchy Event Broker/CDC XML Config Example
      • Cinchy Table
        • Cinchy Table XML Config Example
      • Cinchy Query
        • Cinchy Query XML Config Example
      • Copper
      • DB2 (Query and Table)
      • Dynamics 2015
      • Dynamics
      • DynamoDB
      • File Based Sources
        • Binary File
        • Delimited File
        • Excel
        • Fixed Width File
        • Parquet
      • Kafka Topic
        • Kafka Topic Example Config
        • Apache AVRO Data Format
      • LDAP
      • MongoDB Collection
        • MongoDB Collection Source Example
      • MongoDB Collection (Cinchy Event Triggered)
      • MS SQL Server (Query and Table)
      • ODBC Query
      • Oracle (Query and Table)
      • Polling Event
        • Polling Event Example Config
      • REST API
      • REST API (Cinchy Event Triggered)
      • SAP SuccessFactors
      • Salesforce Object (Bulk API)
      • Salesforce Platform Event
      • Salesforce Push Topic
      • Snowflake
        • Snowflake Source Example Config
      • SOAP 1.2 Web Service
    • Supported Data Sync Destinations
      • Cinchy Table
      • DB2 Table
      • Dynamics
      • Kafka Topic
      • MongoDB Collection
      • MS SQL Server Table
      • Oracle Table
      • REST API
      • Salesforce Object
      • Snowflake Table
      • SOAP 1.2 Web Service
    • Supported Real-Time Sync Stream Sources
      • Cinchy Event Broker/CDC
      • Data Polling
      • Kafka Topic
      • MongoDB
      • Salesforce Push Topic
      • Salesforce Platform Event
  • Other Resources
    • Angular SDK
    • JavaScript SQK
Powered by GitBook
On this page
  • 1. Overview
  • 2. Prerequisites
  • 3. Installing MDQE
  • 4. Creating MDQE Rules
  • 5. Viewing All Exceptions
  • 6. Debugging
  • 7. Scheduling MDQE Jobs

Was this helpful?

Export as PDF
  1. Guides for Using Cinchy
  2. Additional Guides

MDQE

This page guides you through the overview, installation, and use of Cinchy's MDQE function.

PreviousEnable Data At Rest EncryptionNextApplication Experiences

Last updated 2 years ago

Was this helpful?

1. Overview

MDQE, which stands for Metadata Quality Exceptions, can send out notifications based on a set of rules and the “exceptions” that break them. This powerful tool can be used to send notifications for exceptions such as:

  • Healthchecks returning a critical status

  • Upcoming Project Due Dates/Timelines

  • Client Risk Ratings reaching a high threshold

  • Tracking Ticket Urgency or Status markers

  • Unfulfilled and Pending Tasks/Deliverables

  • Etc.

In a nutshell, MDQE monitors for specific changes in data, and then pushes out notifications when that change occurs.

2. Prerequisites

  • You will need to have the

  • Request the installation package from the

3. Installing MDQE

To install MDQE in your Cinchy environment, follow the below steps:

  1. Download the MDQE Installation package.

  2. Unzip the file.

  3. Open an instance of Powershell as an Administrator and navigate to the path where you extracted the MDQE package in step 2 > Metadata Quality Exceptions V.x > Metadata Quality Exceptions.

  4. Run the following command to install all MDQE components in your environment, using the table below as a parameter guide.

.\CinchyDXD.ps1 install `
-s "url.com/Cinchy" `
-sso "url.com/CinchySSO" `
-u "CinchyDQE" `
-p "cinchy" `
-c "C:\Cinchy CLI\Cinchy CLI v4.12.0.564" `
-d "C:\Cinchy CLI\Cinchy CLI Error Logs" `
-y
Parameter
Description

-s

The base URL of your Cinchy instance, without the protocol.

-sso

The base URL of your Cinchy SSO, without the protocol.

-u

Username. We recommend creating a new, specific user for this install. Example: CinchyDQE

-p

The password for the user designated above.

-c

This refers to the path where you have your CLI installed.

-d

This refers to a temporary path for storing error logs.

-h

This flag must be added for environments set up with https.

5. Within the MDQE file package, navigate to the Powershell - DQE Orchestration folder.

6. Extract the contents.

7. Navigate to the _config.json file and update the parameter values using the below as a guide. Make sure to save when finished.

Parameter
Description

CinchyServerProtocol

Defaulted to HTTPS

CinchyServer

The base URL of your Cinchy instance. Example: Cinchy.net

CinchyServerSSO

The base URL of your Cinchy SSO. Example: Cinchy.net/SSO

APIClientSecret

You can find this value in the Integrated Clients table > mdqe row > Guid column in your Cinchy instance.

CinchyCLIPath

The path to your CLI. Example: C:\Cinchy CLI\Cinchy CLI v4.12.0.564

CinchyCLITempPath

The path for storing error logs. Example: C:\Cinchy CLI\Cinchy CLI Error

MailServer

The server that will be sending out your email notifications. Example: smtp.office365.com.

MailPort

The port number for your chosen email server. Example: 25.

MailFrom

The email account that notifications will come from. Example: MDQEnotifications@outlook.com

Mail Subject

A subject line for outbound emails. Example: Data Quality Exception found.

MailUser

The username for the email address above. This may be the same as the address itself. Example: MDQEnotifications@outlook.com

MailPswd

The password for the email account above.

4. Creating MDQE Rules

  1. In the environment where you installed MDQE, search for and open the [Cinchy MDQE].[Rules] table.

  2. Using the “Create Rule” view and the following data, create your Rule:

Column
Description

Name

The name of your rule. This must be unique across the rules.

Example: Project Timeline Start Date Exception

Table

Table: The table on which the exception scenario needs to be evaluated Example: Projects

Table Columns

The columns in the table that should be highlighted in the case of an exception Example: Start Date

Signature

The CQL for your exception condition. Example: [Start Date] is null

Description

A description of the rule. Example: This exception will trigger if the start date of a project is left blank.

User Assignment

This is the owner of the exception. You will use this when you want to assign the rule to a Cinchy user. Example: John Smith

Severity

Choose from the drop down list. Example: Low Note : In case you would like to define your own severity, use [Cinchy MDQE].[Severity] table. You would need admin privileges to view this table

Send Notifications

Choose from the drop down list. Use “Never” if you do not want email notifications sent out. Example: Daily Note : In case you would like to define your own Notification frequency, use [Cinchy MDQE].[Notification schedule] table.You would need admin privileges to view this table

Use the “Invalid Rules” view to correct Rules with have syntax errors

5. Viewing All Exceptions

All exceptions can be viewed in the [Cinchy MDQE].[Data Quality Exceptions] table

  • The Default view only displays exceptions assigned to the currently logged in user.

  • The All Data view displays all exceptions. This is only visible with admin privileges.

6. Debugging

Ways to debug your rules:

  • If your Powershell scripts aren't running: Run the script files in the Powershell - DQE Orchestration folder using an IDE to make sure that all the configurations are correct.

  • Check to see if your bugged Rule is part of the “Invalid Rules” view.

  • If you have admin privileges, check to see if an equivalent SQL statement has been created in the [Rules CQL] table.

  • Check if there is a row for the Rule’s Signature value in the [Cinchy].[Formatting Rules] table.

7. Scheduling MDQE Jobs

You can use the Windows Task Scheduler to run MDQE jobs at regular intervals.

  1. Navigate to your MDQE installation package > Windows Task Scheduler Jobs folder.

  2. Import the files into the Windows Task Scheduler, updating the parameters accordingly.

Cinchy CLI installed.
Cinchy Support team.