WhereScape Release 2022 New Features 

by | Mar 10, 2022 | Data, WhereScape

Wherescape December “DevOps” release , this includes new Metadata Ingestion, Model Test Automation workflows, Merge and Compare options, and Performance tweaks PLUS the official launch of Where scape Enablement Packs along with new File Parser Enablement Pack.

Wherescape Enablement Packs

WhereScape Enablement Packs ensure wherescape tools are perfectly configured for whichever platforms we choose whether in the cloud, on-premises or hybrid. Bundling together the latest platform functionality, source connectivity, modeling standards and broader tool integrations, WhereScape Enablement packs contain all the templates and configurations required for WhereScape 3D, WhereScape RED and Data Vault Express to work across all the major platforms. With WhereScape Enablement Packs data engineers, architects, and designers can maximize the use of automation in delivering data platforms and provisioning data assets to consumers.

These packs enable our users to configure their data platform more easily in a way that meets their specific needs while standardizing architecture, automation patterns, and integrations. They provide Data Engineers, Data Architects and Designers with templates to maximize the use of automation in the delivery of data platforms and data assets that their consumers need.

a.     Source Enablement Packs

Connectors for browsing, discovering, and profiling source data for your data platform. WhereScape supports extensible, user-definable connections alongside its built-in connectors, enabling connectivity to any data source that can be accessed via a script (Example script: Python or PowerShell).

List of Source Enablement Packs release
  • Amazon S3
  • Azure Data Lake Storage gen2
  • Azure Blob
  • Google Cloud Storage (GCS)
  • Google Drive
  • File parsers (Parquet/JSON/XML/Avro/ORC/Excel /CSV/TXT)
  • Rest APIs
b.     Target Enablement Packs

Target-specific templates and configurations for generating code for building and populating data models on your data platform.

WhereScape supports building and deploying Data Warehouses on a wide range of target platforms. Using metadata-driven templates for code generation and platform configuration, WhereScape enables you to configure Data Warehouse standards to fit your needs.

Target Enablement Packs contain the configurations required for each target platform – optimizing items such as:

  • DDL code templates – for deploying physical data models
  • Data type conversion rules – for setting data types compatible for your target platform
  • Integration code / ETL templates – for generating data pipeline code for loading data onto your target platform
  • Transformation code / ELT templates – for generating data pipeline code for transforming data already on your target platform
List of Target Enablement Packs
  • Snowflake (download available)
    • Azure Synapse Analytics (download available)
    • SQL Pool
    • Amazon Redshift
    • Hive, PostgreSQL
    • Google BigQuery
    • Exasol
    • SAP HANA Cloud
    • MySQL.
c.     Design Enablement Packs & Utilities

Patterns for modeling styles, development lifecycles, DevOps and integrations with broader toolsets.

WhereScape supports several modeling styles (Data vault and Dimension), each with its own rules, templates, and design patterns.

Design Enablement Packs contain the configurations required to use a given modeling style and any associated development lifecycle patterns. 

Examples include:

  • Operational Data Store (ODS) / Permanent Staging Area (PSA) patterns
  • Data Vault patterns
  • Metadata import rules
  • Model Validation templates 
    • Data Vault PIT table validation
    • Generic physical model validation
  • Third party integrations

What’s New in WhereScape 3D?

Enhanced Discovery and Metadata Import
  • Wherescape  extended the metadata discover and import, improving WhereScape 3D’s ability to integrate with other tools and frameworks. 
    • Users can download a set of WhereScape RED metadata integration rules, bringing full bi-directional support between WhereScape 3D and WhereScape RED. 
    • Custom rules can be defined for ingesting metadata from external sources such as legacy ETL platforms or automation frameworks. This incredibly helpful in ‘lift-and-shift’ projects to move an existing Data Warehouse to a new target.
New Model Validation Templates and Workflow

Automate integrity tests on models as they are generated

  • Users can now validate models on-demand or as part of an automated workflow. This provides the opportunity to run automated checks on models to validate standards and soft rules during model-generation workflows. 
    • Automated validation tests can be executed, for example, when converting a logical/business model into a raw data vault and its staging model. 
    • This ensures that entity and attribute types are correctly set and data sources correctly mapped and ensures that your model conforms to all of your organization-specific rules.

Empowering Developers and Supporting Remote Working

Compare and merge templates and configurations + performance gains

  • The performance improvements allow WhereScape 3D development teams to work together and compare and merge Model Conversion Rules, templates, scripts, and configurations. 
    • This is particularly useful during software upgrades to easily compare changes in new releases with local forks/customer solutions. 
    • As part of our ongoing focus on performance and remote working, we have significantly reduced processing times for Displaying, Refreshing, Copying and Deleting Models

Thank you to WhereScape for these great new features. Posted from WhereScape.