Platform

Delphix Platform May 2023 Product Updates

The Delphix Platform's top new functionalities include expanded data discovery, Oracle table space subsetting, and improved Data Control Tower developer experience.

Clint Sprauve

May 31, 2023

Welcome to the Delphix May 2023 product updates! We're excited to share the new offerings, features, and functionality changes introduced this month. Starting now, we'll send you a consolidated view of these updates at the end of each month. Let's dive into the exciting changes for May!

Three Key Highlights

Here are the top three functionalities introduced in May:

Expanded Data Discovery 

Continuous Compliance now offers expanded data discovery capabilities. It can automatically discover banking numbers and US Driver's Licenses, making it easier for organizations to adhere to regulatory requirements and ensure compliance.

Oracle Table Space Subsetting 

The Oracle Staging Push Continuous Data connector has been enhanced to allow users to drop table spaces. This enables you to limit the data delivered to downstream users, providing greater control and flexibility in managing your data.

DCT Developer Experience 

Data Control Tower (DCT) is the new and improved version of Delphix Self-Service. It offers a unified experience across a modern user interface, APIs, and DevOps integrations. With DCT, developers can quickly provision, refresh, and teardown-compliant data from any connected Continuous Data Engine.

Now, let's take a closer look at the updates and new features introduced in each product:

Data Control Tower (DCT)

  • Provision VDB User Interface: DCT now offers a UI-based wizard that simplifies the self-service provisioning of virtual databases across any connected Delphix engine. This feature makes it even easier to control ephemeral data within your organization. Note that this release currently supports Oracle Single Tenant databases, with additional sources coming soon.

  • Refresh VDB User Interface: DCT expands the concept of Refresh by introducing a user-friendly UI for common VDB operations. You can now perform operations such as Refresh to Parent (normal refresh), Self-refresh (rewind/rollback), Refresh to Relative (related VDB) and Refresh to Bookmark directly from the UI.

  • VDB Template Import: Centralize your VDB templates in DCT by importing them and removing them from connected engines, streamlining template management.

  • Infrastructure Connection Management: Managing database infrastructure is now easier with DCT. You can view, create, and edit configurations such as OS, IP Address, and authentication type directly from the UI. Existing environments are sourced from connected Continuous Data Engines, and you can perform operations like enable, disable, refresh, edit, and delete. A new Infrastructure wizard allows you to quickly and consistently add UNIX environments from the UI.

  • ServiceNow Integration: Our ServiceNow integration supports the "Utah" version and offers non-user-identifying telemetry monitoring through the DCT API Usage Report. Once "Utah" is fully released, ServiceNow is expected to deprecate San Diego support, and we will do the same. For more details, please refer to the ServiceNow KB article.

  • Terraform Integration: Terraform integration has been enhanced with improved monitoring capabilities for DCT objects. It provides provisioning support for PostgreSQL, SAP HANA, Oracle Real Applications Clusters (RAC), and Oracle with Transparent Data Encryption (TDE).

Continuous Compliance

  • IBAN Discovery and Masking: Continuous Compliance now supports the automatic discovery and masking of International Bank Account Numbers, ensuring the security of sensitive financial data.

  • New US Driver's License Classifier: Automatic discovery and masking of US Driver's Licenses are now supported by Continuous Compliance.

  • Oracle Source Sizing: This feature measures the size of connected Oracle databases. You can access this information through a new utilization PDF report or the GET /billing-usage API.

  • New Features for the Postgres Connector: The Postgres connector now provides more automated control of indexes, constraints, and triggers. You can choose these features and automatically upgrade them as needed.

  • User-controlled Automated Sensitive Data Discovery (ASDD) Set Upgrade

Starting with the 11.0 release, we are shipping the standard ASDD discovery set independent of Continuous Compliance. You can use a new API endpoint to control when to adopt new ASDD discovery sets. This allows you to upgrade to more recent software releases without impacting existing workflows and create and distribute your own classifier sets.

IBAN Discovery and Masking

Hyperscale Compliance

  • Performance and Usability Improvements: Hyperscale Compliance introduces several essential enhancements. These include better status reporting on the post-load phase, improved processing of Microsoft SQL Server tables without a primary or unique key, more efficient index handling (drop and recreate), and the ability to cancel post-load operations.

  • Hyperscale Compliance Kubernetes Support: Hyperscale now supports running in Kubernetes and Docker Compose, providing more deployment options.

Continuous Data

  • Staging Push Read-only Oracle Databases: Continuous Data now supports staging-push ingestion from read-only Oracle databases.

  • Partial Ingestion via Oracle Staging Push: This new feature allows you to selectively ingest specific Oracle tablespaces to subset your Oracle database and choose only the relevant data.

  • MongoDB: Continuous Data now supports MongoDB Enterprise 6.0 and Mongo Atlas, including cluster-to-cluster sync, enabling the ingestion of large, sharded databases.

  • MySQL/Linux: MySQL v8 is now supported across all certified editions in Continuous Data.

  • PostgreSQL: Point-in-time (PIT) provisioning is now possible using external logs, and ingestion is supported using the "pg_dumpall" utility in Continuous Data.

Compliance Services for Salesforce

  • Large Table Masking: Delphix Compliance Services now supports masking large Salesforce Objects, even those with more than 70 million records. Optimized API selection and driver configurations prevent read and update timeouts commonly associated with large Salesforce objects.

  • Configurable Metadata Components: As part of masking, you can select which metadata components to disable, allowing customization of your sandbox metadata while masking.

  • Custom Filters: Salesforce Object Query Language (SOQL) filters can now be added to masking jobs, enabling the partitioning of large tables into smaller masking jobs. Instead of reseeding data when masking fails, custom filters can specifically mask any failed records.

May Product Version Releases

Here are the software products that were shipped in May, along with their release dates:

  • MongoDB Connector 1.2.0 (April 28, 2023)

  • DCT ServiceNow Spoke 4.1.0 (May 5, 2023) (available on the ServiceNow Marketplace)

  • Hyperscale Compliance 8 (May 8, 2023)

  • Data Control Tower 7 (May 9, 2023)

  • MySQL/Linux Connector 4 (May 18, 2023)

  • PostgreSQL Connector 4 (May 24, 2023)

  • Continuous Data 11 (May 25, 2023)

  • Continuous Compliance 11 (May 25, 2023)

  • Hyperscale Compliance 9 (May 30, 2023)

  • DCT Terraform Provider 2.0.0 (May 31, 2023) (hosted by Terraform)

End of Life and Deprecations

Support for ESXi 6.0 has reached its end-of-life for both Continuous Data and Continuous Compliance. It is recommended to upgrade to the latest version to ensure ongoing support and compatibility.

That wraps up our May update, highlighting the new offerings, features, and functionality changes. We hope these updates continue to increase efficiency, control, and compliance with your data management processes. Stay tuned for more exciting developments in the coming months!

Please contact our support team if you have any questions or need assistance.

Thank you for choosing Delphix Data Platform!

*Disclaimer: The information provided in this blog post is based on the Delphix Data Platform as of May 2023. Please refer to the official documentation and release notes for the most up-to-date information.