There has to be a better way

Derek Harris

Subscribe to Derek Harris: eMailAlertsEmail Alerts
Get Derek Harris: homepageHomepage mobileMobile rssRSS facebookFacebook twitterTwitter linkedinLinkedIn


Related Topics: Virtualization Magazine, Desktop Virtualization Journal, IT News & Views

IT News: Blog Post

Advanced Data Virtualization for Data Integration

A leap forward in power and capability

Advanced data virtualization provides a large leap forward in power and capability. The basis of advanced data virtualization is a persistent metadata directory - technically, most are a persistent metadata server with additional workflow for harmonization, security and data management. Advanced data virtualization only stores metadata about the data structures in the internal structures and turns everything into an object model - most other systems are limited by the internal limitation of working with SQL. Even relational data is represented with an object oriented view. This greatly enhances application and data integration and ongoing data management and lets you work with the power of objects.

Central to the notion of a server is a 1:Many (hub and spoke) connection and the notion of globalization - there is one element of truth. This is a big differentiator verses EII tools, basic data virtualization tools and such that focus on moving data back and forth continually in batched or semi-batched cycles. They are single application pipes, just like ETL. A persistent metadata server is a core piece of software infrastructure and it supports the integration of all sources for multiple applications, multiple projects, many sets of business rules and the associated transforms to make it all work. Virtualize once and use many.

In the area of security a persistent metadata server can provide very strong support for security. Basic data virtualization only secures the pipe but pretty much does no more. Advanced data virtualization systems provide complete application security pass-thru at the user and group levels. Some vendors, including us, also provide a new level of security which allows you deploy new entities (global entities) with the security you need. This level of security may be important for BI implementations where new views of the same data produce important and strategic information you might want to protect differently. For example, we have an Application Software BladeTM for LDAP that allows you to leverage the corporation's data security model the way it was intended.

Queplix brings automated Data Harmonization that can help ensure that your data is correct across all of the many systems deployed. This is quite configurable. As you add applications and reach full vision you are solving the problems of data management easily, at low cost, with low risk and at small fraction of the cost of a "boil the ocean" master data management implementation. This allows the alignment of critical customer, product and financial data. Queplix can also integrate third-party data sources for data quality.

Finally, advanced data virtualization brings together a level playing field for relational, object, XML applications and more. It is designed, from the ground up, to work in all of these worlds. Even Hadoop. We're looking forward, not backward. Salesforce doesn't use a relational database! Most of the cloud isn't relational. Advanced data virtualization brings all of this together with configuration (not coding) and a business level formula builder to do transforms. All the string functions, math functions, boolean, fuzzy logic - but simply, with more powerful capability and all without the use of SQL. Normalization. Everything. But Absolutely NO SQL. Nada, Zero, Zip~! A remarkable statement on a remarkable platform designed for the object world. A system a business user can handle.

Advanced data virtualization handles every class of problem ETL, EII and basic data virtualization can handle. But it can do so much more and all of it with considerably less effort. And hence the return on investment is much higher. The technological advantage is remarkable. All assembled on the basic principles of basic data virtualization. We'll talk more about all of this. I'll share specific use cases.

Author: Queplix CMO Michael Zuckerman

More Stories By Derek Harris

Derek Harris Sr. is a senior technology writer and blogger with more than 20 years experience in journalism.

While covering a broad spectrum of technology segments, his focus is weighted on enterprise technologies in the data storage, security and infrastructure spaces.