Page Comparison

On-premise database replication facilitates direct queries and reports run against the replicated (on-premise) database, to feed BI and data warehouse solutions, or other in-house systems. The replication processes can be labor intensive and unreliable for large data sets, and the client must continue to modify their reporting and data transformation processes when the source VIP Veson IMOS Platform database schema changes.

Data Lake solves this issue in two ways. First, Data Lake transforms the Veson IMOS Platform database extracts into Report Designer format prior to making the extracts available to clients, which makes them immune to schema changes. Second, the extracts are sent to the client on a daily or hourly basis, making database replication unnecessary.

Replication is also used traditionally for business continuity, for times when one data center is not available, clients can continue to access data in a replica. Amazon Web Services (AWS) provides redundancy that removes the likelihood of a single point of failure in any part of the Veson IMOS Platform stack (storage, compute, networking), so traditional on-premise replication for business continuity and disaster recovery is not necessary.

Backup and restore operations are typically undertaken in response to the corruption or loss of a server, or to archive the database data at regular intervals for analysis and/or compliance requirements.

Data Lake provides similar functionality by extracting VIP the Veson IMOS Platform database tables on a daily or hourly basis and making them available to clients to import into their reporting, BI, or data warehouse solution. AWS provides the redundancy that removes the likelihood of a single point of failure in any part of the Veson IMOS Platform stack (storage, compute, networking), rendering backup and restore for data recovery unnecessary.

The extracted files represent the state of the client’s VIP Veson IMOS Platform operational database at the point of extraction. The client is responsible for adapting the data in the destination system to account for changes between extract file versions.

If the client is concerned about data change frequency, they are likely a better fit for the hourly update model.

The existing Data Warehouse Connector license enables a client to connect Report Designer report output to an external BI or analytics system. Technically, it is an API connector, whereas the Data Lake is a set of files extracted from all the information in the client’s VIP Veson IMOS Platform operational database. Therefore, the scope and scale of the Data Lake are vastly larger than the Data Warehouse Connector.