Virtualization Technology News and Information
WekaIO Matrix qualifies to run with Kx kdb+ Database in AWS EC2 with noteworthy latency improvements over EFS

WekaIO, an innovation leader in high-performance, scalable file storage for data intensive applications, announced that Kx, creator of the world's fastest time series database, has qualified WekaIO Matrix storage solution for use with kdb+ in the Amazon Web Services (AWS) Elastic Compute Cloud (EC2) for machine learning applications.

This qualification of Matrix comes after Kx conducted its own rigorous benchmark testing of storage solutions available in AWS EC2 as part of a process for determining their suitability for Kx customers looking to migrate their historical kdb+ database (HDB) to the cloud.

"Kdb+ customers considering a migration of their historical market data into a cloud service provider can expect good data access performance and great service metrics from the solution," said Glenn Wright, Systems Architect at Kx. "Matrix offers kdb+ a combination of good read performance and metadata operational latency, being one or two orders of magnitude better than EFS, Storage Gateway, and all open-source products we tested. Matrix exhibited block-like low operational latencies for some metadata functions and good aggregate throughputs for the small random reads with kdb+. WekaIO Matrix will also be of interest to kdb+ customers wanting to store some of their historical data online but using Amazon S3. Matrix achieves this by presenting kdb+ with a normal file-system access point, internally managing the tiering and access rules for any data moved to the lower-cost S3 solution."

The cloud is the cornerstone of digital transformation and thus the number of companies migrating workloads to the cloud continues to grow rapidly. Databases have however been disadvantaged in this race to the cloud by a lack of storage solutions that can effectively deliver low latency data access similar to what customers have come to expect from their on-premises architectures. WekaIO Matrix is a fully distributed and parallel file system with an optimized network stack that solves these latency issues and delivers the highest performance shared storage solution available in the AWS Cloud. The powerful combination of elastic compute resources, Matrix, and kdb+ software results in a comprehensive solution that can handle the most demanding data and metadata intensive operations common in financial trading and market data analysis.

For more information on Kx 's benchmark testing of WekaIO Matrix and other storage systems, you should read the Kx blog post.

Published Friday, June 29, 2018 7:33 AM by David Marshall
Filed under: , ,
There are no comments for this post.
To post a comment, you must be a registered user. Registration is free and easy! Sign up now!
<June 2018>