Humio sets the standard for data ingestion by reaching a
benchmark of over one petabyte of data ingestion per day. At this rate of
unprecedented data intake, Humio gives DevOps, ITOps and SecOps teams the
ability to get insights from their IT infrastructure through real-time
visibility of their log data at massive scale.
In 2019, Humio was the first log
management solution to reach a benchmark of 100TB per day of data. That test
used 25 nodes with 64 cores each, running 2.1 million events per second.
Recently, the Humio engineering team completed a one petabyte benchmark on 45
nodes with 96 cores each running 30 million events per second and delivering
search results with sub-second latency through Humio's index-free architecture.
This is a 10x increase in data ingestion running on just 2.7x of the processing
nodes.
Humio's industry-leading total cost of
ownership is based on the ability to remove the limitations present in legacy
logging solutions, bringing unlimited ingest, reduced infrastructure costs, and
lower operational costs. Even as they increase the amount of log data being
added to Humio, customers have routinely found:
- Infrastructure cost is one-fifth
(saving 80% or more) of the cost of legacy log management vendors.
- Operational cost is one-fourth (saving
75% or more) of the cost of legacy log management vendors.
Organizations increasingly need
improved observability to enable faster response to events that affect customer
experiences, supply chains and IT security. These efforts require a focus on
reducing system outages, protecting the organization from vulnerabilities and
ensuring optimal performance across their infrastructure. At the foundation of
these efforts is data about the performance and health of IT systems. Humio
allows users to ingest all types of data with 100% fidelity from source to
target.
"The challenges facing DevOps, ITOps
and SecOps teams are only growing with the speed and scale of log data
increasing each day - and with data arriving from a complex array of systems
and applications," said Michael Sentonas, chief technology officer at
Crowdstrike. "Data is growing at a rate faster than anyone can budget for or
ingest, but it is critical for businesses to be able to consume log data to
improve observability across the enterprise to solve critical IT, workloads,
compliance and security needs. We are excited to show our customers and the
industry the power of Humio's modern platform and how it improves observability
across enterprises at any scale and all budgets."
Statista.com estimates that the amount of data will
more than double over the next four years. The Humio petabyte benchmark
anticipates this growth, allowing IT to add high-volume log sources within a
unified data fabric. As the first log management company to provide an
unlimited license for data ingestion in 2018, Humio users pay a fixed rate for
license fees without worrying about going over budget or upgrading their
license. Scaling up comes with minimal added cost.
As a disruptive log management
platform, Humio enables complete observability to answer any question, explore
threats and vulnerabilities, and gain valuable insights from all logs in real
time. With this combination of massive scale and sub-second search
capabilities, Humio provides a faster, more cost effective way to quickly and
effectively deliver insights with a platform designed for ease of operations
and stability at any scale.
"Unlike legacy log management systems,
Humio doesn't require organizations to deduplicate data as they increase data
ingestion volumes nor do they have to make cost-based concessions on log files
to include in the system," said William McKnight of GigaOm. "With a one
petabyte per day load rate, a user base can search over 1PB of data each day
and get answers with sub-second latency, all while reducing the number of
servers required to store, process and search the data."
Acquired in early 2021, Humio has become a key technical
differentiator for CrowdStrike underpinning both its expansion into the log
management market as well as CrowdStrike's XDR strategy and new XDR offering,
Falcon XDR.
To learn how Humio achieved these
results in the benchmark, download the
white paper.