Introduction to LogZilla's Preprocessing for Splunk

As organizations face increasing pressure on their IT budgets, the need for cost-effective solutions to manage ever-growing data volumes and data retention requirements is more crucial than ever. LogZilla's platform offers a game-changing approach to improving existing Splunk® investments, using its patented deduplication algorithm to filter out unneeded event data before it is sent to Splunk®. This deduplication not only cuts network events sent downstream by 40% to 60%, but also significantly decreases software license costs, hardware costs, and operational costs, resulting in millions of dollars in savings for federal agencies.

When deployed as a preprocessor for Splunk®, LogZilla takes on the role of the "heavy lifter" for all data, filtering out junk data, deduplicating event streams, and adding enriched information. This ensures that Splunk® becomes smarter, faster, and more cost-efficient as a result.

Evaluating Total Cost of Ownership (TCO)

Many organizations fail to consider all the pieces when calculating the TCO for software. Comprehensive research data should include metrics on cost of storage (including storage configuration), datacenter costs, rack costs, power, HVAC, network equipment (e.g., top of rack switches), power distribution units, amortization, property and sales taxes, compute load per rack (kw/h), rack density, cost of hardware, labor costs (including average burdened salaries by employee type), and more.

By calculating the total cost of ownership for Splunk using data verified from multiple sources, a more complete picture of the full cost becomes apparent. This research data includes information gathered over the last two years from various sources and direct verification from hundreds of both LogZilla and Splunk customers.

LogZilla's Deduplication Algorithm: Advantages and Efficiency

LogZilla's platform complements traditional event ingestion products by utilizing a patented deduplication algorithm to filter out unneeded event data before it is sent to downstream event consumers such as Splunk®. Deduplicating the data not only cuts the amount of network events sent downstream by 40% to 60% on average, but also significantly reduces software license costs, hardware costs, and operational costs for those downstream receivers. This in turn decreases the number of renewal requirements, saving on larger IT budgets for future organizational data initiatives.

LogZilla's platform also allows users to mark events as actionable or non-actionable, further decreasing the amount of data needed to be sent to downstream systems. At the same time, the platform can be used to enrich data in real-time from multiple sources of information, enhancing the outgoing events to downstream systems and increasing their knowledge of how a device or system is affected.

LogZilla’s Deduplication Algorithm
LogZilla’s Deduplication Algorithm

Enhancing Data Actionability and Enrichment

With LogZilla's platform, users can mark events as actionable or non-actionable, providing greater control over the data sent to downstream systems like Splunk®. This feature helps reduce unnecessary data transfers, leading to improved efficiency and cost savings. Additionally, LogZilla's platform can enrich data in real-time using information from multiple sources, enhancing outgoing events to downstream systems. This enrichment process empowers downstream systems with a deeper understanding of how devices or systems are affected, making them more effective and efficient.

Return on Investment with LogZilla's Scalable Solution

LogZilla's platform can ingest, enrich, and orchestrate data at an unprecedented scale, processing more than 20TB per day of data on a single server. This highly scalable solution enables LogZilla to act as a pre-processor for other network and security management products, significantly reducing costs associated with the deployment of hundreds or thousands of servers required for traditional event management solutions.

The platform can be deployed in minutes and placed in front of any products requiring telemetry from servers, applications, networks, and security. As the "heavy lifter" for all data, LogZilla filters out junk data, deduplicates event streams, and adds enriched information, ensuring that all downstream consumers become smarter, faster, and more cost-efficient.

Not only do licensing costs decrease, but the dramatic reduction in hardware footprint also makes any competitive solution prohibitively expensive and significantly less efficient or productive.

Reduced Licensing Costs and Hardware Footprint

LogZilla's platform, when used as a pre-processor for Splunk®, greatly reduces both licensing costs and hardware requirements. By deduplicating event data before sending it to downstream systems like Splunk®, the platform helps organizations save on software license costs, hardware costs, and operational costs. The reduction in hardware footprint achieved through LogZilla's solution is particularly important, as it makes competing solutions both more expensive and less efficient.

By adopting LogZilla's platform, organizations can optimize their existing Splunk® investments, ensuring smarter, faster, and more cost-effective data management.

Real-World Use Cases

  1. Insurance: An insurance company implemented LogZilla's platform to preprocess data for its Splunk® environment, reducing data storage costs and improving data analytics performance.
  2. Healthcare: A large hospital used LogZilla's deduplication algorithm to streamline its Splunk® deployment, decreasing operational expenses and increasing data processing speed.
  3. Education: A university employed LogZilla's platform to optimize its Splunk® environment, saving on hardware costs and enhancing data enrichment for more effective data analysis.
  4. Banking: A major bank integrated LogZilla's platform with its Splunk® system, reducing license costs and improving the efficiency of its IT operations.
  5. Retail: A retail chain implemented LogZilla's solution to preprocess data for Splunk®, cutting down on hardware requirements and reducing total cost of ownership.
  6. Agriculture: An agribusiness company leveraged LogZilla's platform to enhance its Splunk® environment, optimizing data management and increasing overall performance.

August 11, 2020

More from the



View All