Using Spilled
About Spilled
Spilled helps teams investigate network behavior from flow telemetry (Netflow/IPFIX/sFlow). It collects flow records, enriches them with contextual data before storing them in your cloud object storage. Spilled provides a web interface for exploring your data and answering questions of your network. It is designed for the moments when you need to explore: why traffic changed, which hosts were involved, where bytes moved and whether a pattern is normal or suspicious.
The core tenets
Spilled's superpowers are in its design.
Data sovereignty
Raw telemetry data never leaves your cloud or on prem compute. That makes it suitable for anyone who has to keep data on site (or within their VPC in a public cloud) for regulation purposes, security guarantees or otherwise.
Cost efficiency
Spilled is built on top of object storage (e.g AWS S3) instead of traditional cloud disks (e.g AWS EBS or Google Cloud Persistent Disks). For production grade systems this is materially cheaper as storage costs are ~4x less per GB while also removing the need to run HA setups (e.g a 3 node cluster), cutting costs further by up to ~8-12x per GB. Keeping to the practice of ~80% utilization of your disks, it becomes ~15x cheaper per GB. At scale, this means that Spilled can store terabytes of data for a fraction of the cost of traditional solutions.
Highly scalable
Spilled separates compute from storage so each can scale independently. Stateless compute nodes can be added or removed as workloads change while object storage accommodates growing data volumes without requiring a larger compute cluster.
Easy to operate
For customers who manage custom solutions themselves, Spilled provides a much simpler operational experience. Just deploy a set of instances and you're good to go while still keeping your sovereignty needs.
Visualise everything
Spilled provides a platform that allows you to explore, query and visualise your flow data. Over time, we plan to support a number of visualisations that help you gain insights into your networks.