Hyperion: Stream Archival for Large Volumes and Retrospective Queries
Keywords:
Hyperion, File System, Index, Security, Network, Analysis.Abstract
Network monitoring systems with data archiving and retrospective queries are beneficial for various applications, including anomaly detection and security forensics. Nonetheless storing data for these kinds of systems is hard because a single link can handle hundreds of thousands of packets of data per second, and this data needs to be searched securely so that queries can be done in the past. At these data speeds, both database indexes and general-purpose file systems function badly.
References
. Desnoyers, P., and Shenoy, P. Hyperion: High Volume Stream Archival for Retrospective Querying. Tech. Rep. TR46-06, University of Massachusetts, Sept. 2006. [2]. Dreger, H., Feldmann, A., Paxson, V., and Sommer, R. Operational experiences with highvolume network intrusion detection. In Proc. 11th ACM Conf. on Computer and communications security (CCS '04) (2004), pp. 2–11.