zeek2es.py
This Python application translates Zeek's ASCII TSV and JSON logs into ElasticSearch's bulk load JSON format. Table of Contents: Introduction Installation Elastic v8.0+ Docker Upgrading zeek2es ES Ingest Pipeline Filtering Data Python Filters Filter on Keys Command Line Examples Command Line Options Requirements Notes Humio JSON Log Input Data Streams Helper Scripts Cython Introduction Want to see multiple Zeek logs for the same connection ID (uid) or file ID (fuid)? Here are the hits from files.log, http.log, and conn.log for a single uid: You can perform subnet searching on Zeek's 'addr' type: You can create time series graphs, such as this NTP and HTTP graph: IP Addresses can be Geolocated with the -g command line option: Aggregations are simple and quick: This application will 'just work' when Zeek log formats change. The logic reads the field names and associated types to set up the mappings correctly in ElasticSearch. This application will recognize gzip or uncompressed logs. This application assumes you have ElasticSearch set up on your localhost at the default port. If you do not have ElasticSearch you can output the JSON to stdout with the -s -b command line opt
FEATURES
ALTERNATIVES
A cloud-native SIEM platform that provides security analytics, intuitive workflow, and simplified incident response to help security teams defend against cyber threats.
A pure Python parser for Windows Event Log files with access to File and Chunk headers, record templates, and event entries.
A collection of detections for Panther SIEM with detailed setup instructions.
A logging proxy tool created in response to the 'MongoDB Apocalypse', with Docker support.
Browse a library of EQL analytics now natively integrated in Elasticsearch.
PINNED
InfoSecHired
An AI-powered career platform that automates the creation of cybersecurity job application materials and provides company-specific insights for job seekers.
Mandos Brief Newsletter
A weekly newsletter providing cybersecurity leadership insights, industry updates, and strategic guidance for security professionals advancing to management positions.
Kriptos
An AI-driven data classification and governance platform that automatically discovers, analyzes, and labels sensitive information while providing risk management and compliance capabilities.
System Two Security
An AI-powered platform that automates threat hunting and analysis by processing cyber threat intelligence and generating customized hunt packages for SOC teams.
Aikido Security
Aikido is an all-in-one security platform that combines multiple security scanning and management functions for cloud-native applications and infrastructure.
Permiso
Permiso is an Identity Threat Detection and Response platform that provides comprehensive visibility and protection for identities across multiple cloud environments.
Wiz
Wiz Cloud Security Platform is a cloud-native security platform that enables security, dev, and devops to work together in a self-service model, detecting and preventing cloud security threats in real-time.
Adversa AI
Adversa AI is a cybersecurity company that provides solutions for securing and hardening machine learning, artificial intelligence, and large language models against adversarial attacks, privacy issues, and safety incidents across various industries.