zeek2es.py
Python application to translate Zeek logs into ElasticSearch's bulk load JSON format with detailed instructions and features.

zeek2es.py
Python application to translate Zeek logs into ElasticSearch's bulk load JSON format with detailed instructions and features.
zeek2es.py Description
This Python application translates Zeek's ASCII TSV and JSON logs into ElasticSearch's bulk load JSON format. Table of Contents: Introduction Installation Elastic v8.0+ Docker Upgrading zeek2es ES Ingest Pipeline Filtering Data Python Filters Filter on Keys Command Line Examples Command Line Options Requirements Notes Humio JSON Log Input Data Streams Helper Scripts Cython Introduction Want to see multiple Zeek logs for the same connection ID (uid) or file ID (fuid)? Here are the hits from files.log, http.log, and conn.log for a single uid: You can perform subnet searching on Zeek's 'addr' type: You can create time series graphs, such as this NTP and HTTP graph: IP Addresses can be Geolocated with the -g command line option: Aggregations are simple and quick: This application will 'just work' when Zeek log formats change. The logic reads the field names and associated types to set up the mappings correctly in ElasticSearch. This application will recognize gzip or uncompressed logs. This application assumes you have ElasticSearch set up on your localhost at the default port. If you do not have ElasticSearch you can output the JSON to stdout with the -s -b command line opt
FEATURED
Password manager with end-to-end encryption and identity protection features
VPN service providing encrypted internet connections and privacy protection
Fractional CISO services for B2B companies to accelerate sales and compliance
Stay Updated with Mandos Brief
Get the latest cybersecurity updates in your inbox
TRENDING CATEGORIES
POPULAR
Security platform that provides protection, monitoring and governance for enterprise generative AI applications and LLMs against various threats including prompt injection and data poisoning.
A threat intelligence aggregation service that consolidates and summarizes security updates from multiple sources to provide comprehensive cybersecurity situational awareness.
Fabric Platform is a cybersecurity reporting solution that automates and standardizes report generation, offering a private-cloud platform, open-source tools, and community-supported templates.
A weekly newsletter providing cybersecurity leadership insights, industry updates, and strategic guidance for security professionals advancing to management positions.