Logging

Logtail is nice.

Links

• StatsD - Daemon for easy but powerful stats aggregation.
• statsd-vis - Standalone StatsD server with built-in visualization.
• OpenTracing - Vendor-neutral APIs and instrumentation for distributed tracing.
• Telegraf - Open source server agent to help you collect metrics from your stacks, sensors and systems. (Code)
• log.c - Simple logging library implemented in C99.
• OpenTelemetry - Provides a single set of APIs, libraries, agents, and collector services to capture distributed traces and metrics from your application. (OpenTelemetry Specification) (Web Code) (Awesome)
• The logging framework isn't a bottleneck, and other lies your laptop tells you (2020) (Lobsters)
• Logstash - Transport and process your logs, events, or other data.
• Fluent Bit - Fast Log Processor and Forwarder for Linux, Embedded Linux, MacOS and BSD.
• GoAccess - Real-time web log analyzer and interactive viewer that runs in a terminal in *nix systems or through your browser. (Docker image)
• StatsD Metrics Export Specification
• Loglizer - Machine learning-based log analysis toolkit for automated anomaly detection.
• DTXLoggingInfra - Logging infrastructure for Apple platforms.
• Good Logging (2020) (Lobsters)
• Monitoring demystified: A guide for logging, tracing, metrics (2020) (HN)
• Metrictank - Multi-tenant timeseries platform that can be used as a backend or replacement for Graphite.
• EventNative - Open-source data collection framework.
• Phuslu/Log - Structured Logging for Humans.
• Logs and Time Series are not the same (2020)
• Tracing at Slack: Thinking in Causal Graphs (2020)
• slog - Go library for capturing structured log information.
• Logging Levels: What They Are & How to Choose Them (Lobsters)
• bunyan-rs - CLI to pretty print logs in bunyan format. A Rust port of the original JavaScript bunyan CLI.
• Data Logging: Sampling versus Profiling (2020)
• How to Write Unit Tests for Logging (2020) (HN)
• Backend logging options (2020)
• Glean SDK - Modern cross-platform telemetry. (Docs)
• Logflare - Cloudflare, Vercel & Elixir Logging. (Code)
• Flog - Fake log generator for common log formats.
• Stuff your logs (2021)
• Logsuck - Easy log aggregation, indexing and searching.
• Ekanite - High-performance syslog server with built-in text search.
• The Ultimate Guide To Python Logging (2021)
• My Logging Best Practices (2020)
• OpenTelemetry Collector - Offers a vendor-agnostic implementation on how to receive, process and export telemetry data.
• Data Logging: Sampling versus Profiling (2020)
• Stuff Your Logs (2021) (HN)
• How GitHub Actions renders large-scale logs (2021)
• Grafana Agent - Prometheus Metrics, Loki Logs, and Tempo Traces, optimized for Grafana Cloud.
• Why and how GitHub is adopting OpenTelemetry (2021) (HN)
• Logging is important (2021)
• NanoLog - Extremely performant nanosecond scale logging system for C++ that exposes a simple printf-like API.
• pq - Parse and Query log files as time series.
• angle-grinder - Slice and dice log files on the command line.
• Ostracon - Distributed “persistence-first” shared log.
• exo - Process manager & log viewer for dev. (Web)
• errorpush - Minimalist Sentry alternative using PostgreSQL.
• Apache Flume - Distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. (Minimalist Guide to Flume)
• Monika - Command line application to monitor every part of your web app using a simple JSON configuration file. Get alert not only when your site is down but also when it's slow. (Web)
• My Logging Best Practices (2020) (HN)
• Uptrace - Cost-effective tracing solution that helps you monitor, understand, and optimize complex distributed systems. (Code)
• Logs and tracing: not just for production, local development too (2021) (HN)
• Sigma - Generic Signature Format for SIEM Systems.
• Do Not Log (2020) (HN)
• Logging is a code smell (2022) (HN) (Lobsters)
• The Cost of Logging in 2022
• LNAV - Advanced log file viewer for the small-scale. (Web)
• Tango - Tool to get insights from the server access logs.
• Logging at Twitter (2021) (HN)
• Metrics For Your Web Application's Dashboards (2022)
• sugarjazy - Parse JSON logs nicely.
• Good log management services (2022)
• All your metrics belong to influx (2022)
• magic-trace - Collects and displays high-resolution traces of what a process is doing. (HN)
• Bioyino - StatsD server written in Rust.
• Refinery - Trace-aware sampling proxy. It collects spans emitted by your application, gathers them into traces, and examines them as a whole.
• Sagan - Open source high performance, real-time log analysis & correlation engine.
• CT Woodpecker - Tool to monitor a certificate transparency log for operational problems.
• alp - Access Log Profiler.
• uno - Like uniq, but for logs.
• CLP - Compressed Log Processor (CLP) is a free tool capable of compressing text logs and searching the compressed logs without decompression.
• Prettylog - Command line tool that displays JSON logs in a human-friendly format.
• The Art of Logging (2022)
• Reducing Logging Cost by Two Orders of Magnitude using CLP (2022)
• Tips for Analyzing Logs (2022) (HN)
• Logging practices I follow (2023) (HN)
• LogSlash - Standard for reducing log volume without sacrificing analytical capability.
• How Airbnb Achieved Metric Consistency at Scale (2021)
• Grove - Software as a Service (SaaS) log collection framework.
• Shipping Logs · Fly (2023)
• Logtail - Modern ClickHouse-based Log Management. (JS Client)