Stream processing

ksqlDB & RisingWave are neat. I use go-streams for stream processing in Go.

Links

• Logrange - High performance data aggregating storage.
• Mantis - Platform that makes it easy for developers to build realtime, cost-effective, operations-focused applications.
• ksqlDB - Event streaming database purpose-built for stream processing applications. (HN) (Code) (0.24.0 release)
• Transparent Synchronous Dataflow (2019)
• Fluvio - Programmable data streaming platform. (Code)
• Gazette - Makes it easy to build platforms that flexibly mix SQL, batch, and millisecond-latency streaming processing paradigms. (Docs) (HN)
• Apache Flink - Stateful Computations over Data Streams. (Code) (Apache Flink SQL Cookbook) (Web Code)
• Introduction to Stream Processing with Apache Flink (2020)
• Storm Applied: Strategies for real-time event processing
• Template Haskell and Stream-processing programs (2020)
• Eventual Consistency isn’t for Streaming (2020) (HN)
• Hazelcast Jet - Open-Source Distributed Stream and Batch Processing. (Web)
• WTF are streams? (2019)
• Benthos - Stream processor for mundane tasks written in Go. (Web) (Reddit) (Data streaming and Benthos)
• Amazon Kinesis - Process & Analyze Streaming Data .
• Kiner - Python AWS Kinesis Producer with error handling and thread support.
• Modern Distributed Data Architecture with Event Streams, Stream Processing and Derived Data (2020)
• Apache Samza - Distributed stream processing framework.
• Voik - Experimental distributed streaming platform.
• Internal consistency in streaming systems (2021)
• Are We There Yet? The Query Your Database Can't Answer (2021)
• Apache Heron - Real time, distributed, fault-tolerant stream processing engine. (Code)
• The Art of the Meta Stream Protocol: Torrents of Streams
• rlink-rs - High-performance Stream Processing Framework. An alternative to Apache Flink.
• Architecting a Boring Stream Processing Tool With Ashley Jeffs of Benthos (2021)
• Monibuca - Modularized, Extensible framework for building Streaming Server.
• rtsp-simple-server - Ready-to-use RTSP / RTMP / HLS server and proxy that allows to read, publish and proxy video and audio streams.
• Apache Griffin - Big Data Quality Solution For Batch and Streaming. (Code)
• Mirabelle - Stream processing engine for monitoring.
• Kleenex - Programming language for stream processing of data in a regular domain. (Code)
• Callysto - Stream processing framework.
• Database Stream Processor - Streaming and Incremental Computation Framework.
• Conduit - Data Integration for Production Data Stores.
• StreamX - Make stream processing easier.
• Debezium - Change data capture for a variety of databases. (Web)
• Tigris - Modern, scalable backend for building real-time websites and apps. (Web)
• The Dodgy State of Delivery Guarantees (2022) - Summarizing a decades worth of stream processing delivery guarantee misconceptions and bugs.
• Reducing Data Streaming cost by 90% using Benthos (2022)
• Nussknacker - Lets you design, deploy and monitor real time decision algorithms with easy to use GUI.
• Quine - Streaming graph interpreter; a server-side program that consumes data, builds it into a stateful graph structure, and runs live computation on that graph to answer questions or compute results.
• rspl - Stream processor language.
• Readings in Stream Processing
• Serverless Makes Streaming Accessible (2023)