In this series, well explore technologies for processing data in pipelines and directed acyclic graphs. Well start with real-time processing on a single machine using .NET Core libraries, then move to distributed systems like Kafka Streams. The scenario well use involves monitoring complex machinery in astronomical observatories. Well discuss important concepts like fast producer, slow consumer and take into account risks and constraints during development.
