#advanced

Stateful Aggregations in Spark Structured Streaming: mapGroupsWithState

mapGroupsWithState gives you a per-key mutable state machine in a streaming pipeline — it is the right tool when windows are not enough