Burak
Should I put a Kafka/Redis buffer between Fluent Bit and OpenSearch when shipping logs?
Turn on Fluent Bit's filesystem buffer first; move to Kafka once 40k/s is permanent, and keep a Redis list only for logs you can afford to lose.
Tag
Event streaming with Kafka: partitions, ordering guarantees and consumer-group behaviour.
1 answered questions carry this tag.
Turn on Fluent Bit's filesystem buffer first; move to Kafka once 40k/s is permanent, and keep a Redis list only for logs you can afford to lose.