I was seeking a way to process Apache’s access_log file by several parsers simultaneously.
Usually I do it in a straight way:
When access_log is small, this is OK. But if access_log is large, like 15Gb, it is better to read it only once.
We can split one stream into many streams and pass them to many programs using “tee” command and “named pipes”: