AE does not yield expected chunk size #8
Description
We have noticed that the average chunk size yielded by AE deviates from the target chunk size, especially with higher target chunk sizes, and also on random data.
We suspect that the formula coded in ae_chunking.c#27 and also presented in the original paper is wrong.
Take for example a very high target chunk size like 10 KB. According to the formula, the window size should be 5820 bytes. Assuming uniformly distributed data, the maximum byte value in this window is almost certainly gonna be 255, and the next byte to match that would be expected after another 256 bytes, on average. This would then yield an average chunk size of 6067 bytes.