Sharding: Unflatten section about "Segments"

[amotl]

@matriv, @seut: The new section is a bit flat. Do you have any suggestions to unflatten it slightly, to possibly provide better insights and guidance?

Originally posted by @amotl in #355 (comment)

[matriv]

Maybe you can use: https://cratedb.com/product/features/lucene-engine and https://lucene.apache.org/core/3_0_3/fileformats.html#Segments and then also mention: https://cratedb.com/docs/crate/reference/en/latest/admin/optimization.html#optimization about the number of segments and how it can be optimized.

[amotl]

Thanks. The page also refers to those articles, some only blog items. Do you think it is applicable to use the opportunity to wrap their main ingredients concisely into a little documentation page, considering/summarizing/linking to relevant topics all at once?

• https://cratedb.com/docs/crate/reference/en/latest/concepts/storage-consistency.html
• https://cratedb.com/blog/indexing-and-storage-in-cratedb
• https://cratedb.com/blog/guide-to-write-operations-in-cratedb

[matriv]

I wouldn't expand too much, segments is not part of the sharding guide. I'd only have a short paragraph and link to the other places for more info.

[amotl]

The section has been unflattened well ¹, but could refer to ² (via ³, thanks @matriv), for example after also integrating it.

Footnotes

1. https://cratedb.com/docs/guide/feature/storage/#storage-process ↩

2. https://cratedb.com/blog/guide-to-write-operations-in-cratedb ↩

3. https://cratedb.com/product/features/lucene-engine ↩