LanceDB requires data to train the index - How does it work with cocoindex flow? #1348
-
|
https://github.com/cocoindex-io/cocoindex/blob/main/examples/text_embedding_lancedb/main.py - great question from user discussion |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
There is a limitation from LanceDB side. LanceDB requires at least 256 rows to be there before it can build the index (see this issue for more details). So currently we cannot enable the index when the table is empty, but can enable it after it's populated with >=256 rows. I created #1355. After the target table has at least 256 rows, users can change a single line in the |
Beta Was this translation helpful? Give feedback.
There is a limitation from LanceDB side. LanceDB requires at least 256 rows to be there before it can build the index (see this issue for more details).
So currently we cannot enable the index when the table is empty, but can enable it after it's populated with >=256 rows.
I created #1355. After the target table has at least 256 rows, users can change a single line in the
.envfile to enable the index since the next cocoindex run.