Feature/slice based radix

[C-Pro]

Add a separate KVCache with slice based radix implementation (compared to map based wrapper that is KV).
The idea is to cut on memory consumption as well as search time on the trie node level (small maps access is not faster than small slices, and max map size on node level is 256).
And by making it a separate cache size we are cutting down on extra mutex in the wrapped cache.

[Copilot]

Pull request overview

This PR introduces a new KVCache implementation using a slice-based radix trie instead of the existing map-based wrapper (KV). The primary goals are to reduce memory consumption and improve search performance at the trie node level, while eliminating the extra mutex overhead from the wrapped cache approach.

Key Changes

• Added KVCache with slice-based radix trie implementation for memory efficiency
• Updated RingBuffer.All() to use exclusive lock instead of read lock
• Enhanced benchmarks with new test cases and more realistic composite key patterns

Reviewed changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated 3 comments.

File	Description
kv_cache.go	New slice-based radix trie cache implementation with terminal nodes and freelist for value reuse
kv_cache_test.go	Comprehensive test suite including unit tests, fuzz tests, and concurrency tests for KVCache
bench_test.go	Added KVCache to benchmark suite and enhanced test data generation with composite keys
ring.go	Changed All() iterator from RLock to exclusive Lock

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[codecov]

Codecov Report

❌ Patch coverage is 95.02488% with 20 lines in your changes missing coverage. Please review.
✅ Project coverage is 97.98%. Comparing base (e5b429f) to head (6be9a39).
⚠️ Report is 2 commits behind head on main.

Files with missing lines	Patch %	Lines
kv_cache.go	95.02%	15 Missing and 5 partials ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##              main      #17      +/-   ##
===========================================
- Coverage   100.00%   97.98%   -2.02%     
===========================================
  Files            7        8       +1     
  Lines          790     1190     +400     
===========================================
+ Hits           790     1166     +376     
- Misses           0       18      +18     
- Partials         0        6       +6     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[egregors]

LGTM

[C-Pro]

LGTM

I trust you have diligently checked every line with a looking glass 🕵️

[wilyantopintu]

add same logic as insert

	if len(keyBytes) == 0 {
		if node.terminal {
			return kv.values[node.valueIndex], true
		}
		return kv.zero, false
	}

[C-Pro]

I did this instead:

	if node.terminal {
		return kv.values[node.valueIndex], true
	}

	return kv.zero, false