Skip to content

Need info on how to handle 1 billion keys #6441

Answered by derekcollison
kharabela asked this question in Q&A
Discussion options

You must be logged in to vote

Currently subject based indexes for lookup are held in memory.

So I would suggest using a hashing approach to use multiple streams / KVs and size accordingly with memory.

We are looking at improving the memory footprint for very large key/subject spaces.

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by derekcollison
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants