Configuration
Cache Sizing
Paste a chronological trace of token-id requests and simulate the cache hit rate you would get at any L1/L2 capacity, in tokens and bytes.
Paste a chronological trace of token-id requests and simulate the cache hit rate you would get at any L1/L2 capacity, in tokens and bytes.