Semantic cache
Local hashed-trigram similarity, with no embedding model and no LLM calls. The hit rate below is counted from real lookups on this instance. No savings figure is claimed.
Lookup threshold
Local hashed-trigram similarity, with no embedding model and no LLM calls. The hit rate below is counted from real lookups on this instance. No savings figure is claimed.