Prompt Caching for Anthropic models

[zavocc]

This can significantly reduce costs and prevent daily rate limits due to long conversations, chat history can exponentially multiply the cost and its stateless

https://docs.anthropic.com/en/docs/build-with-claude/prompt-caching

[Taewan-P]

I'll be working on issues after Ollama support feature is completed.