KV cache management

[iseeyuan]

Although KV cache is enabled, it's not modularized.

• Architecture can be unified or configurable for different backends.
• APIs provided for higher-level use cases, like different eviction schemes.