Skip to main content
OpenVINO GenAI
Documentation
Status:
Work in progress
GitHub
Concepts
Optimization techniques
Optimization techniques
Optimization techniques to OpenVINO GenAI.
📄️ Speculative Decoding
📄️ KVCache Token Eviction Algorithm
📄️ Continuous Batching
📄️ Prefix Caching