Download Pre-Converted OpenVINO Models

OpenVINO GenAI allows to run different generative AI models (see Supported Models). While you can convert models from other frameworks (see Convert Models to OpenVINO Format), using pre-converted models can save time and effort.

Download from Hugging Face

The simplest way to download models is using the huggingface_hub package:

1. Install the package:

   pip install huggingface_hub
2. Download the model, specifying model id (e.g. OpenVINO/phi-2-fp16-ov) and output directory model_path:

   huggingface-cli download "OpenVINO/phi-2-fp16-ov" --local-dir model_path
   info

   The -ov suffix in model id usually defines OpenVINO pre-converted model.

Available Model Collections

OpenVINO offers collections of pre-converted and pre-optimized models available on Hugging Face under the OpenVINO Toolkit organization:

• Large Language Models
• Image Generation
• Speech-to-Text
• Visual Language Models
• Speculative Decoding Draft Models Collection
• and others.

These models are ready to use with OpenVINO GenAI.

Download from ModelScope

1. Install the package:

   pip install modelscope
2. Download the model, specifying model id (e.g. OpenVINO/phi-2-fp16-ov) and output directory model_path:

   modelscope download --model "OpenVINO/phi-2-fp16-ov" --local_dir model_path

info

For detailed instructions on using downloaded models with OpenVINO GenAI, refer to the Use Cases documentation.