Skip to content

Cloud AI Images

This section provides downloadable UBI-based Docker images tailored for Cloud AI inference workloads, including vLLM, QEff, and PyTools. These containerized environments are optimized to run on supported Qualcomm AI hardware.

SDK Version: 1.19.8.0


Architecture Model Framework Generated URL Docker Image Download Link
vLLM + QEff UBI9 (Python 3.10) https://dc00tk1pxen80.cloudfront.net/CloudAIImages/SDK1.19.8.0/qaic-x86_64-rh_ubi9-py310-py38-release-qaic_platform-qaic_apps-qaic_python-pybase-pytools-vllm-qeff.tar.gz Download
vLLM-TGI-Adapter + QEFF UBI9 (Python 3.10) https://dc00tk1pxen80.cloudfront.net/CloudAIImages/SDK1.19.8.0/rh_ubi9_qaic_vllm_tgis_adapter_new.tar.gz Download