Cloud AI Images¶
This section provides downloadable UBI-based Docker images tailored for Cloud AI inference workloads, including vLLM, QEff, and PyTools. These containerized environments are optimized to run on supported Qualcomm AI hardware.
SDK Version: 1.19.8.0¶
Architecture | Model Framework | Generated URL | Docker Image Download Link |
---|---|---|---|
vLLM + QEff | UBI9 (Python 3.10) | https://dc00tk1pxen80.cloudfront.net/CloudAIImages/SDK1.19.8.0/qaic-x86_64-rh_ubi9-py310-py38-release-qaic_platform-qaic_apps-qaic_python-pybase-pytools-vllm-qeff.tar.gz | Download |
vLLM-TGI-Adapter + QEFF | UBI9 (Python 3.10) | https://dc00tk1pxen80.cloudfront.net/CloudAIImages/SDK1.19.8.0/rh_ubi9_qaic_vllm_tgis_adapter_new.tar.gz | Download |