🐼 xpu

👇 1 Éléments

vllm

41.5k Python Apache-2.0

A high-throughput and memory-efficient inference and serving engine for LLMs

1 il y a 2 an(s) il y a 3 heure(s)