accelerate
torch==2.4.1
transformers
vllm