sglang
Entrypoint
python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-V3-0324 --tp 8 --port 30000 --host 0.0.0.0 --mem-fraction-static 0.9
Refereces
commit: 9069884b5140f95fc4a381b5c98114717744e110
python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-V3-0324 --tp 8 --port 30000 --host 0.0.0.0 --mem-fraction-static 0.9
commit: 9069884b5140f95fc4a381b5c98114717744e110