Skip to content

Commit

Permalink
docs: update README (#877)
Browse files Browse the repository at this point in the history
  • Loading branch information
zhyncs authored Aug 26, 2024
1 parent 82ddf00 commit a18a829
Showing 1 changed file with 0 additions and 5 deletions.
5 changes: 0 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -236,11 +236,6 @@ print("Chat response:", chat_response)

### SGLang

> [!NOTE]
> <div align="center">
> SGLang now does NOT support the <b>Qwen2MoeForCausalLM</b> architecture, thus making <b>Qwen2-57B-A14B</b> incompatible.
> </div>
Please install `SGLang` from source. Similar to `vLLM`, you need to launch a server and use OpenAI-compatible API service. Start the server first:
```shell
python -m sglang.launch_server --model-path Qwen/Qwen2-7B-Instruct --port 30000
Expand Down

0 comments on commit a18a829

Please sign in to comment.