Skip to content

Commit

Permalink
fix readme
Browse files Browse the repository at this point in the history
  • Loading branch information
khai-meetkai committed Aug 22, 2024
1 parent af597e3 commit 5644454
Showing 1 changed file with 3 additions and 2 deletions.
5 changes: 3 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -115,7 +115,8 @@ sudo docker run --gpus all -it --ipc=host --name functionary -v ${PWD}/functiona


### Vision Function Calling Models
We also use ``server_vllm.py`` to deploy function calling models. Note that currently, vllm only supports single image in inputs, mutiple images will be supported in the future.
We also use ``server_vllm.py`` to deploy vision function calling models. Note that currently, vllm only supports single image in inputs, mutiple images will be supported in the future.

**Small Model:**
```shell
python3 server_vllm.py --model "meetkai/functionary-vision-small-v0.1" --max-model-len 8192
Expand Down Expand Up @@ -165,7 +166,7 @@ client.chat.completions.create(
)
```

**For Including Image**
**For Including Image (Vision Models)**
```python
from openai import OpenAI
import base64
Expand Down

0 comments on commit 5644454

Please sign in to comment.