Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Dockerfile with extensions support #107

Merged
merged 11 commits into from
Mar 20, 2024
Merged

Update Dockerfile with extensions support #107

merged 11 commits into from
Mar 20, 2024

Conversation

mgoin
Copy link
Member

@mgoin mgoin commented Mar 8, 2024

Created the nm-vllm-openai package: https://github.com/neuralmagic/nm-vllm/pkgs/container/nm-vllm-openai

Adds a new manual docker build+publish workflow that will build a docker image using the Dockerfile at the top-level and push it to ghcr.io/neuralmagic/nm-vllm-openai. It will upload two tags, one with the current date and one with latest for ease of use.

I also manually built a docker image for the v0.1.0 branch by checking out that branch, applying the magic-wand extensions, and running:

docker build --tag ghcr.io/neuralmagic/nm-vllm-openai:v0.1.0 --target vllm-openai .
docker push ghcr.io/neuralmagic/nm-vllm-openai:v0.1.0

@mgoin mgoin merged commit b953c9f into main Mar 20, 2024
2 checks passed
@mgoin mgoin deleted the dockerfile-extensions branch March 20, 2024 20:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants