New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ADD Florence-2 #1541

Open

itsmeterada opened this issue Sep 4, 2024 · 7 comments

Assignees

Labels

Contributor

itsmeterada commented Sep 4, 2024

https://huggingface.co/microsoft/Florence-2-base
https://huggingface.co/microsoft/Florence-2-base-ft
https://huggingface.co/microsoft/Florence-2-large
https://huggingface.co/microsoft/Florence-2-large-ft

kyakuno assigned ooe1123

Collaborator

kyakuno commented Sep 5, 2024

@ooe1123 GPT-SoVITS2の後に、こちらをお願いできると嬉しいです。

Collaborator

kyakuno commented Sep 5, 2024

軽量なVLMモデルです。

Collaborator

kyakuno commented Sep 5, 2024

MITライセンス。

Collaborator

kyakuno commented Sep 5, 2024 •

edited

Loading

Finetuning

公式（Azure） : https://qiita.com/yo-naka/items/ba552a54b856f9318a7c
HuggingFace : https://huggingface.co/blog/finetune-florence2
サードパーティ：https://github.com/andimarafioti/florence2-finetuning

kyakuno added the high priority label

Collaborator

kyakuno commented Sep 5, 2024

baseのfloatで460MBぐらいとのこと。

Collaborator

kyakuno commented Sep 5, 2024

tokenizerはBartTokenizerを使っている。

Collaborator

kyakuno commented Sep 5, 2024

Roberta Tokenizerに近い。
https://github.com/huggingface/transformers/blob/main/src/transformers/models/bart/tokenization_bart.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment