Skip to content
This repository has been archived by the owner on Oct 31, 2022. It is now read-only.

how do I train gpt-2 using multiple encoding files? #64

Open
ca3games opened this issue Sep 25, 2020 · 1 comment
Open

how do I train gpt-2 using multiple encoding files? #64

ca3games opened this issue Sep 25, 2020 · 1 comment

Comments

@ca3games
Copy link

Hi, I just got gpt-2 working under google collab.

I have two questions:
How much epochs do I need to let it run?
How do I train gpt-2 using multiple encoding files?

Many thanks.

@arturogatti
Copy link

Those are much more complex than what you'll find on google. The only way to do what you are asking is to hire a data scientist, will run you about $75,000 on average. No less than $65,000.00 USD.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants