pre-training a BERT from scratch · Issue #385 · huggingface/transformers

I am wondering whether I can train a new BERT from scratch with this pytorch BERT.
github.com github.com