Commit History

Remove byte tokenizer and add config args to switch between byte/patch packing (#68)
aeb95f1
unverified

par-meta commited on

Add vocab and seq len abstract fields (#66)
ff36aa8
unverified

par-meta commited on

Initial commit
bcc039b

par-meta commited on