• b11819 0693dbfb91

    nemotron : support non-standard GQA, BPE tokenizer and domyn-small pre-type (#23343)

    darthrubik released this 2026-10-22 06:34:47 -05:00 | 8 commits to master since this release

    • nemotron : support non-standard GQA, BPE tokenizer and domyn-small pre-type

    • gguf-py : write Metaspace prepend_scheme as GGUF metadata

    • vocab : parse metaspace prepend_scheme into enum, rename key

    • vocab : use metaspace prepend_scheme in detokenize, add TODOs for other tokenizers

    • vocab : use constant for metaspace escaped space


    Co-authored-by: Martin Cimmino martin.cimmino@domyn.com

    Downloads