Skip to content

fix: preserve Gemma added tokens outside the base vocabulary - #660

Open
Rudy Mizrahi Celekli (rudycelekli) wants to merge 1 commit into
microsoft:mainfrom
rudycelekli:fix/gemma-added-token-export
Open

Rudy Mizrahi Celekli (rudycelekli) wants to merge 1 commit into
microsoft:mainfrom
rudycelekli:fix/gemma-added-token-export

fix: preserve Gemma added tokens outside the base vocabulary

9abe2eb
Select commit
Loading
Failed to load commit list.
Microsoft GitHub Policy Service / license/cla succeeded Oct 13, 2026 in 0s

All CLA requirements met.

This check verifies that the author has agreed to a CLA with Microsoft.