Repository navigation
local bitnet model don't have the same quality as online bitnet #216
Description
It seems, the bitnet local model doesn't have the same quality as the online demo from microsoft site : https://bitnet-demo.azurewebsites.net/
What are the parameters for online demo model ? i seems the result is longer and more precise.
What parameters can i modify to have higher quality results on my local bitnet ?
Thank you.
Activity
sd983527 commentedon Apr 23, 2025
which local model are you using? As for my understanding, the demo site is running the exact same model as provided here https://huggingface.co/microsoft/bitnet-b1.58-2B-4T-gguf
sd983527 commentedon Apr 23, 2025
One thing just came into my mind is that, you may need a refined system prompt to get better response quality. The current default prompt is too simple.
rcsarv commentedon May 4, 2025
Hello,
do anyone have code of https://bitnet-demo.azurewebsites.net