GGUF?
#12
by rodrigomt - opened
When is the GGUF version coming?
Use this until the official GGUF:
https://huggingface.co/ChrisColeTech/minimax-music-GGUF
But yes we need GGUF's especially for the text_encoder.
There is no "official" GGUF because there are several ways to do it. I created a minimal GGML port here, simpler than acestep.cpp but same code style template :
https://github.com/ServeurpersoCom/minimaxmusic.cpp
https://huggingface.co/Serveurperso/MiniMax-Music3-GGUF
If I manage to integrate it into llama.cpp's MTMD, it would result in more complex/unified/official GGUF files. It remains to be seen if it's possible.