> The model is built via a merge of https://huggingface.co/nex-agi/Nex-N2-Pro and https://huggingface.co/Qwen/Qwen3.5-397B-A17B, proceeded by On-Policy Distillation from a stronger model. We detected an incorrect upload in the previous version, where the base merged version was upload instead of the final distilled model. We are sorry for the confusion and apologize profusely.
https://huggingface.co/prefeitura-rio/Rio-3.5-Open-397B/comm...
It was a recent edit though. Yesterday snapshot: https://web.archive.org/web/20260613072958/https://huggingfa...
How does that contradict that they uploaded the wrong model?
can you offer a 4-bit quantized version and name it Zé Pequeno, pretty please?
I'd love to see people figuring out how to build models from several smaller ones. We could then train small specialized models and deploy setups more optimized for any given task. Modular LLMs should be a thing.
This is something I've been trying to figure out for a bit, some models are really good at instructions, but their context window is too small, I do wonder if having a cluster of smaller models would be feasible. Been building a custom coding harness so once its nice and polished I might experiment with this more.