Skip to main content

After a long period of inactivity for vision language models, llama.cpp merged the support for MiniCPM-V-2.5. Hopefully the support for 2.6 is also on the way soon. #LLM #Multimodal #AI #ML
huggingface.co/openbmb/MiniCPM…
huggingface.co/openbmb/MiniCPM…
github.com/ggerganov/llama.cpp…

support MiniCPM-V-2.5 by tc-mb · Pull Request #7599 · ggerganov/llama.cpp

Dear llama.cpp Official, Hi, I'm writing to address our new PR submission for integrating our model MiniCPM-Llama3-V 2.5 into llama.cpp, which has been trending on Huggingface for over a week a...
GitHub
#AI #ML #llm #multimodal

Mikołaj Hołysz reshared this.

in reply to Chi Kim

victor tsaran
victor tsaran
• •
Do you think this MiniCPM is any good? I can't even find a description on this page of what the model does! :)
in reply to victor tsaran

Chi Kim
Chi Kim
• •
@vick21 Definitely better than what's available on Ollama right now. The description is in the model summary for non-quantize model, and it's on one of the links I included in my post. V2.6 is even better, but not supported in llama.cpp yet.
@victor tsaran
in reply to victor tsaran

Bot4Sale
Bot4Sale
• •

@vick21 For anyone having trouble finding the description (like me) this is the direct link

huggingface.co/openbmb/MiniCPM…


openbmb/MiniCPM-V-2_6 · Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.
huggingface.co
@victor tsaran
in reply to Chi Kim

victor tsaran
victor tsaran
• •
Ah, the description was under the second link. I clik on the first one, of course! Have to try it though before I believe the claims. So many people claim to outperform OpenAI these days! :)
in reply to victor tsaran

Chi Kim
Chi Kim
• •
@vick21 You can't trust numbers from benchmarks alone, but I'm waiting for InternVL2-Llama3-76B which is #1 on MMBench! GPT-4o (0513 is #3, the old original GPT-4V-1106 is #31, and MiniCPM-Llama3-V2.5 is #35. mmbench.opencompass.org.cn/lea…

MMBench

mmbench.opencompass.org.cn
@victor tsaran
⇧