Chi Kim 6 months ago • • Chi Kim 6 months ago • • New Mistral 22B model Mistral-Small-Instruct-2409 #LLM #AI #ML huggingface.co/mistralai/Mistr… #AI #ML #llm Languages Search Text Share via ...
in reply to Chi Kim victor tsaran in reply to Chi Kim • 6 months ago • • Why do all Ollama models are Q4 by default? Languages Search Text Share via ...
in reply to victor tsaran Chi Kim in reply to victor tsaran • 6 months ago • • @vick21 Before K quants, q4_0 was the good compromise for size, speed, and quality. Not anymore though. @victor tsaran Languages Search Text Share via ...
victor tsaran
in reply to Chi Kim • • •Chi Kim
in reply to victor tsaran • • •