Skip to main content
Toggle navigation
Friendica
Search
2024-09-17 22:59:10
2024-09-17 22:40:12
2024-09-17 21:32:25
5530917
Chi Kim
2 months ago
•
•
Chi Kim
2 months ago
•
•
New Mistral 22B model Mistral-Small-Instruct-2409 #
LLM
#
AI
#
ML
huggingface.co/mistralai/Mistr…
#
AI
#
ML
#
llm
Languages
Search Text
Share via ...
in reply to Chi Kim
victor tsaran
in reply to Chi Kim
•
2 months ago
•
•
Why do all Ollama models are Q4 by default?
Languages
Search Text
Share via ...
in reply to victor tsaran
Chi Kim
in reply to victor tsaran
•
2 months ago
•
•
@
vick21
Before K quants, q4_0 was the good compromise for size, speed, and quality. Not anymore though.
@
victor tsaran
Languages
Search Text
Share via ...
⇧
victor tsaran
in reply to Chi Kim • • •Chi Kim
in reply to victor tsaran • • •