Friendica
Chi Kim
Chi Kim

Chi Kim

chikim@mastodon.social

Chi Kim

chikim@mastodon.social
Love music, technology, accessibility! Faculty at Berklee College of Music 👨🏻‍💻🎹🐕‍🦺
ActivityPub
2025-07-06 21:51:58 2025-07-06 15:59:24 2025-07-06 11:34:48 8175369

Chi Kim
Chi Kim
mastodon - Link to source

Chi Kim

2 months ago • •

Chi Kim

2 months ago • •


Oh I just realized Ollama now has UI for settings that lets you enable external connections beyond localhost and choose where it stores models. It also appears to add itself to automatically login items. Now they need settings for flash attention, default context length. lol #Ollama
#ollama
  •  Languages
  •  Search Text
  •  Share via ...
in reply to Chi Kim

victor tsaran
mastodon - Link to source

victor tsaran

in reply to Chi Kim • 2 months ago • •
Oh, that's news to me. Have to dig in. Flash attention setting has been here for a while, but I'm not sure it does anything.
  •  Languages
  •  Search Text
  •  Share via ...
Unknown parent

victor tsaran
mastodon - Link to source

victor tsaran

Unknown parent • 2 months ago • •
Oh yes, it's been a variable forever! :)
  •  Languages
  •  Search Text
  •  Share via ...
Unknown parent

victor tsaran
mastodon - Link to source

victor tsaran

Unknown parent • 2 months ago • •
BTW, how are you running Ollama? I used to use their binary, but these days go the homebrew route and run it as a service.
  •  Languages
  •  Search Text
  •  Share via ...
⇧