Skip to main content

I've been very much enjoying running an LLLM (Local Large Language Model) on my Mac with #Ollama the last week or so, asking it random questions without taking up copious amounts of someone else's resources, and leters of water in some datacentre somewhere. My Mac has fans but even with a complex question, they barely bother to spin. I can send it images as well, and the responses are certainly up there with GPT4, so it makes me happy.
#ollama
This entry was edited (3 months ago)
in reply to Andre Louis

Charlotte Joanne
Charlotte Joanne
• •
what sort of Mac do you have and how fast or how long does these things take to work? I wanted to try doing this, but the max somebody suggested cost four grand!!! Yes £4000 for a laptop! I know.
in reply to Charlotte Joanne

Andre Louis
Andre Louis
• •
Well mine was 3.5 grand, so... I do music production on a professional level with it, so it was an expenditure worthwhile for me, because I knew I'd make it back eventually. 64 GB RAM, 1 TB storage, M1 Max chip from 2021. Even after two years it doesn't feel any slower than the day I bought it, and it will definitely last for many more years to come.
in reply to Andre Louis

Charlotte Joanne
Charlotte Joanne
• •
obviously you’ve got the uses for it. But if it works on what you’ve got, I don’t need to buy an M3 promax do I? So maybe I can get a more modest Mac two grand would be okay but four grand is just ridiculous!😉
in reply to Charlotte Joanne

Andre Louis
Andre Louis
• •
Of course. Even a MacBook Air would do you fine, just get one with 16, not 8 GB. 8 in this day and age is just beyond stupid.
Also, do check Apple refurbish store, they have great deals, and still fully warrantee, and they even allow you to add Apple Care as if it were a brandnew device. Highly recommended. I've purchased refurb Mac's from Apple before and never had problems with them.
in reply to Andre Louis

Andre Louis
Andre Louis
• •
More than happy to sit on phone with you and help you get something that will last you many years if that's of interest. Tech support's one of my jams, so would be glad to get you sorted if that's of interest.
in reply to Andre Louis

Devin Prater :blind:
Devin Prater :blind:
• •
I think I want to see what Apple will be putting out this year as far as accessibility, on GAAD in like, May or something, before I think about getting a new Mac. I know I want one with either 32 or 65 GB RAM, and at least 512 GB SSD, but I just need VoiceOver to be at a point where I can do my job, lots of Salesforce and Google Workspace, with it.
in reply to Devin Prater :blind:

Andre Louis
Andre Louis
• •
VO got stupid amounts of responsive in Sonoma, better than I think it's been in years. Also 65 GB of RAM, you just want that extra gig to ramxplain don't you? You horrible horrible person you! Greedy gigger! haa
in reply to Andre Louis

Devin Prater :blind:
Devin Prater :blind:
• •
Oof, did I say 65? Lol, I mean 66. Oops, um, 67! Yeah, I mean like, there are tables in Salesfoce that VO sees the table, but not what's in it. Of course, once I have more than 8 GB of RAM, maybe running Firefox wouldn't be so sluggish. I'll just have to see really. I know I'd definitely be financing it with my Apple Card, thank goodness.
in reply to Devin Prater :blind:

Andre Louis
Andre Louis
• •
I have a windows 11 ARM VM running on here, gave it 8 GB of the 64 and it just flies. Rest of the machine doesn't even care. Can run large Logic projects in the background without breaking a sweat, too.
in reply to Andre Louis

Devin Prater :blind:
Devin Prater :blind:
• •
Oh wow. Windows, flying on 8 GB of RAM? Yeah that is pretty amazing.
in reply to Devin Prater :blind:

destructatron
destructatron
• •
I've seen it happen on the NCw school laptops, they were pretty fast. Even faster if you changed the balanced power plan and set minimum CPU usage to 100%. Usually that's all the average 8 GB ram computer needs to speed it up.
in reply to destructatron

The Cube
The Cube
• •
My system has its foot to the floor. High performance power plan, min and max CPU at 100%.
in reply to The Cube

destructatron
destructatron
• •
There's an ultimate performance plan you can enable with a powercfg command. Not sure what the big difference is between the 2 though.
⇧