I have been hearing a lot about the new Llama CPP UI but have not tried it yet.
This week I am going to run it in a real on device AI workflow and see how well it fits into my day to day work as a blind iOS developer.
If you are using LlamaCPP or similar local model tooling, how is the new UI working for you in practice. What does it do well, and what still gets in your way.
#AI #OnDeviceAI #LlamaCPP