Pi Agent with llama.cpp server
Pi has first class support for Llama.cpp released in version 0.81.0+
How to get started?
You can use the following slash command to do a one time setup.
/login llama.cpp
We don’t need to manage our own custom support to make Pi and llama.cpp anymore.