AINode Pocket runs on your computer next to your Tiiny and gives you one OpenAI-compatible endpoint in front of all of them. /v1/models is the union across your devices, and chat requests route by model id to a box that has it loaded. Each device gets a lock so several callers queue instead of hitting error 150004. There's a chat page, a fleet view, and the TiinyBench suite built in. Standard library Python, no accounts, nothing leaves the house.
farm install ainode-pocket, then farm start ainode-pocket and open http://localhost:8430
Tell me what breaks with your firmware. I've tested against 1.0.
https://tiinyapp.farm/apps/ainode-pocket/
No comments yet.