Haven't given an update on my zero-trust agent framework Sycophant in a while. But it now natively supports in-cluster inference.

So if you have two computers and only one of them is powerful enough to host a model you can do that.

I'll playing around with some CPU-optimized LLMs to figure out reliable model routing once I finish cleaning up.

https://github.com/calebfaruki/sycophant

#ai #openclaw #agenticai