Jul 22, 2025, 9:25 PM@starsider cool. if I may ask, what tooling did you use for this?
- Jul 22, 2025, 9:25 PM
Replies
- Jul 22, 2025, 9:31 PM
@sop llama.cpp server, mikupad and OLMo-2-1124-13B-Instruct (Q4_K_M gguf), but for text completion I would suggest koboldcpp instead which is easier to use and includes a text completion in its web UI (called "story mode" if I remember correctly).