ANDRE LUSTOSA / TAG
#inference
1 entry with this tag.
Serving llama.cpp Across My Home Network and Tailscale
Building llama.cpp on Fedora with Vulkan, then sharing a 27B model with friends and other machines across my home network and Tailscale.
ANDRE LUSTOSA / TAG
1 entry with this tag.
Building llama.cpp on Fedora with Vulkan, then sharing a 27B model with friends and other machines across my home network and Tailscale.