Setting LLMs on Ubuntu at your homelab

As a private and technical person, it is common to be afraid of the data capturing capabilities of current LLM models. Because of this, I decided to create a small post explaining how to set up your own LLM workspace in your own computer, so you can still can use the latest LLMs without being worried about being spied. Basic requirements Notice that one of the downsides of LLMs is that they require somewhat expensive hardware to run on....

May 26, 2024 ยท 2 min