Local LLM

LLMs that could be run on local machines

Created: by Pradeep GowdaUpdated:Aug 11, 2024Tagged: llm .

Introducing llamafile “llamafile lets you turn large language model (LLM) weights into executables.”

HN Discussion of llamafile has some cool application of this given by simonwllamafile is the new best way to run a LLM on your own computer

LMStudio + FreeChat - Freechat “Local, secure, open source AI chat for macOS” - LMStudio “Discover, download, and run local LLMs”

Note on Deepseek v2; Aug 8, 2024