# llama

- Page: https://shared.btbytes.com/p/llama
- Date: 2024-07-28
- Tags: opensource, llm, llama

[llama homepage](https://llama.meta.com)  The latest, as on Jul 2024, is llama 3.1 which has 405B, 70B and 8B models, optimized for "do it all", cost/performance tradeoff, and light-weight+speed.

You can run llama locally on your laptop or pc using the following tools:


1. ollama + OpenWebUI;
	1. ollama is an open-source project that provides an easy way to download and run local LLMs
	2. OpenWebUI gives you a web-based ChatGPT like user interface to interact with the local LLMs.
2. LM Studio - is a desktop app
3. [GPT4All](https://www.nomic.ai/gpt4all) is an open-source ecosystem for running LLMs locally on your computer.
4. [MLX](https://github.com/ml-explore/mlx); optimized to run LLMs on Apple Silicon on [macOS](https://shared.btbytes.com/p/macos).

<figure>
  <img src="https://files.btbytes.com/screenshots/2024/09/llama-stack.webp" alt="llama stack" width="600px">
  <figcaption>llama stack APIs</figcaption>
</figure> [via](https://x.com/shrihacker/status/1838996780236812638)