Post #3076358
2024-07-31 16:56 UTC
Run Llama 3.1 locally on your MacBook! 🦙
llama-server --chat-template llama3 --hf-repo reach-vb/Meta-Llama-3.1-8B-Instruct-Q6_K-GGUF \
--hf-file meta-llama-3.1-8b-instruct-q6_k.gguf \
--ctx-size 8192
#llama31 #locallama #llm
Replies (0)
No replies.