https://youtu.be/l5ggH-YhuAw
#BMO #LLM #LocalLLMs #FOSS #raspberrpi

Curious if others have found different winners or have tips I missed.

#LocalLLMs #AIEngineering #MachineLearning #Ollama

I spent some time playing around with Local LLMs on Apple Silicon. Here's how that played out.

Local LLMs on Spare Apple Silicon: A Cautionary Tale
https://macadminmusings.com/blog/2026/01/11/local-llms-on-spare-apple-silicon-a-cautionary-tale/
#MacAdmins #LocalLLMs

"Đánh giá AI qua trò chơi 2D như Portal! Xây dựng bảng xếp hạng mô hình LLM cục bộ, cần cộng đồng hỗ trợ. Dự án mã nguồn mở – tham gia GitHub & Discord. #AILocalBenchmark #Portal2DBenchmark #LocalLLMs #XếpHạngLLM #TríTuệNhânTạo #MạngLLM"

https://www.reddit.com/r/LocalLLaMA/comments/1ppnrq5/benchmarking_ai_by_making_it_play_a_2d_version_of/

"OpenAI công bố kiến trúc GPT-4 giúp LLM nhỏ địa phương tiến bộ? Việc mở mã nguồn kiến trúc hoặc notebook huấn luyện GPT-4 có thể thu hẹp khoảng cách với mô hình lớn. #GPT4 #AI #LocalLLMs #MachineLearning #ViệtNamAI #TríTuệNhânTạo"

https://www.reddit.com/r/LocalLLaMA/comments/1pof7fm/forget_about_datasource_but_if_open_ai_open/

Bạn muốn tìm hiểu về Local LLMs với cấu hình máy hiện có và mục tiêu xây dựng AI kiến thức về Docker? Cộng đồng đang chia sẻ kinh nghiệm và tài liệu hữu ích. Hãy tìm kiếm các kênh YouTube, website và subreddit chuyên về LocalLLaMA để có những bước đi đầu tiên nhé!

#LocalLLMs #AI #Docker #MachineLearning #HọcMáy #TríTuệNhânTạo

https://www.reddit.com/r/LocalLLaMA/comments/1p0vo67/what_are_the_best_resources_to_learn_more_about/

🚨 ALERT: Local LLMs, the supposed guardians of your digital fortress, are apparently about as secure as a wet paper bag. 🤦‍♂️ This "groundbreaking" #research reveals that local models are easily tricked, making them the cyber equivalent of a friendly puppy that wags its tail at everyone, including burglars. 🐶🔓
https://quesma.com/blog/local-llms-security-paradox/ #LocalLLMs #CyberSecurity #DigitalFortress #Vulnerability #AIModels #HackerNews #ngated

The security paradox of local LLMs

https://quesma.com/blog/local-llms-security-paradox/

#HackerNews #securityparadox #localLLMs #technologyprivacy #AIethics #machinelearning

NVIDIA DGX Spark + Apple Mac Studio = 4x Faster LLM Inference with EXO 1.0

#ai, #apple, #generative-ai, #llms, #local-llms, #nvidia

Các mô hình LLM cục bộ chuyên viết code (như aiXCoder-7B) gây thất vọng khi dùng ở chế độ chat. Người dùng báo cáo phản hồi kém, không liên quan hoặc chỉ là link, thay vì code. Liệu các coder LLM này chỉ phù hợp cho IDE mà không phải chat trực tiếp?

#LLM #AI #Coding #LocalLLMs #Tech #MôHìnhAI #LậpTrình #TròChuyệnAI

https://www.reddit.com/r/LocalLLaMA/comments/1nzc9zv/local_coder_models_cannot_be_used_in_chat_model/

What App do you use to run LLMs locally on iOS? I’ve been using PocketPal, but it seems to have trouble with Apples built in limit for Apps of max 50% VRAM, which limits model sizes & choice. #iOS #LLMs #LocalLLMs

Experimenting with Local LLMs on macOS

https://blog.6nok.org/experimenting-with-local-llms-on-macos/

#HackerNews #LocalLLMs #macOS #Experimenting #AI #Technology

Comprehensive introduction to #SemanticKernel as an AI Orchestrator, how it works, and how to leverage it for your organization's benefit?
Free course on YouTube https://www.youtube.com/playlist?list=PLyqwquIuSMZpGDiocmT-M67dcDxjWmoYK
Hope you enjoy! 😀
#AzureAIFoundry #OpenAI #LocalLLMs #Ollama #DockerModelRunner #RAG #Agents

🚀 Take control of your AI usage! With LiteLLM + OpenWebUI you can unify cloud & local models, set real budgets, and never get surprise bills. Perfect for home labs and small teams. 🧑‍💻💡

#LiteLLM #OpenWebUI #Docker #AItools #HomeLab #LocalLLMs #APIGateway #AIbudget #TechBlog #SmallBusinessAI

https://victornava.dev/2025/09/02/litellm-at-home-one-endpoint-real-budgets-zero-surprises/

llama.cpp guide: running gpt-oss with llama.cpp

#ai, #generative-ai, #gpt-oss, #llama-cpp, #llms, #local-llms, #macos, #openai

Introducing Gemma 3 270M: The compact model for hyper-efficient AI

#ai, #gemini, #gemma, #generative-ai, #google, #llm, #llm-release, #llms, #lm-studio, #local-llms, #pelican-riding-a-bicycle

New to AI? The #ollama UI might be the perfect, easy-to-use entry point. It's a fantastic start! 🎉 #AIforBeginners #LocalLLMs https://youtu.be/prrWESXl7wg

"Simon Willison has a plan for the end of the world. It’s a USB stick, onto which he has loaded a couple of his favorite open-weight LLMs—models that have been shared publicly by their creators and that can, in principle, be downloaded and run with local hardware. If human civilization should ever collapse, Willison plans to use all the knowledge encoded in their billions of parameters for help. “It’s like having a weird, condensed, faulty version of Wikipedia, so I can help reboot society with the help of my little USB stick,” he says.

But you don’t need to be planning for the end of the world to want to run an LLM on your own device. Willison, who writes a popular blog about local LLMs and software development, has plenty of compatriots: r/LocalLLaMA, a subreddit devoted to running LLMs on your own hardware, has half a million members.
For people who are concerned about privacy, want to break free from the control of the big LLM companies, or just enjoy tinkering, local models offer a compelling alternative to ChatGPT and its web-based peers.

The local LLM world used to have a high barrier to entry: In the early days, it was impossible to run anything useful without investing in pricey GPUs. But researchers have had so much success in shrinking down and speeding up models that anyone with a laptop, or even a smartphone, can now get in on the action. “A couple of years ago, I’d have said personal computers are not powerful enough to run the good models. You need a $50,000 server rack to run them,” Willison says. “And I kept on being proved wrong time and time again.”"

https://www.technologyreview.com/2025/07/17/1120391/how-to-run-an-llm-on-your-laptop/

#AI #GenerativeAI #LLMs #Chatbots #LocalLLMs #Privacy #DataProtection #Decentralization

Local LLMs versus Offline Wikipedia

https://evanhahn.com/local-llms-versus-offline-wikipedia/

#HackerNews #LocalLLMs #OfflineWikipedia #TechDebate #AIResearch #KnowledgeAccess

... first task done by #ollama #LocalLLMs (model: qwen2.5-coder:14b ) at first run without errors: "Make a web-readable table in html out of this csv-file.... the result: http://ham.acc4sc.de/html1/ensembles.html