The Quest for Local Machine Learning: A Tale of Hardware, Efficiency, and the Unseen Costs
-
Frank
- October 31, 2024
- ai on intel
- apple event
- apple silicon
- chatGPT
- Developer
- developer tests
- gmktec
- gmktec k9
- Intel
- intel core ultra
- intel ipx
- intel llm
- ipx
- llama.cpp
- LLM
- llm on 4090
- local ai
- local chatgpt
- local llm
- m2 pro
- m3 ai
- M3 chip
- m3 llm
- m3 machine learning
- m3 max ml
- m3 ml
- m3max
- mac mini
- Machine Learning
- machine learning m3
- ml on m3
- nuc
- nucbox
- openui
- programmer
- Programming
- rtx 4090
- rtx4090
- software developer
- software development
- webui
The allure of cloud services, with their seemingly infinite resources, has long been irresistible. Yet, as we stand on the precipice of a new era, the wisdom of relying perpetually on these external behemoths is being called into question. The narrative is changing, veering towards a future where running machine learning models locally isn’t just […]
Read More
Using Clusters to Boost LLMs 🚀
-
Frank
- September 28, 2024
- ai on intel
- apple event
- apple silicon
- chatGPT
- Developer
- developer tests
- gmktec
- gmktec k9
- Intel
- intel core ultra
- intel ipx
- intel llm
- ipx
- llama.cpp
- LLM
- local ai
- local chatgpt
- m3 ai
- M3 chip
- m3 llm
- m3 machine learning
- m3 max ml
- m3 ml
- m3max
- Machine Learning
- machine learning m3
- ml on m3
- nuc
- open webui
- openui
- programmer
- Programming
- software developer
- software development
- webui
This video is from Alex Ziskind. The Unseen Frontier of Computing: Distributed AI on Consumer Hardware There’s a certain thrill that comes from pushing the boundaries of what’s possible with the tools at our disposal. Recently, a fascinating experiment caught my attention—an endeavor that not only challenges conventional wisdom but also hints at the untapped […]
Read More
Cheap Mini PC runs a 70B LLM 🤯
-
Frank
- September 10, 2024
- ai on intel
- apple event
- apple silicon
- chatGPT
- Developer
- developer tests
- gmktec
- gmktec k9
- Intel
- intel core ultra
- intel ipx
- intel llm
- ipx
- llama.cpp
- LLM
- local ai
- local chatgpt
- m3 ai
- M3 chip
- m3 llm
- m3 machine learning
- m3 max ml
- m3 ml
- m3max
- Machine Learning
- machine learning m3
- ml on m3
- nuc
- open webui
- openui
- programmer
- Programming
- software developer
- software development
- webui
Alex Ziskind put 96GB of RAM in this tiny mini PC and ran Llama 70B LLM on it.
Read More