open source llm

AI Large Language Models

How to Run 70Bn Llama 3 Inference on a Single 4GB GPU

This video is from Rohan-Paul-AI. Code : https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/layered_inference_with_airllm_70B_LLM_Inference_on_a_Single_4GB_GPU.ipynb Airllm Github – https://github.com/lyogavin/Anima/tree/main/air_llm

Read More
AI

Mistral Finetuning on Custom Data: Learn in 7 Mins!

This video is from Mervin Praison. In this tutorial, we dive deep into the world of AI model training with Ludwig, focusing on fine-tuning a large language model, Mistral, using the Alpaka dataset. This video is a comprehensive guide to using Ludwig, a low-code, scalable, and efficient framework for building custom AI modules. We’ll explore […]

Read More
AI

Solar 10.7B Model: Revolutionizing AI with Depth Upscaling

This video is from Mervin Praison. 🚀 Welcome to an exciting journey through the world of Artificial Intelligence! In today’s video, we explore the groundbreaking Solar 10.7 billion parameter model. This model stands out with its innovative depth upscaling technique, setting new benchmarks in AI performance. 🌟 👨‍💻 We’ll take you step-by-step through setting up […]

Read More
AI Generative AI Large Language Models Privacy

Chat With PDF, TXT, and CSV Privately! (FULLY Local) How To Install PrivateGPT UPDATED

In this video, Matthew Berman shows you how to install and use the new and improved PrivateGPT. Chat with your docs (txt, pdf, csv, xlsx, html, docx, pptx, etc) easily, in minutes, completely locally using open-source models. This is an update from a previous video from a few months ago.

Read More
AI Generative AI Large Language Models Open Source

Guanaco 65B: 99% ChatGPT Performance 🔥 Using NEW QLorRA Tech

This video is from Matthew Berman. In this video, we review Guanaco, the new 65B parameter model that achieves 99% of the performance of ChatGPT. It is truly incredible. Since it is a large model, we use a cloud GPU to power it. This model can code, has logic and reasoning, can do creative writing, […]

Read More
AI Generative AI Large Language Models

NEW GPT4All “Snoozy” – Don’t Sleep On The Best Local LLM

In this video, Matthew Berman review the brand new GPT4All Snoozy model as well as look at some of the new functionality in the GPT4All UI. This model is fast and is a significant improvement from just a few weeks ago with GPT4All-J.

Read More
Large Language Models Privacy

How To Install PrivateGPT – Chat With PDF, TXT, and CSV Files Privately! (Quick Setup Guide)

In this video, Matthew Berman shows you how to install PrivateGPT, which allows you to chat directly with your documents (PDF, TXT, and CSV) completely locally, securely, privately, and open-source. PrivateGPT is the top trending github repo right now and it’s super impressive. It uses GPT4All to power the chat. Links: PrivateGPT – https://github.com/imartinez/privateGPT GPT4All […]

Read More