LLM

AI Generative AI Large Language Models Red Hat

InstructLab Demo: Lowering the barrier to AI model development

Jeremy Eder, Distinguished Engineer at Red Hat, gives an in-depth demo of InstructLab, a new approach to contributing to and training large language models that combine the power of the open source contributor model with synthetic data generation for creating world-class LLMs. As a core element of the Red Hat Enterprise Linux AI foundation platform, […]

Read More
AI Generative AI Large Language Models

Another glorious battle for AI dominance… GPT-4o vs Google I/O

OpenAI recently announced a new model called GPT-4o, just days before Google I/O. Let’s recap the announcements at Google I/O and determine who is currently winning the artificial intelligence race.

Read More
AI Generative AI Large Language Models

RAG Explained

Oftentimes, GAI and RAG discussions are interconnected. Learn more about about RAG is and how it works alongside your databases, LLMs and vector databases for better results with Luv Aggarwal and Shawn Brennan. AI news moves fast. Sign up for a monthly newsletter for AI updates from IBM → https://ibm.biz/BdmP2c

Read More
AI Large Language Models

How to Run 70Bn Llama 3 Inference on a Single 4GB GPU

This video is from Rohan-Paul-AI. Code : https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/layered_inference_with_airllm_70B_LLM_Inference_on_a_Single_4GB_GPU.ipynb Airllm Github – https://github.com/lyogavin/Anima/tree/main/air_llm

Read More
AI Large Language Models

GraphRAG: LLM-Derived Knowledge Graphs for RAG

This video is from Alex Chao. GraphRAG is a research project from Microsoft exploring the use of knowledge graphs and large language models for enhanced retrieval augmented generation. It is an end-to-end system for richly understanding text-heavy datasets by combining text extraction, network analysis, LLM prompting, and summarization.

Read More
AI Large Language Models Livestream

How to Run LLMs Locally on Inexpensive Hardware

This weekend, I had some fun installing Ollama on my existing hardware with varying results. The surprise winner? The Dell R630 handled the LLM workload best of all my old machines. I streamed this on FranksWorldTV.

Read More
AI Generative AI Large Language Models

How To Run Llama 3 8B, 70B Models On Your Laptop (Free)

Unlock the power of AI right from your laptop with this comprehensive tutorial on how to set up and run Meta’s latest LLaMA models (8B and 70B versions). Written guide.

Read More
AI Generative AI Large Language Models Natural Language Processing

How to Create Dataset Locally with Retrieval Aware Fine-tuning (RAFT)

This video from Fahd Mirza introduces RAFT which is a recipe to adapting LLMs to domain-specific RAG. Retrieval Aware Fine-tuning (RAFT) trains LLMs for best performance.

Read More
AI Generative AI Large Language Models Livestream

LLMs, Latent Spaces, and More

This video is from FranksWorldTV.

Read More