Day: May 6, 2024

AI Large Language Models

How to Run 70Bn Llama 3 Inference on a Single 4GB GPU

This video is from Rohan-Paul-AI. Code : https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/layered_inference_with_airllm_70B_LLM_Inference_on_a_Single_4GB_GPU.ipynb Airllm Github – https://github.com/lyogavin/Anima/tree/main/air_llm

Read More
AI Large Language Models

GraphRAG: LLM-Derived Knowledge Graphs for RAG

This video is from Alex Chao. GraphRAG is a research project from Microsoft exploring the use of knowledge graphs and large language models for enhanced retrieval augmented generation. It is an end-to-end system for richly understanding text-heavy datasets by combining text extraction, network analysis, LLM prompting, and summarization.

Read More
AI Ethics

Introduction to the AILI Community

Noelle introduces us to the AILI Community Join us: http://skool.com/aili Learn the skills that took me from a cloud architect to AI Executive, and helped me build a 7-figure business with the power of AI.

Read More
Android Security

Is Your VPN Leaking?

In this video Mental Outlaw discover a VPN leak that was discovered in Android by Mullvad that effects any wireguard VPN in any app that relies on the getaddrinfo function. Read more about it here and test the leak for yourself https://mullvad.net/en/blog/dns-traffic-can-leak-outside-the-vpn-tunnel-on-android

Read More
AI Large Language Models Livestream

How to Run LLMs Locally on Inexpensive Hardware

This weekend, I had some fun installing Ollama on my existing hardware with varying results. The surprise winner? The Dell R630 handled the LLM workload best of all my old machines. I streamed this on FranksWorldTV.

Read More
Windows

Windows 11 Not as Popular as Windows 10 Still

This video from TechLinked covers the abysmal uptake of Windows 11 and some of the reasons why. As for me, I finally have succumbed to FOMO and I’m running Windows 11 on two machines. WSL is implemented better in Windows 11 and, for me, that was reason enough to like it. Either that or Stockholm […]

Read More