Skip to content

DEV Community

# llm

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Apr 30

KVQuant: Run 70B LLMs on 8GB RAM with Real-Time KV Cache Compression

#python #llm #ai #opensource

1 min read

Charles Wu for seekdb

Apr 30

I Built a Knowledge Base That Thinks — Inspired by Karpathy’s LLM Wiki

#ai #productivity #llm #bigdata

6 min read

Apr 30

Cencori: A Serverless Infrastructure Layer for Secure and Scalable AI Applications

#ai #llm #security #serverless

5 min read

Apr 30

KVQuant: Run 70B LLMs on 8GB RAM with 4-bit KV Cache Quantization

#python #llm #quantization #optimization

1 min read

Badri C

Apr 30

Securing Agentic Workflows: A Deterministic 'Human-in-the-Loop' Pattern for LLMs

#agents #architecture #llm #security

5 min read

Paulo Victor Leite Lima Gomes

Apr 30

software engineers are becoming reliability engineers for generated output

#ai #softwareengineering #reliability #llm

5 min read

Grega Snoj

May 4

I just wanted to chat with my Raspberry Pi.

#ai #python #raspberrypi #llm

9 min read

Apr 30

Fix Your Prompt Structure Before You Touch Your Infrastructure

#ai #llm #rag #machinelearning

4 min read

Apr 30

Why File-to-Markdown Conversion Is Becoming an AI Input Layer

#markitdown #llm #ai

7 min read

Apr 30

I Compressed GPT-2 to Run on an Arduino

#llm #embedded #tinyml #python

1 min read

Apr 29

How LLMs Memorize Phone Numbers (and How Labs Stop It)

#ai #llm #security #privacy

7 min read

Magicrails

Apr 29

I Let My AI Agent Run Overnight. It Cost $437.

#agents #ai #devjournal #llm

5 min read

Christopher Maher

Apr 29

TurboQuant on a MacBook Pro, part 2: perplexity, KL divergence, and asymmetric K/V on M5 Max

#ai #llm #kubernetes #opensource

8 min read

Eli Hadam Zucker

Apr 29

Why I'm Building a Local-First AI Coding Workspace (And How Behavioral Routing Makes It Work)

#ai #rust #llm #webdev

6 min read

Apr 29

Prompt Caching Works. Your Prompt Assembly Code Does Not.

#ai #llm #rag #machinelearning

4 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.