DEV Community

Local AI Engineering Notes Series' Articles

Back to Rob's Series
Your GPU Probably Isn't Helping Your Retrieval System

Your GPU Probably Isn't Helping Your Retrieval System

4
Comments 5
4 min read
An AMD GPU Beat My Mac on Llama 8B. The Same GPU Lost on Phi-3.

An AMD GPU Beat My Mac on Llama 8B. The Same GPU Lost on Phi-3.

Comments
5 min read
Cross-Machine Memory Query: About 20 Milliseconds, Most Days

Cross-Machine Memory Query: About 20 Milliseconds, Most Days

1
Comments
9 min read
Brute-Force Retrieval Holds Through 5,000 Memories. Then It Doesn't.

Brute-Force Retrieval Holds Through 5,000 Memories. Then It Doesn't.

3
Comments 2
7 min read
Why Decentralized AI Compute Needs Two Assets, Not One

Why Decentralized AI Compute Needs Two Assets, Not One

3
Comments 1
8 min read
Keep the Credit Ledger Off-Chain. Checkpoint It On-Chain.

Keep the Credit Ledger Off-Chain. Checkpoint It On-Chain.

1
Comments
8 min read
Local AI Needs Data-Plane Health Checks

Local AI Needs Data-Plane Health Checks

3
Comments 1
7 min read