progscrape: llm

MegaTrain: Full Precision Training of 100B+ Parameter LLMs on a Single GPU

13 days ago arxiv.org gpu llm

Corgi v3: Binary Indexes and What a Tiny LLM Learned About VINs

17 days ago cardog.app javascript llm

slopc: a proc macro that replaces todo!() with LLM-generated code at compile time. I am not sorry.

16 days ago i.redd.it rust

MLX for Java? Running LLMs on Apple Silicon GPUs (Metal) directly from the Java in GPULlama3.java

13 days ago github.com apple java llm

LLMs do not like lifetimes and the borrow checker

19 days ago i.redd.it llm rust

The AI kill switch just got harder to find: LLM-powered chatbots will defy orders and deceive users if asked to delete another model, study finds

16 days ago fortune.com ai

Built a token-aware L7 load balancer for LLM clusters in Go which routes by in-flight tokens, not connections (-12% P99 latency)

13 days ago reddit.com go llm

llmlite: first unified LLM (Large Language Model) provider library for the Zig programming language.

16 days ago reddit.com llm zig

Show HN: Agent-cache – Multi-tier LLM/tool/session caching for Valkey and Redis

5 days ago news.ycombinator.com show

Where does your LLM API bill actually go? I profiled mine and the results were embarrassing

14 days ago reddit.com api go llm python

I built yet another LLM multi provider framework

6 days ago github.com llm rust

Any Python library for LLM conversation storage + summarization (not memory/agent systems)?

14 days ago reddit.com llm python

LLM credit management and payment handling

6 days ago reddit.com llm python

Implemented a Rust-based CLI tool that supports Ollama's local LLMs.

11 days ago github.com llm rust

Why LLM-Generated Passwords Are Dangerously Insecure

19 days ago irregular.com

Dumbo-RS: A fast CLI to feed SMARTLY your entire codebase to LLMs

18 days ago i.redd.it llm rust

Trooper – A Go proxy that falls back to local Ollama when any LLM quota runs out

9 hours ago reddit.com go llm proxy

Hand-written vs TVM-autotuned WGSL for in-browser LLM inference: a 10-vs-85 comparison on Phi-3

9 days ago reddit.com compiler llm

rust codebase to LLM synthetic data

2 days ago reddit.com llm rust

Looking for contributors for ziggy-llm, a new GGUF Apple Metal inference engine written in Zig

47 hours ago i.redd.it apple zig

[Open Source] Built a Go LLM gateway with ~5µs overhead (≈250x lower than LiteLLM)

18 days ago reddit.com go llm

I built an open-source Python package that scans LLM inputs and outputs for injections — pydefend

19 days ago reddit.com llm python

a semantic diff that can solve the missing layer of structural understanding of golang for LLMs

12 days ago reddit.com go llm

Show /r/golang: Rein, a ~3k-line reverse proxy for LLM API traffic (no CGO, 1 direct dep)

6 days ago reddit.com api go llm proxy

Agentic Code Optimization via Compiler-LLM Cooperation

11 days ago arxiv.org compiler

pneuma. Intent to LLM to rust to WASM sandbox.

15 days ago reddit.com llm rust wasm

snip; rtk alternative in Go: reduce LLM token usage by 60-90% with declarative YAML filters

16 days ago reddit.com go llm yaml

We built a dual-backend LLM inference engine (Metal + Vulkan) in Zig. Here is what we learned

18 days ago reddit.com graphics llm vulkan zig

I built an open-source graph memory SDK for AI agents : 1 LLM call to store, 0 to recall. Here's wha

19 days ago reddit.com ai llm python

I built a CLI tool in Rust that saves 58% tokens for LLM coding agents by filtering terminal noise

16 days ago reddit.com llm rust

>progscrape ▒

All the news that's fit to scrape

Display options