Show HN: Parsimony – an open-source benchmark for how much code AI models add
Existing benchmarks measure solve rate and token output/cost, but don't punish excess code, which makes a codebase harder to work with in the long term. I wanted to measure this since it matters most for long-term projects.<p>Method: it takes the patches that benchmarks already publish (DeepSWE, SWE-bench Verified, SWE-bench Live) and counts "coding units": syntax elements like statements, calls, names and literals. I didn't use lines of code, so cramming code isn't rewarded. Deleted code is subtracted, so it measures net units.<p>GPT-6 and Claude 5.5 have no public patches yet, so I ran them myself on 3–10 tasks on my own subscriptions (shown as faded circles, not ranked).<p>Any feedback or model contributions are welcome, especially public patch exports for newer models.<p>GitHub: <a href="https://github.com/La5u/Parsimony" rel="nofollow">https://github.com/La5u/Parsimony</a><p>Not affiliated with any of the benchmarks.
Wettbewerber & Alternativen
Show HN: PaperMono, e-ink fridge magnet shopping list with mobile web page
Fridge magnet shopping list on an M5Stack PaperMono (ESP32-S3, e-ink touchscreen), synced with a phone web app over Wi-…
Show HN: Zero-axiom Lean 4 proof that Yang-Mills on R^4 is a "round square"
On October 26, OpenAI announced a claimed "bare existence" proof in Balaban's RG programme on pure R^4—but notably stop…
Show HN: Doom or Bloom, map your AI worldview
Map your AI worldview by answering a few questions, and see how you compare with others.<p>only takes a few minutes &&…
Show HN: HackerRepos – HackerTube for repos mentioned on HN
Karpathy posted hackertube.org 5 days ago, and mentioned that it took him 2 hours to build. A day after another fellow…
Show HN: I finetuned 1.5B Qwen to near GPT-4o level bash generation perf
Purely a hobby side project to see how far I can push a really small model, using (mostly) automated training pipelines…