← Feed

Posts

• Post #2577130

  Same energy

• Post #2577129

  Slowly working towards the inference engine I want on Apple Silicon: - MTLSafeTensors: mmap safetensors into MTLBuffers (https://github.com/finnvoor/MTLSafeTensors) - Popcorn: a collection of optimized Metal kernels (https://github.com/finnvoor/Popcorn)

• Post #2327505

  anyone need a Metal-accelerated ascii camera preview in their terminal? no? https://github.com/finnvoor/mirror

• Post #1864132

  Made a lil tui agent entirely in Swift, only dependency is swift-cmark for markdown parsing

• Post #1864130

  I'm fascinated by this section in an Apple paper about how they're using ASTC to compress models to 4 bit, then using the hardware decode to decompress with no overhead. I don't understand how ASTC could ever be even remotely close to 4bit quantization in terms of NRMSE though…

• Post #1864129

  if you want to keep using Claude Pro/Max in pi 🤫 https://gist.github.com/finnvoor/25ca1758cbb358eb7c716976ce85861c

• Post #1864128

  @schwa I wanted a minimal solution so I still get all the same system prompt/etc of pi which seems to work well

• Post #1864127

  @schwa they've made a world-ending new model but still the best they can do is string-matching the system prompt to block requests, I think we'll be fine 😉

• Post #1864126

  I should really release my bezel framing app someday 🤔

• Post #1864125

  @schwa they've employed some advanced security practices but after lots of hard work and reverse engineering we've cracked the code https://gist.github.com/finnvoor/25ca1758cbb358eb7c716976ce85861c

• Post #1864124

  @schwa damn they took all of GitHub down, they really don’t want you using pi

• Post #1864123

  you can just copy things (computer use in pi)

• Post #1864122

  Metal 4 has some really cool looking new features, but pretty much every time I've tried to use one I've gotten either vague errors or kernel panics.

• Post #1864121

  Hugging Face's AnyLanguageModel is an amazing way to make provider-agnostic agents in Swift. Here's a library to use your Claude/Codex subscription with AnyLanguageModel: https://github.com/finnvoor/OAuthLanguageModels

• Post #1315600

  Okay this is *crazy* An agent running entirely on iPad* that can control any app

• Post #911541

  ✨ Run ModernBERT using CoreML https://huggingface.co/finnvoorhees/ModernBERT-CoreML

• Post #749777

  this ain’t it

• Post #742172

  🌐 Still a little rough around the edges, but Navi is an agent that lives in Safari and helps you research and chat with your tabs, à la Dia, Comet, or Claude in Chrome. Sign in with ChatGPT Plus/Pro or Claude Pro/Max, open source, and available on iOS, iPadOS, and macOS. https://github.com/finnvoor/Navi

• Post #674648

  Made a lil agent that lives in Safari on iOS and macOS 🧚

• Post #613370

  Kind of crazy that in a few months my job has gone from writing code to simply sending slack messages