Post #479522

I vibe-coded a tool to explore embedding models - it's just a page that calls out to llama-server and renders the computed values as pixels. I tried the embeddinggemma model and noticed there are some "hot elements" (like "hot pixels" on a camera sensor), always stuck to some out-of-distribution value. Why? Is it some model marker? No one looked at it prior to release? Does it fulfill a function? How does it affect comparisons? It's like if a hash function always had some bits set to 0 or 1...