Post #2011535

I was talking to ChatGPT about how its brain works, and why people always thought local minima would kill this sort of thing. "In very high dimensions, true isolated local minima are comparatively rare, and most 'stuck' behavior is dominated by saddle structure—points with both stable and unstable directions. In other words, not pits but passes. 'There’s always another direction to go in' is almost literally the statement that the Hessian has mixed signs—hyperbolic structure rather than purely positive curvature." I love it when it gets hyperbolic