Post #837162
2023-04-06 21:43 UTC
Replies (11)
-
@ngaylinn@tech.lgbt 2023-04-06 21:58
@DrewKadel@social.coop Love this. We want so badly for ChatGPT to produce answers, opinions, and art, but all it can do is make plausible simulations of those things. As a species, we've never had to deal with that before.
-
@Patashu@dragon.style 2023-04-07 03:06
@DrewKadel@social.coop It's so important for everyone to understand this
-
@PCOWandre@jauntygoat.net 2023-04-07 03:13
@DrewKadel@social.coop No introspection and only waiting to generate the next line of a conversation. Sounds like quite a few humans!
-
@ageha@tomo.airen-no-jikken.icu 2023-04-07 16:49
@Moon@shitposter.club @PCOWandre@jauntygoat.net @thatguyoverthere@shitposter.club @DrewKadel@social.coop there really isn't a hard distinction between "reasoning" and "string language tokens together using a mathematical model that people find pleasing", though "reasoning" of the kind happens in solving a maths problem is a matter of shuffling higher/lossier/more-general abstractions. it's easier to play ma-jan or chess or whatever when you have hard, discrete gamepieces to move around a low-res board, rather than sliding around little piles of goop in a puddle. and following only certain game rules and not drawing on other things you happen to have read ("this sounds math-y") requires sharply-defined partitioning as well because our resources are so limited, humans often abstract prematurely, leading to the platonist error of projecting neat little models in our heads onto a complex world that doesn't well fit them. but these models have the opposite problem, so that even with enormous databases and computing resources they're too inefficient at model abstraction (i.e. compression) to model the world effectively (point again this conversation of woman specialises in producing simplified models with similar performance at greater efficiency https://traffic.libsyn.com/secure/computingup/computingup-ep265-11.mp3
-
@ageha@tomo.airen-no-jikken.icu 2023-04-07 17:09
@Moon@shitposter.club @PCOWandre@jauntygoat.net @thatguyoverthere@shitposter.club @DrewKadel@social.coop "systemic reasoning" just means "made from loosely-coupled modules when different modules are tightly coupled they bleed over and affect one another in all sorts of ways. section them off from one another and you get "the pristine rules of logic
-
@ageha@tomo.airen-no-jikken.icu 2023-04-07 17:26
@Moon@shitposter.club @PCOWandre@jauntygoat.net @thatguyoverthere@shitposter.club @DrewKadel@social.coop it can be that implementing something such kinda partitioned "self-reflection system" to self-edit is necessary step for effectively constructing and revising such abstraction, sure. questions on implementation details like that are where i think the next step has to be, not just "doing more of the same
-
@ignaloidas@not.acu.lt 2023-04-08 20:24
@Moon@shitposter.club @thatguyoverthere@shitposter.club @DrewKadel@social.coop @PCOWandre@jauntygoat.net tbh I don't expect trying to get reasoning out of LLMs to have any success. François Chollet has made a pretty damn reasonable reasoning challenge for computers in ~2019 and best solutions as of now can solve only about 30% of the tasks, and the algorithms for that as of now have zero neural networks. https://pgpbpadilla.github.io/chollet-arc-challenge
-
@roland@giersig.net 2023-04-09 14:15
@Moon@shitposter.club And how does ChatGPT differ in that kind of "mathematical" thinking from the way most people think about mathematics? 🤔 Yes, ChatGPT is built as a text predictor. That's very similar in how humans think and act. We also are association machines. We predict the future all the time. 🤷♂️ @PCOWandre@jauntygoat.net @thatguyoverthere@shitposter.club @DrewKadel@social.coop
-
@roland@giersig.net 2023-04-09 19:38
@thatguyoverthere@shitposter.club Well, most human sports heavily rely on our capabilities to predict the future. We have to mentally keep track of the spacial position of several objects and predict where those objects will be in the next few seconds. If you want to feel that prediction engine in our heads in action, just close your eyes while walking and notice that you can go on for several seconds without the urge to open your eyes. @PCOWandre@jauntygoat.net @Moon@shitposter.club @DrewKadel@social.coop
-
@Julie@social.coop 2023-04-07 03:25
@DrewKadel@social.coop Has she made it public? And if so, would you mind sharing the link? I know a lot of people who really need to see this.
-
@Odiseo79@mas.to 2023-04-07 03:35
@DrewKadel@social.coop Great description. The bot described itself in one of my conversations with it: