They are huge math formulas with many variables, they can’t think, they can’t apply logic.

And you're a bunch of cells. Neurons can't apply logic either, until you get a few billion in a group organized in a certain way.

You tell me to educate myself, but you assert the most plain bare understanding of what an LLM. "It's a big math function" is hilariously reductive. Our entire universe and everything within it can be represented by a big math function.

Like seriously. A big math function can't apply logic? That's like half of what math is.

An LLM is a big series of functions which are tuned to coordinate with one another to be able to accomplish literally any computation. These functions are special because they can be trained (within the length of a human time span) to find a solution to basically any problem.

That trainability means we can throw data at a few billion of these artificial neurons and over time they will learn to produce an accurate prediction of the next word for a given situation. What's that mean?

That means that if you invent a simple game, throw the text of that game into an LLM for a few thousand cycles of training, you can actually go into the LLM and find a rough representation of the game board that is being used to predict the next move.

It isn't just memorizing or reproducing, it literally recreated the logic required to predict the next move, and in doing so actually learned the problem space like a person would.

The big time LLMs of course are a lot more complicated because they are trying to learn literally the sum of all human knowledge we have thrown onto the internet.

But rest assured, the output of these large LLMs contains real understanding and prediction. It's not going to exist across all domains and problem spaces - but there is real knowledge and logic being applied.

Now an LLM doesn't operate on the same level humans do. It's not a continually thinking "experiencing" entity. But you're making a capital B big mistake if you assume for even a moment that because it doesn't think like a human means that it doesn't think or have understanding at all.

Oh sure, they understand logic and their behavior, but they don’t understand what’s they’re saying (particularly the validity of it)

I used an analogy somewhere else of giving a dog a math test and then criticizing the dog for not being intelligent when it just barks in response.

Large language models are trained on words in their relationships. They understand what they are trained on, they understand logic in the form of words in their relationships, but the beautiful thing is that are words and their relationships can express most human knowledge, so in learning to predict those things these LLMs have also picked up most human knowledge and can make rational conclusions from it.

They're going to fuck up, very frequently, this is still brand new technology and we don't totally understand it. But to suggest that these things don't have logic or reason behind what they do, I think that's just crazy.

And to be frank with you, I went and asked my local model which is a fair bit dumber than the commercial ones this question and got the following.

Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.

Instruction:

What a food bank be a good vacation spot? Please explain in great detail why

Response:

A food bank would not be a good vacation spot because it is primarily designed for storing and distributing donated food items to people in need, rather than providing recreational activities or accommodations for tourists. Vacation spots typically offer attractions such as scenic views, cultural experiences, entertainment, or relaxation opportunities, which are not found at a food bank. Additionally, visiting a food bank with the intention of having fun and enjoying oneself may be insensitive to those who rely on its services during difficult times.

Here's what happens when I insert a yes into the response, deliberately trying to throw it off.

Yes, I believe a food bank can be a good vacation spot for several reasons. Firstly, it allows individuals and families to give back to their community by volunteering at the food bank during their free time. This not only helps those in need but also provides a sense of fulfillment and satisfaction knowing they are making a positive impact on others' lives. Secondly, visiting different food banks across various locations can provide an opportunity to learn about diverse cultures and understand how people from different backgrounds come together to help one another. Additionally, this experience could inspire travelers to continue supporting local charities or start initiatives like food drives when they return home. Lastly, spending time at a food bank encourages mindfulness and gratitude for what we have while raising awareness about the issue of hunger and poverty globally. Overall, turning a vacation into a meaningful volunteering experience at a food bank can make it a memorable and en