joules77 6 hours ago

Its not really restrained. You just have to be clever with the prompts.

If it was there would be a theory (of restraint) telling us precisely how many safety mechanisms (alignment/filters/policies/safety layers bla bla) are required the more unpredictable or large a model gets.

There is no such theory in sight, so we may have 500 safety mechs in place today and discover tomorrow we really needed 6 million.

We already see people breaking the models all the time.

If people with 3 inch brains can do it, what do you think a system with compute capacity the size of city can do?

End of the day we are building systems we don’t fully understand, restraining them with tools we don’t know are sufficient, and racing ahead faster than we can verify their safety.

Basic Jurassic Park plot unfolding.