• 0 Posts
  • 25 Comments
Joined 11 months ago
cake
Cake day: March 22nd, 2025

help-circle

  • In my opinion the proper solution is to ask for the constraints. Similar to the “walk or drive to the car wash” problem LLMs still tend to get confused but a familiar format and don’t notice this problem doesn’t make sense. You can actually play around with different examples to see how crazy the problem has to get form an LLM to refuse to answer and what biases or constraints does it have. Even if they assume some constraints they fail to solve this puzzle surprisingly often (like I showed for Sonnet 4.6 in other comment).




  • I kind of get it. It looks a little bit scary so you flash it and some intrusive guy should get the message and fuck of. Probably as effective as spring knife would be but more fancy looking. As an actual self defense weapon it would be useless. I would be easy to close the distance fast and knock it out. I guess this is part of the appeal. It looks scary but is not really that dangerous. Knife would be a better weapon but that’s exactly you don’t want to carry a knife around. It turns any fight in a life or death situation while a big lighter like this is just a prop. Anyway, just get some pepper spray.




  • It’s not about a solution. It’s about how they react.

    Fist, this “puzzle” is missing the constraints on purpose so “smart” thing to do would be to point that out and ask for them. LLMs are stupid and are easily tricked into thinking it’s a valid puzzle. They will “solve it” even though there’s no logical solution. It’s a nonsense problem.

    Older models would straight out refuse to solve it because the questions is to controversial. When asked why it’s controversial they would refuse to elaborate.

    Newer model hallucinate constraints. You have two options here. Some models assume “priest can’t stay with a child” which indicates funny bias ingrained in the model. Some models claim there are no constraints at all. I haven’t seen a model which hallucinate only “child can’t stay with candy” constraint and respond correctly.

    Sonnet 4.6, one of the best models out there claims that “child can stay alone with candy because children can’t eat candy”. When I pointed out that that’s dumb it introduced this constraint and replied with:

    That’s one of the best models out there…