It's on you to make your designs user friendly.
If use of your design is ambiguous and fails to predict human behavior, you don't get to escape by calling everyone ELSE an idiot. If you failed to adhere to conventions and designed a car with the brake pedal on the right, drivers are not idiots for crashing. If you're teaching a class and everyone fails your test, the problem is not that the whole class is lazy. If you make a website for your restaurant and people constantly call you asking what the hours are, you might want to move the hours to a more noticable place.
I find fault with anyone who thinks "I'm smart, the rest of the world is full of idiots."