[ He'd had enough the moment he got drunk enough to think inviting Joshua over was not going to end poorly for all his secrets. ]

Not if he won't tell you anything. It might seem strange to Hisoka who has never needed to ask, but if he has problems with you they won't get addressed unless he tells you. And if he does tell you, you need to respect them.