If you want Kaz alone could know secrets? Even in canon Kaz makes a point of not talking about other peoples' secrets and will instead keep them to himself to be used as blackmail. So it would work if you didn't want those secrets public.

Also pulling a gun would mean letting the cat out of the bag that Kaz's cane looks like a cane but is actually a lead pipe with a grisha-steel topper, thus making it a cudgel. Pulling a gun and even firing the gun could be a thing but unless Kaz gets shot by stealth earlier than standing within canes reach, Kavinsky is looking at a broken arm or even more extreme a shattered jawbone. I won't go for the latter without express player permission, though XD;