1113 points•516 comments•2w ago•by jms703•semgrep.dev ↗

GLM 5.2 beats Claude in our benchmarks

Semgrep's IDOR benchmark shows GLM-5.2, an open-weight model, achieving 39% F1 on IDOR detection with a prompt-only setup, beating Claude Code at 32% in the same test. The Semgrep Multimodal pipeline leads the results, recording 61% and 53% F1 in its two configurations, indicating the harness around the model provides substantial performance gains. GLM-5.2's open-weight run cost about $0.17 per vulnerability found.

Discussion (516)

No comments yet

Top
Trending
New
For You
Bookmarks
Dossier