jailbreak-detection

Open repos and models their makers tagged jailbreak-detection, most starred first. The same for everyone.

HomelabRepo

uptrain

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

  • 2.4k
  • Python
  • Apache-2.0
  • 2 y ago
uptrain-aiTake it
AI agentsRepo

little-canary

Detects prompt injection by its effect on a sacrificial canary model, not just pattern matching: untrusted input hits a powerless model first, a behavioral check reads the residue, and it returns block, flag, or pass before your primary model acts. Inbound preflight sensor, not a guarantee.

  • 42
  • Python
  • Apache-2.0
  • 13 d ago
Websites and appsRepo

MASST

Bugsmirror MASST (Mobile Application Security Suite and Tools) is a comprehensive platform for end-to-end mobile application security. It offers threat detection tools for static, runtime, dynamic API testing and red teaming; robust app shielding solution for threat mitigation; threat visibility dashboard; & AI powered insight in a single platform.

  • 2
  • 15 mo ago
bugsmirrorTake it
Search GitHub and Hugging Face for jailbreak-detection

Get , open it once and sign in. Then come back here and press the button again.