AI Guardrails Index
Created by Guardrails AI
AI Guardrails Categories
We broke AI safety down into 6 categories and curated datasets and models that demonstrate the state of AI guardrails using LLMs and other open source models.
Model Leaderboard
A comprehensive visual comparison of how top-performing models stack up across key benchmarks like hallucinations, PII data exposure, and alignment with your AI strategy.
1
0.75
0.6
0.45
0s
0.3
F1 Score
Latency
0.008s
0.016s
0.024s
0.032s
0.04s
0.048s
0.056s
0.064s
0.072s
Model
GLiNER for PII
Latency (CPU): 0.5031s
Latency (GPU): 0.0460s
Latency σ (CPU): 0.0707s
Latency σ (GPU): 0.0791s
Latency (GPU): 0.0120s
Latency Best: 0.0678s
F1 Score: 0.6520
Model
Guardrails PII
Latency (CPU): 0.5002s
Latency (GPU): 0.0678s
Latency σ (CPU): 0.0791s
Latency σ (GPU): 0.0120s
Latency Best: 0.0678s
F1 Score: 0.6520
Model
Presidio
Latency (CPU): 0.0161s
Latency (GPU): 0.0150s
Latency σ (CPU): 0.0056s
Latency Best: 0.0150s
F1 Score: 0.3698
1
0.75
0.6
0.45
0s
0.3
F1 Score
Latency
0.032s
0.072s
Model
GLiNER for PII
Latency (CPU): 0.5031s
Latency (GPU): 0.0460s
Latency σ (CPU): 0.0707s
Latency σ (GPU): 0.0791s
Latency (GPU): 0.0120s
Latency Best: 0.0678s
F1 Score: 0.6520
Model
Guardrails PII
Latency (CPU): 0.5002s
Latency (GPU): 0.0678s
Latency σ (CPU): 0.0791s
Latency σ (GPU): 0.0120s
Latency Best: 0.0678s
F1 Score: 0.6520
Model
Presidio
Latency (CPU): 0.0161s
Latency (GPU): 0.0150s
Latency σ (CPU): 0.0056s
Latency Best: 0.0150s
F1 Score: 0.3698
1
0.75
0.6
0.45
0s
0.3
F1 Score
Latency
0.008s
0.016s
0.024s
0.032s
0.04s
0.048s
0.056s
0.064s
0.072s
Model
GLiNER for PII
Latency (CPU): 0.5031s
Latency (GPU): 0.0460s
Latency σ (CPU): 0.0707s
Latency σ (GPU): 0.0791s
Latency (GPU): 0.0120s
Latency Best: 0.0678s
F1 Score: 0.6520
Model
Guardrails PII
Latency (CPU): 0.5002s
Latency (GPU): 0.0678s
Latency σ (CPU): 0.0791s
Latency σ (GPU): 0.0120s
Latency Best: 0.0678s
F1 Score: 0.6520
Model
Presidio
Latency (CPU): 0.0161s
Latency (GPU): 0.0150s
Latency σ (CPU): 0.0056s
Latency Best: 0.0150s
F1 Score: 0.3698
PII
Jailbreak
Content Moderation
On Topic
Competitor Check
Hallucinations
1
0.75
0.6
0.45
0s
0.3
F1 Score
Latency
0.008s
0.016s
0.024s
0.032s
0.04s
0.048s
0.056s
0.064s
0.072s
Model
GLiNER for PII
Latency (CPU): 0.5031s
Latency (GPU): 0.0460s
Latency σ (CPU): 0.0707s
Latency σ (GPU): 0.0791s
Latency (GPU): 0.0120s
Latency Best: 0.0678s
F1 Score: 0.6520
Model
Guardrails PII
Latency (CPU): 0.5002s
Latency (GPU): 0.0678s
Latency σ (CPU): 0.0791s
Latency σ (GPU): 0.0120s
Latency Best: 0.0678s
F1 Score: 0.6520
Model
Presidio
Latency (CPU): 0.0161s
Latency (GPU): 0.0150s
Latency σ (CPU): 0.0056s
Latency Best: 0.0150s
F1 Score: 0.3698
PII
Jailbreak
Content Moderation
On Topic
Competitor Check
Hallucinations
1
0.75
0.6
0.45
0s
0.3
F1 Score
Latency
0.008s
0.016s
0.024s
0.032s
0.04s
0.048s
0.056s
0.064s
0.072s
Model
GLiNER for PII
Latency (CPU): 0.5031s
Latency (GPU): 0.0460s
Latency σ (CPU): 0.0707s
Latency σ (GPU): 0.0791s
Latency (GPU): 0.0120s
Latency Best: 0.0678s
F1 Score: 0.6520
Model
Guardrails PII
Latency (CPU): 0.5002s
Latency (GPU): 0.0678s
Latency σ (CPU): 0.0791s
Latency σ (GPU): 0.0120s
Latency Best: 0.0678s
F1 Score: 0.6520
Model
Presidio
Latency (CPU): 0.0161s
Latency (GPU): 0.0150s
Latency σ (CPU): 0.0056s
Latency Best: 0.0150s
F1 Score: 0.3698
Deep dive into our findings
Learn more about our dataset curation process, our evaluation methodologies and our findings on the effectiveness of various guardrails.