Go Back

FiddleCube Compliant LLM

github.com
Summary

FiddleCube's Compliant LLM is a toolkit designed to help organizations ensure the security and compliance of their AI agents and MCP servers. It provides features for security testing against various attack strategies and compliance analysis against industry standards like NIST, ISO, and GDPR. The platform supports multiple LLM providers and offers detailed reporting with a visual dashboard for analyzing test results.

Features
6/13
See all

Must Have

3 of 5

API Access

Safety & Alignment Framework

Enterprise Solutions

Conversational AI

Fine-Tuning & Custom Models

Other

3 of 8

Code Generation

Research & Publications

Security & Red Teaming

Image Generation

Multimodal AI

Synthetic Media Provenance

Threat Intelligence Reporting

Global Affairs & Policy

Pricing
Freemium
See all

Free

$0.00 monthly
  • Unlimited public/private repositories
  • Dependabot security and version updates
  • 2,000 CI/CD minutes/month
  • 500MB of Packages storage
  • Issues & Projects
  • Community support

Team

$4.00 per user
Popular
  • Everything included in Free
  • Access to GitHub Codespaces
  • Protected branches
  • Multiple reviewers in pull requests
  • Draft pull requests
  • Code owners
  • Required reviewers
  • Pages and Wikis
  • Environment deployment branches and secrets
  • 3,000 CI/CD minutes/month
  • 2GB of Packages storage
  • Web-based support

Enterprise

$21.00 per user
  • Everything included in Team
  • Data residency
  • Enterprise Managed Users
  • User provisioning through SCIM
  • Enterprise Account to centrally manage multiple organizations
  • Environment protection rules
  • Repository rules
  • Audit Log API
  • SOC1, SOC2, type 2 reports annually
  • FedRAMP Tailored Authority to Operate (ATO)
  • SAML single sign-on
  • Advanced auditing
  • GitHub Connect
  • 50,000 CI/CD minutes/month
  • 50GB of Packages storage
Rationale

FiddleCube's Compliant LLM is a toolkit focused on ensuring the security and compliance of AI systems, which directly aligns with the 'Safety & Alignment Framework' feature. It offers 'Security Testing' against various attack strategies and 'Compliance Analysis' against frameworks like NIST, ISO, GDPR, and HIPAA. The platform supports 'multiple LLM providers via LiteLLM', implying API access. While it doesn't explicitly offer conversational AI or fine-tuning, its focus on testing AI agents and MCP servers suggests an underlying capability to interact with and evaluate LLMs. The GitHub page also mentions 'GitHub Copilot' and 'GitHub Models' which are code generation and AI model management tools, respectively, offered by GitHub itself, not FiddleCube. However, FiddleCube's tool is designed to test AI agents and MCP servers, which are often built using such models and APIs. The 'Enterprise Solutions' feature is supported by their offering of 'Self-hosted or hosted cloud' options and focus on enterprise compliance. The 'Research & Publications' and 'Security & Red Teaming' features are supported by their focus on security testing and compliance, which often involves research into vulnerabilities and red teaming exercises.