FiddleCube Compliant LLM
github.comSummary
FiddleCube's Compliant LLM is a toolkit designed to help organizations ensure the security and compliance of their AI agents and MCP servers. It provides features for security testing against various attack strategies and compliance analysis against industry standards like NIST, ISO, and GDPR. The platform supports multiple LLM providers and offers detailed reporting with a visual dashboard for analyzing test results.
Features6/13
See allMust Have
3 of 5
API Access
Safety & Alignment Framework
Enterprise Solutions
Conversational AI
Fine-Tuning & Custom Models
Other
3 of 8
Code Generation
Research & Publications
Security & Red Teaming
Image Generation
Multimodal AI
Synthetic Media Provenance
Threat Intelligence Reporting
Global Affairs & Policy
PricingFreemium
See allFree
- Unlimited public/private repositories
- Dependabot security and version updates
- 2,000 CI/CD minutes/month
- 500MB of Packages storage
- Issues & Projects
- Community support
Team
- Everything included in Free
- Access to GitHub Codespaces
- Protected branches
- Multiple reviewers in pull requests
- Draft pull requests
- Code owners
- Required reviewers
- Pages and Wikis
- Environment deployment branches and secrets
- 3,000 CI/CD minutes/month
- 2GB of Packages storage
- Web-based support
Enterprise
- Everything included in Team
- Data residency
- Enterprise Managed Users
- User provisioning through SCIM
- Enterprise Account to centrally manage multiple organizations
- Environment protection rules
- Repository rules
- Audit Log API
- SOC1, SOC2, type 2 reports annually
- FedRAMP Tailored Authority to Operate (ATO)
- SAML single sign-on
- Advanced auditing
- GitHub Connect
- 50,000 CI/CD minutes/month
- 50GB of Packages storage
Rationale
FiddleCube's Compliant LLM is a toolkit focused on ensuring the security and compliance of AI systems, which directly aligns with the 'Safety & Alignment Framework' feature. It offers 'Security Testing' against various attack strategies and 'Compliance Analysis' against frameworks like NIST, ISO, GDPR, and HIPAA. The platform supports 'multiple LLM providers via LiteLLM', implying API access. While it doesn't explicitly offer conversational AI or fine-tuning, its focus on testing AI agents and MCP servers suggests an underlying capability to interact with and evaluate LLMs. The GitHub page also mentions 'GitHub Copilot' and 'GitHub Models' which are code generation and AI model management tools, respectively, offered by GitHub itself, not FiddleCube. However, FiddleCube's tool is designed to test AI agents and MCP servers, which are often built using such models and APIs. The 'Enterprise Solutions' feature is supported by their offering of 'Self-hosted or hosted cloud' options and focus on enterprise compliance. The 'Research & Publications' and 'Security & Red Teaming' features are supported by their focus on security testing and compliance, which often involves research into vulnerabilities and red teaming exercises.