Augmentoolkit

Augmentoolkit is an open-source project hosted on GitHub that focuses on creating custom LLMs and domain-expert datasets. It explicitly mentions the ability to fine-tune models and provides an API for integration. While it doesn't directly offer a 'safety & alignment framework' as a standalone feature, its focus on custom model creation and alignment (e.g., GRPO) implies a degree of control over model behavior. The GitHub platform itself offers enterprise solutions and code generation capabilities (GitHub Copilot), which are relevant to the broader GitHub ecosystem where Augmentoolkit resides. The conversational AI aspect is present through the ability to create and chat with newly trained models.