Skip to main content

SecretLLM

Secret Large Language Model (SecretLLM) leverages trusted execution environments (TEEs) for secure inference. By running entirely within TEEs, this ensures robust data privacy and protection, making it ideal for sensitive applications. It provides cutting-edge capabilities alongside strong security features, including:

  • OpenAI-compatible API.
  • Integration with NVIDIA Confidential Computing.
  • State-of-the-art models.
  • Privacy-preserving operations enabled by TEEs.