📄️ Overview
Continuum consists of two parts: the server side and the client side. The server side hosts the AI service and processes prompts securely. The client side verifies the server, encrypts the prompts, and sends inference requests.
📄️ Prompt Encryption
Continuum uses end-to-end encryption to protect user data from being accessed by the service provider. Prompts are encrypted on the client side, decrypted within runtime-encrypted Continuum workers, and re-encrypted before being returned to the client.
📄️ Runtime Encryption
While encryption in transit (TLS) and at rest (disk encryption) have become widespread, confidential computing completes data protection.
📄️ Attestation
Continuum verifies the CVM's attestation statement to ensure that the involved services and workloads run on trusted hardware.
📄️ Sandboxing
The inference code is provided by an external party, such as HuggingFace TGI, vLLM, NVIDIA Triton, and is frequently updated.