Skip to content
FloTorch

FloTorch SDK Overview

Overview

Section titled “Overview”

The FloTorch SDK provides typed, high-level clients for building AI apps against the FloTorch Gateway and Workspace services. It currently includes:

  • LLM: FlotorchLLM for sync and async model invocations
  • Memory: FlotorchMemory / FlotorchAsyncMemory for user/agent/app memories and FlotorchVectorStore / FlotorchAsyncVectorStore for vector store search
  • Session: FlotorchSession / FlotorchAsyncSession for structured conversational sessions and event streams

Use the sidebar to dive into each module.

Installation

Section titled “Installation”
Terminal window
pip install flotorch[sdk]

Configuration

Section titled “Configuration”

All SDK clients require your FloTorch API key and the base URL of your deployment.

API_KEY = "<your_api_key>"
BASE_URL = "https://gateway.flotorch.cloud"

Next steps

Section titled “Next steps”
  • See LLM, Memory, and Session pages for full APIs and advanced usage.
  • Prefer async variants for high-throughput or I/O-bound workloads.