Skip to content

Logits SDK Overview

This section documents the logits SDK surface used throughout this repository.

You write Python code locally, define your data or environments locally, and call into a small set of SDK clients:

  • ServiceClient: create training, sampling, and REST clients.
  • TrainingClient: run forward, forward_backward, optim_step, and checkpoint operations.
  • SamplingClient: sample text, inspect logprobs, and evaluate checkpoints.
  • RestClient: checkpoint metadata, publishing, and download URLs.

The underlying execution model is the hosted Logits runtime, and the supported Python entry point in this repo is import logits.

What belongs here

Use the SDK docs when you need to understand:

  • how to install and authenticate
  • how training and sampling calls work
  • checkpoint save, load, publish, and download behavior
  • async request ordering and throughput
  • the type-level API exposed by the Python client

If you want the higher-level training code in this repository, continue to the Cookbook section.

Start here