Trait Provider 

pub trait Provider: Send + Sync {
    // Required methods
    fn name(&self) -> &'static str;
    fn auth(&self) -> AuthStyle;
    fn encode(&self, request: &Request<'_>) -> HttpCall;
    fn decode(&self, body: &Value) -> Result<Reply, LlmError>;
    fn error(&self, status: u16, headers: &HeaderMap, body: &str) -> LlmError;
}

One wire format. Pure: no network, no clock, no database.

Required Methods

fn name(&self) -> &'static str

Short name for logs and the audit record (anthropic).

fn auth(&self) -> AuthStyle

How the API key goes into the request.

fn encode(&self, request: &Request<'_>) -> HttpCall

The HTTP request of one model call.

fn decode(&self, body: &Value) -> Result<Reply, LlmError>

The reply from a successful response body.

fn error(&self, status: u16, headers: &HeaderMap, body: &str) -> LlmError

The error for a response with a status outside 2xx.

Dyn Compatibility

This trait is dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors

impl Provider for Anthropic

impl Provider for OpenAi