Struct Assistant 

pub struct Assistant {
    pub provider: Box<dyn Provider>,
    pub transport: HttpTransport,
    pub model: String,
    pub limits: Limits,
    pub permits: Semaphore,
    pub run_timeout: Duration,
    pub label: String,
    pub provider_name: &'static str,
    pub host: String,
    pub retention_days: u32,
}

The configured assistant of a server.

Fields

provider: Box<dyn Provider>

transport: HttpTransport

model: String

limits: Limits

permits: Semaphore

run_timeout: Duration

Time limit of a whole run.

label: String

provider:model@host, for the log (never the key).

provider_name: &'static str

Provider name and host of the API base, shown to users (privacy).

host: String

retention_days: u32

Days an idle conversation is kept.

Implementations

impl Assistant

pub fn new(config: &AssistantConfig) -> Result<Assistant>