Class Friendli

The Friendli class is used to interact with Friendli inference Endpoint models. This requires your Friendli Token and Friendli Team which is autoloaded if not specified.

Hierarchy (view full)

Constructors

constructor

Properties

baseUrl model frequencyPenalty? friendliTeam? friendliToken? maxTokens? modelKwargs? stop? temperature? topP?

Constructors

constructor

Properties

baseUrl

baseUrl: string = "https://inference.friendli.ai"

model

model: string = "mixtral-8x7b-instruct-v0-1"

Optional frequencyPenalty

frequencyPenalty?: number

Optional friendliTeam

friendliTeam?: string

Optional friendliToken

friendliToken?: string

Optional maxTokens

maxTokens?: number

Optional modelKwargs

modelKwargs?: Record<string, unknown>

Optional stop

stop?: string[]

Optional temperature

temperature?: number

Optional topP

topP?: number

Settings

Member Visibility

Theme

On This Page

Generated using TypeDoc