Databricks
[Sign up for Databricks](https://www.databricks.com/try-databricks#account)
Notes:
- Since Databricks provides a full completions endpoint, ending with “invocations” for “serving-endpoints”, use of directEndpoint setting is required.
- titleMessageRole set to “user” is also required for title generation, as singular “system” messages are not supported.
librechat.yaml
- name: 'Databricks'
apiKey: '${DATABRICKS_API_KEY}'
baseURL: 'https://your_databricks_serving_endpoint_url_here_ending_with/invocations'
models:
default: [
"databricks-meta-llama-3-70b-instruct",
]
fetch: false
titleConvo: true
titleModel: 'current_model'
directEndpoint: true # required
titleMessageRole: 'user' # required