Skip to main content
Archived

AI Assist to use local AI endpoint

Related products:Integrations
  • February 12, 2024
  • 2 replies
  • 96 views

oliver.morris
Contributor
Forum|alt.badge.img+14

I would like to point the AI Assist to use Ollama - with the standard OpenAI API spec (https://ollama.com/blog/openai-compatibility?ref=upstract.com)

This would allow me to run completely locally and avoid the concerns of running AI Assist over the web to third party sources or incurring costs of models running in the cloud.

 

 

2 replies

danilo_fme
Celebrity
Forum|alt.badge.img+55
  • Celebrity
  • February 12, 2024

I would like to point the AI Assist to use Ollama - with the standard OpenAI API spec (https://ollama.com/blog/openai-compatibility?ref=upstract.com)

This would allow me to run completely locally and avoid the concerns of running AI Assist over the web to third party sources or incurring costs of models running in the cloud.

 

 

@oliver.morris thanks for share us. It may be very interesting. I will check it.


LizAtSafe
Safer
Forum|alt.badge.img+21
  • Safer
  • October 29, 2024
The product team is taking AI assist in a new direction. However, to call any AI API, the OpenAPI transformer in 2024.1 can be used
OpenArchived