Not all customers are going to bring their own LLM provider to plotly - many customers download plotly studio will expect the product to come with AI providers natively. To support these users, we should enable a pathway for our AI features to work as a service for users, so that they don't need to bring their own keys to external providers to use plotly AI.
We can explore whether we service these requests through our own approach to provisioning keys to our default LLM provider, through a technology such as Openrouter, or by providing locally managed LLMs for these requests. The choice of which provider to use can vary based on the users subscription - we do not have to provide every user with the same option here, just the best quality LLM we can provide at a reasonable price point for the volume of requests they are likely to make and how much they are paying.Please authenticate to join the conversation.
In Review
Plotly Cloud
AI
About 1 year ago

Louis Huard
Get notified by email when there are changes.
In Review
Plotly Cloud
AI
About 1 year ago

Louis Huard
Get notified by email when there are changes.