Databricks Community

pemidexx · 11-22-2024

I am trying to pass a column of data from python/pandas to Spark, then run AI_QUERY. However, when I attempt to pass modelParameters (such as temperature), the function fails. Below is a minimal example: import pandas as pdqueries = pd.DataFrame([ ...

pemidexx

@brian_law In the section above on HuggingFace cache you recommend using DBFS for the model cache. Can a shared path (such as a Workspace of Volume) be used as well?

pemidexx

@Daniel-Liden Thanks for this great post - I appreciate the concise overview. It's been a few months now - is this still a recommended way to proxy LLM calls? And if so, where do you recommend serving the LiteLLM proxy?If it helps, my use case is con...

pemidexx · 11-22-2024

Hi @Walter_C , yes, I am receiving this error when only attempting to set temperature, which should be supported on most if not all models, including the specific models I'm working with. The error message seems to indicate this is a problem with AI_...

Databricks Community

User Stats

User Activity

AI_QUERY does not accept modelParameters argument

Re: Introducing the DeepSpeed Distributor on Databricks

Re: Simplifying Multi-Model LLM Development: A Developer’s Guide to LiteLLM and Databricks

Re: AI_QUERY does not accept modelParameters argument