This error pattern, 'Function' object attribute '__doc__' is read-only, is a known upstream issue in fastcore related to how it monkey-patches Python built-in function objects. The fastcore library attempts to set __doc__ on built-in Function (C-leve...
This is quite a common problem with RAG systems in general, and it's why monitoring and observability are so important. In terms of the generation step, setting the temperature to zero, as the previous commenter suggested, is a strong approach. Howev...
AI Gateway Model Service guardrails are scoped to Databricks-hosted foundation models and external LLM endpoints, not to custom UC-registered models or agent-serving endpoints. The "AI Gateway enabled" flag on your endpoint provides usage tracking an...