cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Rajat-TVSM
by New Contributor III
  • 166 Views
  • 2 replies
  • 1 kudos

Documentation on all ways to access agent serving endpoint from outside databricks

Struggling to find clear documentation which can help me with the subject. Need to know all the ways (production best practices) along with API method. As far as I know, using PAT is not a production best practice

  • 166 Views
  • 2 replies
  • 1 kudos
Latest Reply
Gecofer
Contributor II
  • 1 kudos

Hi @Rajat-TVSM You’re absolutely right that Personal Access Tokens (PATs) are not considered a production best practice. For accessing Agent / Model Serving endpoints from outside Databricks, the recommended and supported approach for production is:S...

  • 1 kudos
1 More Replies
damselfly20
by New Contributor III
  • 616 Views
  • 1 replies
  • 1 kudos

Inference table not working for Gemma 3 12b

Hi, I have a problem regarding the inference table for Gemma 3 12b. If I create a serving endpoint for the model (from system.ai.gemma-3-12b-it) with an inference table, the inference table is being created, but it always stays empty. No matter how m...

create_gemma_serving_endpoint.png
  • 616 Views
  • 1 replies
  • 1 kudos
Latest Reply
Yogesh_Verma_
Contributor II
  • 1 kudos

The endpoint is working since you’re receiving responses, but the inference table isn’t capturing any records. This points to a logging/compatibility issue rather than request handling. Please confirm inference logging is enabled, verify permissions,...

  • 1 kudos