cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
andcch552
New Contributor
since Thursday
Thursday

User Stats

  • 1 Posts
  • 0 Solutions
  • 0 Kudos given
  • 0 Kudos received

User Activity

Slow Delta write when creating embeddings with mapPartitions

Thursday
I’m trying to generate 35k+ embeddings in Databricks. What I’ve tried so far:Per-row UDF (very slow).Replaced UDF with rdd.mapPartitions to batch API calls, create one Azure client per partition, and call client.embed_documents(texts) in batches. Thi...