Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-22-2025 05:50 AM
Hello @rohith_23
Good day!!
Thank you for sharing the details.
These errors are typically related to connectivity issues between your Databricks SQL warehouse and the Hive Metastore (HMS), often triggered by high concurrency overwhelming the metastore's connection handling.
1. Increase Client Socket Timeout:
spark.hadoop.hive.metastore.client.socket.timeout 1800
2. Increase HMS Client Pool Size:
spark.databricks.hive.metastore.client.pool.size 32
3. Migrate to Unity Catalog (Long-Term Fix)
Hive Metastore is legacy and prone to these scalability issues. Switch to Unity Catalog (UC), which is Databricks' modern metadata layer—it's more reliable, supports fine-grained access, and avoids HMS bottlenecks.
how to migrate to unity catalog:
I hope this helps.
Thank you.
