cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Erik
by Valued Contributor II
  • 9334 Views
  • 22 replies
  • 15 kudos

How to enable/verify cloud fetch from PowerBI

I tried to benchmark the Powerbi Databricks connector vs the powerbi Delta Lake reader on a dataset of 2.15million rows. I found that the delta lake reader used 20 seconds, while importing through the SQL compute endpoint took ~75 seconds. When I loo...

query_statistics query_profile_tree_view
  • 9334 Views
  • 22 replies
  • 15 kudos
Latest Reply
pulkitm
New Contributor III
  • 15 kudos

Guys, is there any way to switch off CloudFetch and fall back to ArrowResultSet by default irrespective of size? using the latest version of Spark Simba ODBC driver?

  • 15 kudos
21 More Replies
DianGermishuiz1
by New Contributor III
  • 3640 Views
  • 7 replies
  • 4 kudos

Resolved! Unsupported cloud file system schema 'wasbs' error in custom catalog, but not in hive_metastore

When trying to run a create table USING CSV that pulls data from an azure blob storage path in a custom catalog I created, I get an error stating Unsupported cloud file system schema 'wasbs'.However, when I run this code in the hive_metastore catalog...

wasbs cloud path unsupported error
  • 3640 Views
  • 7 replies
  • 4 kudos
Latest Reply
youssefmrini
Honored Contributor III
  • 4 kudos

WASB Has been deprecated.

  • 4 kudos
6 More Replies
data_testing1
by New Contributor III
  • 28269 Views
  • 7 replies
  • 13 kudos

Can databricks be used locally to learn it or is it cloud only

I'm tired of telling clients or referrals I don't know databricks but it seems like the only option is to have a big AWS account and then use databricks on that data. Can I download it locally for training, upskilling with python or is it only for cl...

  • 28269 Views
  • 7 replies
  • 13 kudos
Latest Reply
Kaniz
Community Manager
  • 13 kudos

Hi @Andrew Schell​, We haven't heard from you on the last response from @Hubert Dudek​ , and I was checking back to see if his suggestions helped you. Or else, If you have any solution, please share it with the community as it can be helpful to other...

  • 13 kudos
6 More Replies
edwardh
by New Contributor III
  • 2056 Views
  • 9 replies
  • 7 kudos

Resolved! How to call Cloud Fetch APIs?

About Cloud Fetch mentioned in this article:https://databricks.com/blog/2021/08/11/how-we-achieved-high-bandwidth-connectivity-with-bi-tools.htmlAre there any public APIs that can be called directly without ODBC or JDBC drivers? Thanks.

  • 2056 Views
  • 9 replies
  • 7 kudos
Latest Reply
edwardh
New Contributor III
  • 7 kudos

Hi @Kaniz Fatma​, can you please give some help on this question? Thanks

  • 7 kudos
8 More Replies
aldrich_ang
by New Contributor II
  • 4065 Views
  • 4 replies
  • 4 kudos

Resolved! How do you use cloud fetch?

We're trying to pull a big amount of data using databricks sql and seem to have a bottleneck on network throughput when fetching the data.I see there's a new feature called cloud fetch and this seems to be the perfect solution for our issue. But I do...

  • 4065 Views
  • 4 replies
  • 4 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 4 kudos

Trying to get an idea of what you are trying:so you query directly on a database of +100GB or is it parquet/delta source?Also, where is the result fetched to? File download, BI tool, ...?

  • 4 kudos
3 More Replies
User16826994223
by Honored Contributor III
  • 739 Views
  • 2 replies
  • 0 kudos

What is the differentiator between delta sharing and other cloud sharing platform

What is differentiator between delta sharing and other cloud sharing platform.

  • 739 Views
  • 2 replies
  • 0 kudos
Latest Reply
User16752244127
Contributor
  • 0 kudos

Also, unlike other servers, Delta Sharing internally uses pre-signed URLs to S3, GCS, or ADSL, so data transfer from a client happens at the bandwidth of the underlying cloud object-store. This way the Delta Sharing server scales extremely well and d...

  • 0 kudos
1 More Replies
Labels