- 2543 Views
- 2 replies
- 32 kudos
Databricks Roadmap AzureThere are a lot of excitement new features coming in 2022. I tried to put them all on one list:Unity catalog (seems that it will exists next to hive metastore and it will be possible to migrate)Control metastore, unity creatio...
- 2543 Views
- 2 replies
- 32 kudos
Latest Reply
Hi @Hubert Dudek​ , We know the world is full of choices. Thank you for choosing us! We would like to thank excellent customers like you for your support. We couldn’t do it without you!
1 More Replies
by
missyT
• New Contributor III
- 730 Views
- 1 replies
- 1 kudos
Hello Python People.Im still going through the motions learning python and have a general question.example = Im creating basic ETL tasks to practice (SQL, SQLite, Excel etc)I can see that to read excel I can use the pyodbc module - or can use Pandas ...
- 730 Views
- 1 replies
- 1 kudos
Latest Reply
do not reinvent the wheel. If what you need exists already, use it.If you only use a few methods of a package you can consider not importing it completely.The cost of importing is not huge, but that depends on the amount of imports and the size of th...
- 1202 Views
- 1 replies
- 7 kudos
Thanks to everyone who joined the Hassle-Free Data Ingestion webinar. You can access the on-demand recording here. We're sharing a subset of the phenomenal questions asked and answered throughout the session. You'll find Ingestion Q&A listed first, f...
- 1202 Views
- 1 replies
- 7 kudos
Latest Reply
Check out Part 2 of this Data Ingestion webinar to find out how to easily ingest semi-structured data at scale into your Delta Lake, including how to use Databricks Auto Loader to ingest JSON data into Delta Lake.
- 1084 Views
- 1 replies
- 0 kudos
I can see an example on how to call the vacuum function for a Delta lake in python here. how to use the same in python %sql
VACUUM delta.`dbfs:/mnt/<myfolder>` DRY RUN
- 1084 Views
- 1 replies
- 0 kudos
Latest Reply
The dry run for non-SQL code is not yet available in Delta version 0.8. I see there is a bug that is opened with delta opensource in git . hope it get resolved soon
- 272 Views
- 0 replies
- 0 kudos
python Vs Scala in Spark Daatricks.we are seeing Datbricks platform is more used with Python language than scala language , and databricks is also enhancing its python API more than the scala API, so is Scala will be past for Spark.Thanks
- 272 Views
- 0 replies
- 0 kudos
- 4987 Views
- 1 replies
- 0 kudos
A job recently began failing with the following error when a python notebook imports the pip package s3fs.ImportError: cannot import name 'maybe_sync' from 'fsspec.asyn' (/databricks/python/lib/python3.8/site-packages/fsspec/asyn.py)
ImportError Tr...
- 4987 Views
- 1 replies
- 0 kudos
Latest Reply
While checking the init script is installing the s3fs version 0.5.2.This version has issues at the moment from the pypi. I have tested version 0.6.0 that works fine. please change your requirement.txt file with a newer version of s3fs. Below is the p...
