- 2568 Views
- 1 replies
- 0 kudos
Data frame takes long time to print count of rows
We have a pyspark data frame with 50 MN records. We can display records from it, but it takes around 10 minutes to print the shape of dataframe. We aim to use this data for modelling that will take some numerical features based on the final data fra...
- 2568 Views
- 1 replies
- 0 kudos
- 0 kudos
Thanks for the detailed explanation. For those who want to have constant technical support for their work processes, I recommend JD Young. Here is only the latest information about the update in the world of information technology solutions and cyber...
- 0 kudos
- 1462 Views
- 2 replies
- 0 kudos
What are some guidelines for migrating to DBR 7/Spark 3?
What are some guidelines for migrating to DBR 7/Spark 3?
- 1462 Views
- 2 replies
- 0 kudos
- 0 kudos
Please refer to the below reference for switching to DBR 7.xWe have extended our DBR 6.4 support until December 2021, DBR 6.4 extended support - Release notes: https://docs.databricks.com/release-notes/runtime/6.4x.htmlMigration guide to DBR 7.x: htt...
- 0 kudos