Showing results for 
Search instead for 
Did you mean: 
since ‎11-05-2022

User Stats

  • 10 Posts
  • 1 Solutions
  • 9 Kudos given
  • 9 Kudos received

User Activity

HelloI having an issue with using a window in pyspark. I created a simple example that reproduce the error, basically i want to define a window with a dynamic size (say from another column ) instead of a fix value  from pyspark.sql import SparkSessio...
I am having this error when running my cluster, any idea why?
I am working on Databricks Notebook and trying to display a map using Floium and I keep getting this error > Command result size exceeds limit: Exceeded 20971520 bytes (current = 20973510)How can I get increase the memory limit?I already reduced the...
HelloI am trying to read this JSON file but didn't succeed  You can see the head of the file, JSON inside a list of lists. Any idea how to read this file?
Python Commanddf ='csv').option('sep', ';').option("recursiveFileLookup", "true").load('dbfs:/***/data_files/PREVISIONS/')Here is the content of the folder  Each folder contain the following files: Full logorg.apache.spark.sql.stre...
Kudos from