Databricks Community

mshettar · 06-06-2023

databricks workspace export_dir / export command with overwrite option enabled adds non-existent changes in the target directory. 1. It introduces new line deletion and 2. add/deletion of MAGIC comments despite not making any meaningful changes in th...

mshettar · 03-30-2023

Reading from an HBase table with a few hundred records that haven't been persisted (flushed) to HDFS doesn't show up in Spark. However, the records become visible after forced flush via Hbase shell or system triggered flush (when size of Memstore cro...

mshettar · 04-03-2023

Hi @suteja,Thank you for the response. I didn't make myself clear on unflushed writes being visible after initial flush, I have explained it below. Our concern is with regards to the step 3. Per our assumption, the ten unflushed records shouldn't be ...

Databricks Community

User Stats

User Activity

Databricks CLI's workspace export_dir command adds unnecessary edits despite not making any change in the workspace

newAPIHadoopRDD Spark API doesn't retrieve unflushed data written to Hbase table

Re: newAPIHadoopRDD Spark API doesn't retrieve unflushed data written to Hbase table