cancel
Showing results for 
Search instead for 
Did you mean: 
Community Discussions
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

KVK
by New Contributor II
  • 233 Views
  • 1 replies
  • 0 kudos

Unable to reset my Community edition password

I created a new Databricks community account a few days ago. Unfortunately, I seem to have forgotten the password associated with it. Despite trying the "forgot password" option multiple times on the login page, I haven't received any emails to reset...

  • 233 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz
Community Manager
  • 0 kudos

Hi @KVK, Please look at this link related to the Community - Edition, which might solve your problem.   I appreciate your interest in sharing your Community-Edition query with us.   If you have any more questions or concerns, please don't hesitate to...

  • 0 kudos
radix
by New Contributor
  • 153 Views
  • 1 replies
  • 0 kudos

Liquid clustering on and dynamic overwrites

I use the following option to write from multiple tasks to the same table with overwrite (in Pyspark).option("partitionOverwriteMode", "dynamic")The table was created with partition by so it works as expected.I read about liquid clustering and it's b...

  • 153 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz
Community Manager
  • 0 kudos

Hi @radix, Liquid clustering is an innovative approach that simplifies data layout decisions and optimizes query performance in Delta tables. What is Liquid Clustering? Liquid clustering replaces traditional table partitioning and ZORDER techniq...

  • 0 kudos
DavidKxx
by New Contributor III
  • 310 Views
  • 1 replies
  • 0 kudos

Resolved! pandas .style is ugly in Databricks

Why does something like      df.style.hide_index()     turn out so ugly in Databricks?  That command should show the dataframe pretty like always, but simply with the index column concealed.  Instead, here's an image of what happens instead (displayi...

Screenshot 2024-03-11 111410.png
Community Discussions
Pandas
python
style
  • 310 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz
Community Manager
  • 0 kudos

Hi @DavidKxx, You can use df.to_html(index=False) to generate an HTML representation of the DataFrame without the index column.Databricks notebooks have their own rendering and display mechanisms. Sometimes, the rendering of Pandas DataFrames within ...

  • 0 kudos
Ruby8376
by Valued Contributor
  • 214 Views
  • 2 replies
  • 1 kudos

Function/system id for tableau databricks connector

currently, we are using PAT token for authentication purposes to generate tableau reports form data in databricks delta tables using databricks tableau connector. Would somebody know if system/function ID can be used from Tableau to  Databricks inste...

  • 214 Views
  • 2 replies
  • 1 kudos
Latest Reply
Kaniz
Community Manager
  • 1 kudos

Hi @Ruby8376, Please refer to the official documentation: Connect Tableau to Azure Databricks1.Connect Tableau to Databricks2.

  • 1 kudos
1 More Replies
Shravanshibu
by New Contributor III
  • 140 Views
  • 1 replies
  • 0 kudos

No able to move a file to volume

I am trying to move a file from repo local directory to volumes, but I am getting directory not found issue. Can some one guide me.tried using dbfs (dbfs/:Volumes/folder/ , /dbfs/Volumes/folder/) and without dbfs (/Volumes/folder/). None worked.@Kani...

Shravanshibu_0-1710141545813.png
Community Discussions
unitycatalog
Volumes
  • 140 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz
Community Manager
  • 0 kudos

Hi @Shravanshibu , When using Databricks File System (DBFS), ensure you use the correct syntax for specifying the path to a volume: If you’re using the absolute path, it should be: /dbfs/Volumes/folder/your_file.txt.If you’re using a relative path, i...

  • 0 kudos
Ruby8376
by Valued Contributor
  • 690 Views
  • 3 replies
  • 1 kudos

Resolved! Can data be unified based on client profile (unified profile) in databricks?

Hi All,my question is in regard to how data in salesforce data cloud gets unified based on client profiles. Can similar action be done on data in databricks. i believe unity catalog just provides unified layer for security and governance. is there a ...

  • 690 Views
  • 3 replies
  • 1 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 1 kudos

You want to identify actual persons based on one or more profiles (based on e-mail address etc).  That is something that is not available out-of-the box in Databricks.  The 'unified' in Databricks means you have a single platform for several data top...

  • 1 kudos
2 More Replies
Balazs
by New Contributor II
  • 1394 Views
  • 4 replies
  • 1 kudos

Resolved! Databricks Asset Bundles and Dashboards

Hi Databricks Team! I saw in the documentation that Databricks Asset Bundles will support Dashboards as well in the future. Could you please share, when we can expect that feature to be available? Is it coming only for the new Lakeview dashboards or ...

  • 1394 Views
  • 4 replies
  • 1 kudos
Latest Reply
lucas_ledesma
New Contributor II
  • 1 kudos

Hi @Kaniz ,It is not clear to me whether deploying dashboards with asset bundles is supported yet or not. If so, can you please point to an example or documentation on how to achieve this? Otherwise, when is this feature plan for? Thanks!

  • 1 kudos
3 More Replies
vkuznetsov
by New Contributor III
  • 1159 Views
  • 5 replies
  • 2 kudos

Problem sharing a streaming table created in Delta Live Table via Delta Sharing

Hi all,I hope you could help me to figure out what I am missing.I'm trying to do a simple thing. To read the data from the data ingestion zone (csv files saved to Azure Storage Account) using the Delta Live Tables pipeline and share the resulting tab...

vkuznetsov_0-1689259588838.png 2023_07_13_16_48_52_Data_Explorer.png
  • 1159 Views
  • 5 replies
  • 2 kudos
Latest Reply
jdog
New Contributor II
  • 2 kudos

I'm curious if Databricks plans to address this.  We use delta live streaming tables extensively and also planned on using delta sharing to get our data from our production unity catalog (different region).  Duplicating the data as a workaround is no...

  • 2 kudos
4 More Replies
Madalian
by New Contributor II
  • 297 Views
  • 2 replies
  • 0 kudos

How to create Delta live tables in Silver layer

How to create Delta live tables in Silver layerHi DB Experts,Having basic questions :I am working on Madalian Architecture (B, S, G) Layers.on B i am getting Delta files (Parq) format. with log folders. One folder for one table, multiple files are ge...

  • 297 Views
  • 2 replies
  • 0 kudos
Latest Reply
Madalian
New Contributor II
  • 0 kudos

Dear Kaniz,Thank you for addressing question :I am getting following error if i follow above: pyspark.errors.exceptions.captured.IllegalArgumentException: Reading from a Delta table is not supported with this syntax. If you would like to consume data...

  • 0 kudos
1 More Replies
santiagortiiz
by New Contributor III
  • 538 Views
  • 2 replies
  • 0 kudos

I was charged by a free trial

Hello databricks community, I took a databricks course to prepare for certification exam and requested a 14-days free trial on february 13 at 4:51 PM. So, February 27 at 4:51 pm must be the end of the free trial, but it ended 1 day before. Additional...

  • 538 Views
  • 2 replies
  • 0 kudos
Latest Reply
Kaniz
Community Manager
  • 0 kudos

Thank you for posting your concern on Community! To expedite your request, please list your concerns on our ticketing portal. Our support staff would be able to act faster on the resolution (our standard resolution time is 24-48 hours).

  • 0 kudos
1 More Replies
Sujitha
by Community Manager
  • 3993 Views
  • 8 replies
  • 27 kudos

Big news: Our Community is now 100,000 members strong with over 50,000 posts🚀

Thanks to every one of you, the Databricks Community has reached an incredible milestone: 100,000 members and over 50,000 posts! Your dedication, expertise and passion have made this possible. Whether you're a seasoned data professional, a coding en...

Header Image 2.png
  • 3993 Views
  • 8 replies
  • 27 kudos
Latest Reply
AshR
New Contributor III
  • 27 kudos

Wonderful!

  • 27 kudos
7 More Replies
Paul1
by New Contributor
  • 470 Views
  • 1 replies
  • 0 kudos

Error Spark reading CSV from DBFS MNT: incompatible format detected

I am trying to follow along with a training course, but I am consistently running into an error loading a CSV with Spark from DBFS.  Specifically, I keep getting an "Invalid format detected error".  Has anyone else encountered this and found a soluti...

  • 470 Views
  • 1 replies
  • 0 kudos
Latest Reply
MichTalebzadeh
New Contributor III
  • 0 kudos

Well your error message is telling you that Spark is encountering a Delta table conflict while trying to read a CSV file. The file path dbfs:/mnt/dbacademy... points to a CSV file. This is where the fun begins. Spark detects a Delta transaction log d...

  • 0 kudos
Pravin08
by New Contributor III
  • 983 Views
  • 14 replies
  • 0 kudos

Resolved! Want to split JSON data into multiple rows

Hi,This is my sample JSON data which is generated from api response and it is all coming in a single row. I want to split this in multiple rows and store it in a dataframe.[{"transaction_id":"F6001EC5-528196D1","corrects_transaction_id":null,"transac...

  • 983 Views
  • 14 replies
  • 0 kudos
Latest Reply
Pravin08
New Contributor III
  • 0 kudos

Yes indeed, it was datatype issue. After changing it to Longtype in the schema definition, it is working now. Thanks once again for all your inputs and time. Much appreciated !!!

  • 0 kudos
13 More Replies
SamDataWalk
by New Contributor III
  • 555 Views
  • 2 replies
  • 0 kudos

Bug with show tblproperties directly returning redacted in the result set where "userid" in value

When I use show tblproperties on a view/table to see the metadata, it will redact any value which has "userid" anywhere put in to it.And it is not just through the visual interface, when I query it through python directly, it contains the redacted va...

Databricks-bug-Screenshot 2023-12-24 115012.png
  • 555 Views
  • 2 replies
  • 0 kudos
Latest Reply
PatDBX
New Contributor II
  • 0 kudos

I understand that yours is a View. For my case, it's a Table so I could use `desc detail <schema_name>.<table_name>` to get the table properties info that are not redacted in the `properties` column from the `desc detail` output.

  • 0 kudos
1 More Replies
sirishavemula20
by New Contributor III
  • 1505 Views
  • 4 replies
  • 0 kudos

My exam got suspended ; Need help immediately (10/09/2023)

Hello Team,I encountered Pathetic experience while attempting my DataBricks Data engineer certification. Abruptly, Proctor asked me to show my desk, after showing he/she asked multiple times.. wasted my time and then suspended my exam.I want to file ...

  • 1505 Views
  • 4 replies
  • 0 kudos
Latest Reply
APadmanabhan
Moderator
  • 0 kudos

Hello, @sirishavemula20 It's a general practice for a proctor to ask the test taker to pan the room(as part of security measures) and its the responsibility of the test taker to make sure the surroundings are clear of any other objects whilst attempt...

  • 0 kudos
3 More Replies