- 1537 Views
- 1 replies
- 0 kudos
Clarification on Acceptable ID Proof for Databricks Associate Exam
Hi,I am planning to take the Databricks Associate exam in the upcoming week. My current ID proof is my original driving license issued by the Tamil Nadu government; however, it is laminated rather than a hard plastic card.Could you please confirm if ...
- 1537 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi Databricks community and @Cert-Team,Can you please help me here? The reason I am asking is Microsoft certification doesn’t approve laminated id proof’s.
- 0 kudos
- 585 Views
- 0 replies
- 0 kudos
gem 'activerecord-jdbc-adapter' rails active record adapter for Databricks
We currently have approximately 60 tables that collectively exceed 500GB, representing 99.9% of our total database size. One potential solution is to migrate these larger tables to Databricks, which may help us mitigate synchronization costs and addr...
- 585 Views
- 0 replies
- 0 kudos
- 1613 Views
- 1 replies
- 0 kudos
Unable to access Community Edition
I'm trying to create community edition account but everytime i try it shows" An error has occurred. Please try again later."I have attached the screenshot.I also tried accesiing Databricks in a differenct pc based on the answers from previous threads...
- 1613 Views
- 1 replies
- 0 kudos
- 0 kudos
By any chance is that email address already registered with another Databricks Tier (like company or paid)? Can you try in incognito mode with all ad blockers/popup blockers disabled
- 0 kudos
- 1160 Views
- 1 replies
- 1 kudos
Instance profiles are not working in Shared access mode
I’m trying to fetch billing data from an AWS account using boto3 to assume a role that has access to this information. This operation works fine in No Isolation and Single User access modes, but it fails in Shared access mode. Since I need to store t...
- 1160 Views
- 1 replies
- 1 kudos
- 1 kudos
Instance Profiles are open for all, they won't work in Shared access mode. Using Storage credentials, create External Locations. Cleaner way to Govern the access.
- 1 kudos
- 4456 Views
- 4 replies
- 1 kudos
Resolved! Can we get notebook owner using notebook path as parameter in api ?
I need to get the notebook owner using api or some other way by passing notebook path as parameter.
- 4456 Views
- 4 replies
- 1 kudos
- 3950 Views
- 2 replies
- 2 kudos
Associating a Git Credential with a Service Principal using Terraform Provider (AWS)
I am attempting to create a Databrick Repo in a workspace via Terraform. I would like the Repo and the associated Git Credential to be associated with a Service Principal. In my initial run, the Terraform provider is associated with the user defined ...
- 3950 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi Kinger and Debi-Moha, Do the steps in the "Use a service principal with Databricks Git folders" documentation work for you? Specifically for Terraform: https://docs.databricks.com/en/repos/ci-cd-techniques-with-repos.html#terraform-integration Th...
- 2 kudos
- 4044 Views
- 6 replies
- 3 kudos
Resolved! Data loss after writing a transformed pyspark dataframe to delta table in unity catalog
Hey guys, after some successful data preprocessing without any errors, i have a final dataframe shape with the shape of ~ (200M, 150). the cluster i am using has sufficient ram + cpus + autoscaling, all metrics look fine after the job was done.The pr...
- 4044 Views
- 6 replies
- 3 kudos
- 3 kudos
@szymon_dybczak i could resolve it now! basically, i broke the process down into further subprocesses, for each sub process, i cached and wrote them all into delta table (without overwritting), the next subprocess needs to read data in the delta tabl...
- 3 kudos
- 4323 Views
- 3 replies
- 3 kudos
Display data as multi-line in dashboard table
I am displaying a table in a notebook dashboard. One column of the data is conceptually a list of strings. I can originate or convert the list as whatever format would be useful (as a string representing a JSON array, as an ARRAY struct, etc.). I w...
- 4323 Views
- 3 replies
- 3 kudos
- 3 kudos
Hi @DavidKxx ,What you can do is convert your array to into an HTML formatted string with bullet points.Here is the code: # Sample data with an array column data = [ (1, ['Apple', 'Banana', 'Cherry']), (2, ['Dug', 'Elephant']), (3, ['Fish...
- 3 kudos
- 2342 Views
- 1 replies
- 0 kudos
Word wrap in dashboards
When I'm displaying a Table-style visualization in a notebook dashboard, is there a setting I can apply to a text column so that it automatically word-wraps text longer than the display width of the column?For example, in the following dashboard disp...
- 2342 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @DavidKxx ,That is quite similar question to one about displaying array as bullet list. Since you were successful in implementing displayHTML, what do you think about doing similar in this case? # Sample DataFrame with long text data = [ (1, '...
- 0 kudos
- 616 Views
- 0 replies
- 0 kudos
Databricks integration with Canada Post
hello everyone,I want to validate whether the postal code in my data is a valid postal code as per Canada postal code directory. Assuming, we have subscription to Canada Post APIs, how can we bring the postal code data into Databricks?Thanks
- 616 Views
- 0 replies
- 0 kudos
- 541 Views
- 0 replies
- 0 kudos
setting defaultValue for runtime_engine policy
Hi,I want to set runtime_engine default value to STANDARD but a user can also select PHOTON if they want. Something like below. Can anyone please verify if that works?"runtime_engine": {"type": "allowlist","values": ["STANDARD","PHOTON"],"defaultValu...
- 541 Views
- 0 replies
- 0 kudos
- 1795 Views
- 3 replies
- 0 kudos
Lost untracked and gitignore files when push new commit
Hi guys, our team uses Databricks clusters to develop with Python using Jupyter Notebooks.Recently we had a serious problem in our repos folder ( mainly Jupyter Notebook and Python scripts ).After my teammate committed in the branch, all the tracked ...
- 1795 Views
- 3 replies
- 0 kudos
- 0 kudos
Yes we have a subscription. Please tell me which information you need to check. I want to dive in this problem. If possible, pls contact through my email.
- 0 kudos
- 21821 Views
- 4 replies
- 0 kudos
Connecting live google sheets data to Databricks
Hi! So we have a live google sheets data that gets updated on an hourly/daily basis, and we want to bring it to databricks as a live/scheduled connection for further analysis, together with other tables and views present there. Do you have any sugges...
- 21821 Views
- 4 replies
- 0 kudos
- 0 kudos
Thanks @Ajay-Pandey ! Appreciate your reply. I am new to Databricks, apologies, but I wonder if it's possible to put this live data into a table under a specific catalog-schema? Such that the table will reflect the live data in google sheet?
- 0 kudos
- 2252 Views
- 5 replies
- 1 kudos
My Databricks Exam got suspended
Hi Databricks Team,My Certification exam got suspended today, I started my exam as normal and then my exam was put on hold quoting "team from support needs to talk with you", I connected with the support team and showed my Exam area and everything ve...
- 2252 Views
- 5 replies
- 1 kudos
- 1 kudos
Hi @Cert-TeamOPS ,My exam was rescheduled today and I gave my exam and still it got suspended, it's very sad that it's happening again to meI have complied with all the rules set by the exam.The question and options are on the complete left of the sc...
- 1 kudos
- 5635 Views
- 3 replies
- 1 kudos
#Table object name limits
Hi, is there a limit on the number of characters a table object name can be? If so, please provide the source of where this information can be found.
- 5635 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @Chughes1408 ,The table name can have up to 255 characters:The source:Names - Azure Databricks - Databricks SQL | Microsoft Learn
- 1 kudos
