- 2356 Views
- 1 replies
- 0 kudos
How to automate creating notebooks when i have multiple .html or .py files
Hi all,I have 50+ .html and .py files, for which I have to create separate notebooks for each and every single one of them. For this, manually creating a notebook using the UI and importing the .html/.py file is a bit tedious and time consuming. Is t...
- 2356 Views
- 1 replies
- 0 kudos
- 0 kudos
Depending on your use case and requirements, one alternative would be to create a script that loops through your files and uploads them using the API. You can find more information about the API here: https://docs.databricks.com/api/workspace/workspa...
- 0 kudos
- 3228 Views
- 0 replies
- 0 kudos
move files and folder from workspace/repo to external location.
I would like to move the folder from my repo under /Workspace/Repos/ar... to the external Azure blob location.I tried dbutils.fs.mv(repo_path, az_path) but this gave me an error for the file not found.Also, I am not able to see workspace -> repo usin...
- 3228 Views
- 0 replies
- 0 kudos
- 7800 Views
- 2 replies
- 3 kudos
Resolved! Limitations of committing ipynb notebook output with Repos
During my experimentation with the latest feature that allows including notebook output in a commit, I ran into a specific issue. While attempting to commit my recent changes, I encountered an error message stating "Error fetching Git status." Intere...
- 7800 Views
- 2 replies
- 3 kudos
- 3 kudos
I've found that the restriction I've encountered isn't related to the file size within Repos, but rather the maximum file size that can be shown in the Azure Databricks UI. You can find this limitation documented at https://learn.microsoft.com/en-us/...
- 3 kudos
- 16113 Views
- 2 replies
- 2 kudos
workspace
How can I do to access the Workspace ?
- 16113 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi, you can try checking https://docs.databricks.com/en/administration-guide/workspace/index.html , please let us know if this helps. Also please tag @Debayan​ with your next response which will notify me, Thank you!
- 2 kudos
- 9855 Views
- 1 replies
- 1 kudos
Structured Streaming of S3 source
I am trying to setup s3 as a structured streaming source. The bucket receives ~17K files/day and the original load to the bucket was ~54K files. The bucket was first loaded 3 months ago and we haven't started reading from it since. So let's say there...
- 9855 Views
- 1 replies
- 1 kudos
- 1 kudos
Thanks,We were able to make things work by increasing the driver instance size so it has more memory for the initial load. After initial load we scaled the instance down for subsequent runs. We're still testing, if we aren't able to make it work we'l...
- 1 kudos
- 2132 Views
- 0 replies
- 0 kudos
"command complete" but not executed
I have a notebook that calls other notebooks with `dbutils.notebook.run` and execute them as a 'Notebook job'. But sometimes when a notebook is taking a long time and the cluster is just waiting for, for instance, an api response, the subsequent comm...
- 2132 Views
- 0 replies
- 0 kudos
- 37183 Views
- 8 replies
- 6 kudos
Get up to speed on Generative AI with this free on-demand training
Build foundational knowledge of generative AI, including large language models (LLMs), with 4 short videos. Here is how it works: Watch 4 short tutorial videosPass the knowledge testEarn a badge for Generative AI Fundamentals you can share on your ...
- 37183 Views
- 8 replies
- 6 kudos
- 18094 Views
- 6 replies
- 2 kudos
Exam retest voucher
Hi Data bricks Team,I set for Data bricks Certified Machine Learning Professional exam for 2nd time (10 Sept 2023), but didn't pass again. Got 66.66% overall.I am seasoned Data bricks user but this particular exam is quite unorthodox one. Nevertheles...
- 18094 Views
- 6 replies
- 2 kudos
- 2 kudos
Hi @Theor Thank you for submitting a ticket to our support team! They are working on it.
- 2 kudos
- 941 Views
- 0 replies
- 0 kudos
Is there any way to create Databricks jobCluster through Databricks connect
Is there any way to create Databricks jobCluster through Databricks connect We are using All purposed cluster so far, to reduce Databricks cost we are planning to go ahead with jobCluster but unfortunately, I couldn't find a way to create jobCluster ...
- 941 Views
- 0 replies
- 0 kudos
- 8641 Views
- 3 replies
- 0 kudos
Databricks Certified Data Engineer Associate exam
My Databricks Certified Data Engineer Associate exam got timed out as I was uninstalling the Antivirus, it took a while to set up my device. By that time it got timed out to start the exam. So please reschedule my exam.webassessor id: anjaliisanvaga...
- 8641 Views
- 3 replies
- 0 kudos
- 0 kudos
Dear Support Team, I apologize for the inconvenience caused. Unfortunately, due to unforeseen circumstances with my antivirus uninstallation, I was unable to start the exam on time. I kindly request you to reschedule my Databricks Certified Data Engi...
- 0 kudos
- 8644 Views
- 3 replies
- 0 kudos
Data Engineer Associate V3 exam got suspended
Hi team,My Databricks Certified Data Engineer Associate exam got suspended within 40 minutes. I had also shown my exam room to the proctor. My exam got suspended due to eye movement. I was not moving my eyes away from laptop screen. Some questions ar...
- 8644 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @vivek2612 the support team did receive your case and is working on it now. Good luck on your exam!
- 0 kudos
- 3474 Views
- 0 replies
- 0 kudos
Cluster can't connect to redshift
I'm trying to connect to redshift with redshift-connector module, but it get 'Connection refused' error, redshift cluster and ec2 cluster are in the same VPC, security group of redshift cluster is open with inbound from VPC's IP range, i can connect ...
- 3474 Views
- 0 replies
- 0 kudos
- 10363 Views
- 0 replies
- 0 kudos
Left join with merging two streaming tables returns inner join instead
Hi all, Im trying to merge two streaming tables together with a left (outer) join, but it seems to somehow return all values from the left table that have matching values from the right table, instead of also appending the NULL values if there is no ...
- 10363 Views
- 0 replies
- 0 kudos
- 7900 Views
- 1 replies
- 1 kudos
Need direction
I want to create an online chat bot that answers questions related to the immigration visa category that we work in. I don’t have programming experience myself. I would like to find someone in this community that could lead our product development.
- 7900 Views
- 1 replies
- 1 kudos
- 1 kudos
I suppose you are looking to recruit someone? You might be lucky finding someone in here, but job boards might have a larger reach.
- 1 kudos
- 7954 Views
- 0 replies
- 0 kudos
How to use variable values in Parent Workflow in Child Workflow.
In ADF, a variable called Datetime was specified to be entered and executed in a workflow called Parent using Web Activity.There is a Child Workflow (two-step workflow) in Parent Workflow, and Datetime variables are available in Parent Workflow, but ...
- 7954 Views
- 0 replies
- 0 kudos
