- 1395 Views
- 1 replies
- 1 kudos
Resolved! Selective column loader unity catalog
I am loading a table into a data frame using df = spark.table(table_name) Is there a way to load only the required columns? The table has more than 50+ columns and I only need a handful of column.
- 1395 Views
- 1 replies
- 1 kudos
- 1 kudos
@vk217 Simply just use select function, ex.df = spark.read.table(table_name).select("col1", "col2", "col3")
- 1 kudos
- 1537 Views
- 1 replies
- 0 kudos
Reading tables from different databricks clusters
Hello,My organization uses two cluster for dev and Prod. We mount our azure blobs on to delta lake to store the delta tables. Prod has bunch of data and dev has limited data. I want to move the data from prod to dev for testing purposes. How can I do...
- 1537 Views
- 1 replies
- 0 kudos
- 0 kudos
It depends on the current setup, how your clusters are working right now and how your data is stored. One alternative could be mount the Dev storage to the Prod cluster and execute a DEEP CLONE (https://docs.databricks.com/en/sql/language-manual/delt...
- 0 kudos
- 1569 Views
- 0 replies
- 0 kudos
Blue/Green Deployment, Table Cloning, and Delta live table pipelines
this a rather complex question that addresses Databricks users only. Let me recap a bit of the context that produced it. In the attempt to adopt the Blue/Green deployment protocol, we found good applications of the table cloning capabilities offered ...
- 1569 Views
- 0 replies
- 0 kudos
- 1693 Views
- 0 replies
- 0 kudos
Repos section in Admin Settings Page is not visible
Hello,We have multitple workspace of Azure Databricks and we recently noticed that in some of the Administrator workspace settings, we are not able to Repos section (https://learn.microsoft.com/en-us/azure/databricks/repos/repos-setup#--restrict-usag...
- 1693 Views
- 0 replies
- 0 kudos
- 2887 Views
- 0 replies
- 0 kudos
Can someone explain the key differences between Databricks
Hello Databricks community! I'm relatively new to Databricks and I'm trying to understand the distinctions between Databricks Community Edition and Databricks Workspace
- 2887 Views
- 0 replies
- 0 kudos
- 1645 Views
- 2 replies
- 0 kudos
Resolved! Databricks Certificate
I cleared Databricks Associate level certification on 25th September. But, I am yet to receive my certificate from Databricks. I raised a ticket for the same but got no response from the suppport team.
- 1645 Views
- 2 replies
- 0 kudos
- 0 kudos
Hello There, Can you share the ticket number, note that we have a high influx of cases and the team is actively working on clearing the backlogs and you should be able to receive the reply in the next 48 hours. I appreciate the patience.
- 0 kudos
- 2253 Views
- 1 replies
- 6 kudos
Webinar: Accelerate Data and AI Projects With Databricks Notebooks
Register now: October 24, 2023 | 8:00 AM PT Use new capabilities in Databricks Notebooks to speed up innovation. This webinar will walk you through the features that are designed to take the manual effort and delays out of building and deploying dat...
- 2253 Views
- 1 replies
- 6 kudos
- 6 kudos
This will help databricks user to speed up development.
- 6 kudos
- 1444 Views
- 0 replies
- 0 kudos
Model serving is not available for trial workspaces. Please contact Databricks
Hi, as mentioned in the title, I'm getting this error when I try to use model serving, despite being on the premium plan, my trial account ends on 28th September 2023, is there a way to use model serving immediately or am i stuck until 28th September...
- 1444 Views
- 0 replies
- 0 kudos
- 4036 Views
- 0 replies
- 0 kudos
SQL Warehouse - several issues
Hi there,I am facing several issues while trying to run SQL warehouse-starter on Azure databricks.Please note I am new to this data world, Azure & Databricks . while starting SQL starter warehouse in Databricks Trail version and I am getting these ...
- 4036 Views
- 0 replies
- 0 kudos
- 14880 Views
- 2 replies
- 2 kudos
workspace
How can I do to access the Workspace ?
- 14880 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi, you can try checking https://docs.databricks.com/en/administration-guide/workspace/index.html , please let us know if this helps. Also please tag @Debayan​ with your next response which will notify me, Thank you!
- 2 kudos
- 15210 Views
- 6 replies
- 1 kudos
Exam retest voucher
Hi Data bricks Team,I set for Data bricks Certified Machine Learning Professional exam for 2nd time (10 Sept 2023), but didn't pass again. Got 66.66% overall.I am seasoned Data bricks user but this particular exam is quite unorthodox one. Nevertheles...
- 15210 Views
- 6 replies
- 1 kudos
- 1 kudos
Hi @Theor Thank you for submitting a ticket to our support team! They are working on it.
- 1 kudos
- 414 Views
- 0 replies
- 0 kudos
Is there any way to create Databricks jobCluster through Databricks connect
Is there any way to create Databricks jobCluster through Databricks connect We are using All purposed cluster so far, to reduce Databricks cost we are planning to go ahead with jobCluster but unfortunately, I couldn't find a way to create jobCluster ...
- 414 Views
- 0 replies
- 0 kudos
- 6834 Views
- 1 replies
- 1 kudos
Need direction
I want to create an online chat bot that answers questions related to the immigration visa category that we work in. I don’t have programming experience myself. I would like to find someone in this community that could lead our product development.
- 6834 Views
- 1 replies
- 1 kudos
- 1 kudos
I suppose you are looking to recruit someone? You might be lucky finding someone in here, but job boards might have a larger reach.
- 1 kudos
- 7301 Views
- 0 replies
- 0 kudos
How to use variable values in Parent Workflow in Child Workflow.
In ADF, a variable called Datetime was specified to be entered and executed in a workflow called Parent using Web Activity.There is a Child Workflow (two-step workflow) in Parent Workflow, and Datetime variables are available in Parent Workflow, but ...
- 7301 Views
- 0 replies
- 0 kudos
- 1150 Views
- 1 replies
- 0 kudos
init script doesn't finish its run when it is located in workspace. it runs fun when I have in bfs
the first attached image runs fine when cluster startsthis next image of the script does not finish when I include the -y parameter. if I include the -y I get failed: Script exit status is non-zero can someone please help
- 1150 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, if I have understand your issue correctly, when you run directly in notebook it ends with an error but when you run it inside .sh with -y it runs okay?
- 0 kudos
