- 3196 Views
- 7 replies
- 2 kudos
Notebook cell gets hung up but code completes
Have been running into an issue when running a pymc-marketing model in a Databricks notebook. The cell that fits the model gets hung up and the progress bar stops moving, however the code completes and dumps all needed output into a folder. After the...
- 3196 Views
- 7 replies
- 2 kudos
- 2 kudos
This can be a frustrating situation where the notebook cell appears stuck, but the code execution actually finishes in the background. Here are some steps you can troubleshoot to resolve this: camzap bazoocam1. Restart vs Interrupt:Try using the "Res...
- 2 kudos
- 501 Views
- 0 replies
- 0 kudos
jobs.python_wheel_task.enty_point can't find entry points defined in dependency packages
Let's say I have packageA with no entry points, packageA dependents on dependencyA package, which has entry-points.In order to be able to use those entrypoints, i.e.```yamlpython_wheel_task: package_name: packageA entry_point:dependencyA_entry```I ...
- 501 Views
- 0 replies
- 0 kudos
- 905 Views
- 2 replies
- 0 kudos
child notebook is not displaying output.
I have built pipeline to execute databricks notebook having SQL scripts. It is executing notebook but not able to see output for each cell. I am executing child notebook through driver notebook.
- 905 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi Verr,In short it depends on how your child notebook is configured. But I would start with the following points -Output Logging Settings: Check the logging settings for your notebook cells. Ensure that the cells are configured to display output. In...
- 0 kudos
- 3443 Views
- 6 replies
- 2 kudos
Resolved! column "storage_sub_directory" is now always NULL in system.information_schema.tables
Hello,I am running a job that depends on the information provided in column storage_sub_directory in system.information_schema.tables .... and it worked until 1-2 weeks ago.Now I discovered in the doc that this column is deprecated and always null , ...
- 3443 Views
- 6 replies
- 2 kudos
- 804 Views
- 1 replies
- 0 kudos
displaying unity catalog metadata and other information in sharePoint
Is there any connectors or api which we can use to display metadata information stored in Unity catalog to business users using SharePoint.
- 804 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Lucifer As metadata are stored in system schema as table that means you can use databricks to extract the data from databricks and display it to Sharepoint Docs - Statement Execution API: Run SQL on warehouses | Databricks on AWS
- 0 kudos
- 2298 Views
- 1 replies
- 1 kudos
Resolved! Unable to provide access in unity catalog using SQL commands
I am trying to provide access in unity catalog using the SQL commands.I am following the below documentation:https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/manage-privileges/It suggests to create SQL commands in belo...
- 2298 Views
- 1 replies
- 1 kudos
- 1 kudos
Try this. For some reason the quotes are crazy when using these commands. GRANT USAGE ON CATALOG `uda_dev` TO `your-group` GRANT SELECT ON SCHEMA uda_dev.default TO `your-group` (without quotes for the schema)
- 1 kudos
- 1196 Views
- 4 replies
- 1 kudos
Cluster policy type
Hi guys,I am creating a cluster policy through json. "runtime_engine": {"type": "fixed""value": "PHOTON"}When I run the above code... PHOTON option is getting enabled but graying out... What would I specify in type field so that the photon option sho...
- 1196 Views
- 4 replies
- 1 kudos
- 1 kudos
@thrinadhReddy This section includes a reference for each of the available policy types. There are two categories of policy types: fixed policies and limiting policies. Fixed policies prevent user configuration on an attribute. The two types of fixed...
- 1 kudos
- 529 Views
- 1 replies
- 0 kudos
Databricks workflow jobs run is taking Double time in EU Region
We have a scheduled job in Databricks workflow, This Job run is taking aroud 5 hours Previously before 1 month it was tasking on 2.5 hours. Can any one tell what may be the reason behind this. Note: There is no change has been made in this period of ...
- 529 Views
- 1 replies
- 0 kudos
- 0 kudos
You can check if you are using spot instances on your Job Cluster.btw. if you are using Azure West Europe is on very high demand and sometimes it takes time to provision compute.But it should be matter of minutes, not hours.Check maybe if your data v...
- 0 kudos
- 6257 Views
- 3 replies
- 0 kudos
Resolved! How to pass variables to a python file job
Hi everyone,It's relatively straight forward to pass a value to a key-value pair in notebook job. But for the python file job however, I couldn't figure out how to do it. Does anyone have any idea?Have been tried out different variations for a job wi...
- 6257 Views
- 3 replies
- 0 kudos
- 0 kudos
Thanks so much for this! By the way, is there a way to do it with the JSON interface? I am struggling to get the parameters if entered in this way
- 0 kudos
- 716 Views
- 1 replies
- 0 kudos
Chat Bot with Azure blob and databricks
Hi Team, I am thinking to start a chat bot application for teams to query data from Azure blob and data bricks tables in python programming language.Please help me out on how i can start and which tools i can use for this requirement.Thanks in advanc...
- 716 Views
- 1 replies
- 0 kudos
- 0 kudos
@Nagrjuna , that's a great idea! Although we do not know about your use case completely, I am sure you would definitely fall in love with our AI/ML Products. To create a Python chat bot application that can pull data from Azure Blob Storage and Datab...
- 0 kudos
- 648 Views
- 1 replies
- 1 kudos
Databricks AI summit '23 recommendations
Looking for recommendations on breakout sessions that are geared towards Revenue Data analytics and data science! Any leads would be great!
- 648 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @JiviteshM, If you’re interested in breakout sessions related to Revenue Data Analytics and Data Science, here are some recommendations: Building a data lakehouse for Data Science at DoorDash: Hien Luu, Senior Engineering Manager at DoorDash, ...
- 1 kudos
- 1126 Views
- 2 replies
- 2 kudos
Resolved! First time at Data + AI summit
It’s a wonderful summit! I met so many women in tech during this event, it’s a very good opportunity to exchange thought and ideas with such a divers ppl to modernize Data & AI! I actually join here from Japan, and unfortunately not so many women in ...
- 1126 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @Sakura, We're thrilled to hear that you had a wonderful experience at DAIS 2023 and that you were able to connect with so many inspiring women in tech! It's events like these that truly highlight the importance of diversity and collaboration in t...
- 2 kudos
- 706 Views
- 1 replies
- 0 kudos
Databricks AI Summit 2023
Thank you so much for organizing this big event. The main purpose of attending this event is to get to know about how the databricks is solving the problems for thousands of customers. The training session I attend for the databricks was amazing and ...
- 706 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @milinshah, We're thrilled to hear that you had a great experience at DAIS 2023 and found the training session valuable! Your enthusiasm for learning about how Databricks solves problems for customers is exactly what drives us. We wanted to share ...
- 0 kudos
- 2439 Views
- 1 replies
- 0 kudos
DAIS2023
Excited to know the dramatic innovations!- Delta Lake 3.0 enabling all the format to one ecosystem- Collaboration with Habu in Clean Room- LakehouseIQ: truly we are at the dawn of democratization of Data and AI!!#UniForm
- 2439 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Masa, Thank you for sharing your experiences and insights from DAIS 2023! It's great to hear about the exciting innovations and collaborations that were highlighted during the event, such as Delta Lake 3.0 and the collaboration with Habu in Clean...
- 0 kudos
- 1208 Views
- 1 replies
- 0 kudos
Lakeview dashboard dynamically change filter values
Greetings everyone,We are trying to implement a series of visualizations. All these visualizations have queries assigned to them in the form of “ Select * from test table where timestamp between :Days start and :Days end”. The is also a filter applie...
- 1208 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @EDDatabricks, Thank you for sharing your requirements and observations regarding the Lakeview dashboards. Let’s address each of your points: Dynamic Filters Based on Current Timestamp: To achieve dynamic filtering based on the current timesta...
- 0 kudos
