- 3933 Views
- 2 replies
- 0 kudos
Resolved! Cluster configuration / notebook panel
Hi,Is it possible to let regular users to see all running notebooks (in the notebook panel of the cluster) on a specific cluster they can use (attach and restart).by default admins can see all running notebooks and users can see only their own notebo...
- 3933 Views
- 2 replies
- 0 kudos
- 0 kudos
hi @Philippe CRAVE​ a user can see a notebook only if they have permission to that notebook. Else they won't be able to see it. Unfortunately there is no possibility for a normal user to see the notebooks attached to a cluster if they do not have per...
- 0 kudos
- 2828 Views
- 0 replies
- 2 kudos
Data unloading to S3 bucket from Databricks.
Hi,I am completely new to the Databricks & have a task to unload the data from Databricks table to the S3 location using java/sql. Is this possible? If yes can you please help me?
- 2828 Views
- 0 replies
- 2 kudos
- 6564 Views
- 1 replies
- 2 kudos
How to restart a cluster on databricks using databricks-CLI?
I'm trying to restart an existing cluster in Databricks on Azure using databricks-cli.I'm using the following command:databricks clusters restart {"cluster_id": "0710-121255-liner30"}But it gives giving me this error:Error: Missing option "--cluster-...
- 6564 Views
- 1 replies
- 2 kudos
- 2 kudos
Can you try:databricks clusters restart --cluster-id <the-cluster-id>$ databricks clusters restart --help Usage: databricks clusters restart [OPTIONS] Restarts a Databricks cluster given its ID. If the cluster is not currently in a RUNNING st...
- 2 kudos
- 1623 Views
- 0 replies
- 0 kudos
Is it possible to specify a specific branch commit when deploying repo to a workspace via the Databricks CLI?
I would like to know if it is possible to include a specific commit identifier when updating a repo in a workspace via the Databricks CLI.Why? Currently we use the repos CLI to push updates to code throughout dev, test and prod (testing along the wa...
- 1623 Views
- 0 replies
- 0 kudos
- 21789 Views
- 2 replies
- 6 kudos
Resolved! Create a Dashboard: How do I visualize data with Databricks SQL or my BI tool?
Databricks SQL helps query and visualize data so you can share real-time business insights with built-in dashboards or your favorite BI tools.This post helps you create queries, visualizations and dashboards and connect to your BI tools for deeper da...
- 21789 Views
- 2 replies
- 6 kudos
- 6 kudos
Thanks for the information, I will try to figure it out for more. Keep sharing such informative post keep suggesting such post.
- 6 kudos
- 1512 Views
- 0 replies
- 3 kudos
Register for Databricks Office HoursAugust 17 & August 31 from 8:00am - 9:00am PT | 3:00pm - 4:00pm GMT. Databricks Office Hours connects you dire...
Register for Databricks Office HoursAugust 17 & August 31 from 8:00am - 9:00am PT | 3:00pm - 4:00pm GMT.Databricks Office Hours connects you directly with experts to answer your Databricks questions.Join us to: • Troubleshoot your technical questions...
- 1512 Views
- 0 replies
- 3 kudos
- 2162 Views
- 2 replies
- 1 kudos
Databricks and AWS Cloud watch agent issue
I'm facing problem while connecting Data bricks with AWS cloud watch, I want to send certain logs to cloud watch but seems like there is some connectivity issue between the 2 parties
- 2162 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Tushar Dua​ , please follow the below blog which has details on how to monitor Databricks using Cloudwatch.How to Monitor Databricks with AWS CloudWatch
- 1 kudos
- 6213 Views
- 3 replies
- 3 kudos
- 6213 Views
- 3 replies
- 3 kudos
- 3 kudos
@RonVBrown (Customer)​ : Could you please refer below linkhttps://docs.databricks.com/data/data-sources/elasticsearch.htmlPlease try to use opens search library instead of the ES jar if it does not work.https://search.maven.org/artifact/org.opensearc...
- 3 kudos
- 1086 Views
- 0 replies
- 0 kudos
Use databricks-sync import to migrate to new workspace
Hello,We are using the databricks-sync tool in an attempt to migrate from a legacy workspace into a new E2 account workspace. The tool exports json files successfully, but when I try to import, I receive various Terraform errors referencing undeclar...
- 1086 Views
- 0 replies
- 0 kudos
- 1577 Views
- 0 replies
- 0 kudos
define notebook path from a parameter
Is there a way to define the notebook path based a parameter from the calling notebook using %run? I am aware of dbutils.notebook.run(), but would like to have all the functions defined in the reference notebook to be available in the calling noteboo...
- 1577 Views
- 0 replies
- 0 kudos
- 2740 Views
- 0 replies
- 0 kudos
Workflow parameters
Hey everyone! I'm close but can't seem to figure this out. I'm trying to add 2 notebooks to a Databricks Job. Instead of the first command in both notebooks being a connection to an RDS/Redshift cluster, I'd prefer to make that connection once and ha...
- 2740 Views
- 0 replies
- 0 kudos
- 1461 Views
- 0 replies
- 2 kudos
What is the best practice while loading delta table , do I infer the schema or provide the schema?
I am loading avro files into the detla tables. I am doing this for multiple tables and some files are big like (2-3GB) and most of them are small like in few MBs.I am using autoloader to load the data into the delta tables.My question is:What is the ...
- 1461 Views
- 0 replies
- 2 kudos
- 5774 Views
- 2 replies
- 1 kudos
Error in SQL statement: KeyProviderException: Failure to initialize configuration
I have a source delta table from which I have selectively granted access to a particular pool id(can be thought of a dummy user). From the pool id interface, whenever I am running a select on any of the tables, even though it has access to, is faili...
- 5774 Views
- 2 replies
- 1 kudos
- 5397 Views
- 4 replies
- 3 kudos
Resolved! Azure Databricks: Failed to extract data which is between two timestamps within those same dates using Pyspark
Data type:AAPL_Time: timestampAAPL_Close: floatRaw Data:AAPL_Time AAPL_Close 2015-05-11T08:00:00.000+0000 29.0344 2015-05-11T08:30:00.000+0000 29.0187 2015-05-11T09:00:00.000+0000 29.0346 2015-05-11T09:3...
- 5397 Views
- 4 replies
- 3 kudos
- 3 kudos
Another thing to try is the hour() and minute() functions will return integers.
- 3 kudos
- 24107 Views
- 5 replies
- 3 kudos
Resolved! Precision and scale is getting changed in the dataframe while casting to decimal
When i run the below query in databricks sql the Precision and scale of the decimal column is getting changed.Select typeof(COALESCE(Cast(3.45 as decimal(15,6)),0));o/p: decimal(16,6)expected o/p: decimal(15,6)Any reason why the Precision and scale i...
- 24107 Views
- 5 replies
- 3 kudos
- 3 kudos
You can use typeof(COALESCE(Cast(3.45 as decimal(15,6)),0.0)); (instead of 0)
- 3 kudos
| User | Count |
|---|---|
| 1637 | |
| 791 | |
| 531 | |
| 349 | |
| 287 |
