- 3737 Views
- 3 replies
- 0 kudos
Resolved! Token management is not enabled for this feature tier
I want to create a personal access token for a service principal so that I can use that service principal personal access token in the databricks-connect configure command in an automated build. I followed the instructions from here.https://docs.data...
- 3737 Views
- 3 replies
- 0 kudos
- 0 kudos
@Vikas B https://docs.databricks.com/dev-tools/api/latest/scim/scim-sp.html#scim-api-20-serviceprincipals let me know if this helps.
- 0 kudos
- 2815 Views
- 2 replies
- 1 kudos
Unable to access Scala and python variables in-between shells in same notebook.
I am facing issue in while accessing python data frame in Scala shell and vice versa. I am getting error variable not defined.
- 2815 Views
- 2 replies
- 1 kudos
- 1 kudos
The context is not shared between Scala and Python so you won't be able to access the same variables directly. However you can use createOrReplaceTempView to create a temporary view of your dataframe and read it in the other language with read_df = s...
- 1 kudos
- 4175 Views
- 2 replies
- 2 kudos
Delta Live Tables - how do you merge multiple streaming datasets into a single one?
I need to create a dataset that is dependent on multiple streaming datasets. However, when I attempt to create the new single stream I am getting an error. Append output mode not supported when there are streaming aggregations on streaming DataFrame...
- 4175 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi Kaniz/Jose, I was able to resolve the issue. I used 'union all' to avoid aggregation on the stream and have it continue to write to the table in append mode.This issue can be closed.
- 2 kudos
- 2400 Views
- 1 replies
- 3 kudos
Resolved! How can I change the admin settings by Terraform?
I need to update most of the settings that are visible on the Admin Console UI by using Terraform. In another post in this forum I saw that I can use `custom_config` in a `databricks_workspace_conf` resource to achieve that but the options seem limit...
- 2400 Views
- 1 replies
- 3 kudos
- 3 kudos
Ok, looks like I can inspect the network and see which flags are sent to the endpoint. Tried that and it worked.
- 3 kudos
- 1926 Views
- 1 replies
- 0 kudos
Databricks and conda-env support
In my current company, we have a Hadoop cluster in which we extensively use conda environments and conda-packs. What are the requirements for Databricks to work with this setup?
- 1926 Views
- 1 replies
- 0 kudos
- 2412 Views
- 1 replies
- 0 kudos
unable to create delta tables in aws glue catalog
unable to create delta tables in aws glue catalogThe project requires that we integrate with the AWS Glue catalog.We would like to be able to create tables in delta format in the glue catalog.To test this functionality. We did the followingCreated th...
- 2412 Views
- 1 replies
- 0 kudos
- 3875 Views
- 4 replies
- 2 kudos
Resolved! GitHub Credentials Won’t Save on User Settings Page
When I attempt to save my username and token for Github I receive a “Failed to Save. Try again.” message. I’ve used Azure DevOps with another DB workspace and never had an issue saving my PAT. I’ve tried using both my GitHub username and email wi...
- 3875 Views
- 4 replies
- 2 kudos
- 2 kudos
Quick update that I’ve now attempted to save my PAT for Github using two different computers and browser types (Safari and Chrome) and all have given the same “Failed to save. Please try again” message. Thankfully I can still clone from public repo...
- 2 kudos
- 4783 Views
- 4 replies
- 1 kudos
Trying to write to S3 bucket but executed code not showing any progress
I am trying to write data from databricks to an S3 bucket but when I submit the code, it runs and runs and does not make any progress. I am not getting any errors and the logs don't seem to recognize I've submitted anything. The cluster also looks un...
- 4783 Views
- 4 replies
- 1 kudos
- 6265 Views
- 4 replies
- 8 kudos
Resolved! [Databricks SQL] Commented Escape Character (\) Causes Unexpected Behavior
The Problem:I've observed erratic behavior when I add a comment containing a trailing escape character (\) to a CREATE TABLE statement.For example, this query returns data (though it shouldn't):CREATE TABLE example_table SELECT 1 -- This comment has ...
- 6265 Views
- 4 replies
- 8 kudos
- 8 kudos
@Graham Carman we're tracking this as a defect / issue on our side. For now, please don't include the escape character in comments.
- 8 kudos
- 1411 Views
- 1 replies
- 0 kudos
Parallelize fbprophet
What is the best way to parallelize fbprophet?
- 1411 Views
- 1 replies
- 0 kudos
- 2525 Views
- 1 replies
- 1 kudos
Need help with loading 11 TB data into spark dataframe using managed gcp databricks.
I am using managed databricks on gcp. I have 11TB of data with 5B rows. Data from source is not partitioned. I'm having trouble loading the data into dataframe and do further data processing. I have tried couple of executors configuration , none of t...
- 2525 Views
- 1 replies
- 1 kudos
- 2771 Views
- 3 replies
- 3 kudos
How to import blob storage container with sub-directories as a database in databricks sql?
I am trying to upload blob storage on databricks sql warehouse. I followed this document https://docs.databricks.com/data/data-sources/azure/azure-storage.html. but this doesn't seem to be working. Query executed fine but created schema was empty. An...
- 2771 Views
- 3 replies
- 3 kudos
- 3 kudos
@Athar Abbas the simplest thing would be to create a SAS token to the ADLS Gen 2 container and then use the COPY INTO command with the AZURE_SAS_TOKEN credential: https://docs.microsoft.com/en-us/azure/databricks/data/data-sources/azure/adls-gen2/az...
- 3 kudos
- 834 Views
- 0 replies
- 0 kudos
smarter living shop
We design and manufacture intelligent products and smart solutions that make your life easier, safer and more comfortable. Via the registered 2USB brand we produce innovative easy to install USB stopcontact & powerful USB charging solutions. We are a...
- 834 Views
- 0 replies
- 0 kudos
- 1253 Views
- 0 replies
- 2 kudos
Bug report: Switching branches duplicates cells
I'm using Databricks' support for GitHub repos. When I switch from one branch to another while a notebook is open, it messes up my notebook. Specifically, every notebook cell appears twice after switching branches.
- 1253 Views
- 0 replies
- 2 kudos
- 16591 Views
- 9 replies
- 2 kudos
SSL Error While Setting up databricks cli or installing library
How to fix below SSL error while setting up databricks Cli or installing library in clusterLibrary installation attempted on the driver node of cluster *** and failed.Please refer to the following error message to fix the library or contact Databric...
- 16591 Views
- 9 replies
- 2 kudos
- 2 kudos
I was getting an SSL when trying to set up secrets using the Databricks CLI. To fix the CLI SSL error I went to %USERPROFILE%\.databrickscfg (~/.databrickscfg on Unix, Linux, or macOS) from the file explorer on my local machine and added the insecure...
- 2 kudos
| User | Count |
|---|---|
| 1619 | |
| 790 | |
| 484 | |
| 349 | |
| 287 |
