- 2104 Views
- 4 replies
- 0 kudos
Error when cloning repository
Hi all,cloning a devops repo worked like a charm every time, but now I get a weird error, that I do not understandWhat container is meant here and why would I need one?Thanks and regards,Raphael
- 2104 Views
- 4 replies
- 0 kudos
- 0 kudos
@Yeshwanth I am sorry, I thought I replied to you on friday. I cannot upload a .har file. I get the error message:The file type (.har) is not supported. Valid file types are: jpg, gif, png, pdf.
- 0 kudos
- 4056 Views
- 3 replies
- 1 kudos
Certification Coupon Voucher Not Received
Hi Team I have attended the webinar long back and completed the survey as well still i have not receive any coupon voucher and because of that not able to give exam . Please look into this isue asap and provide me with the voucher .
- 4056 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi Guilherme, We can see that, whereas you used the email address "guilherme.santos@bridgeconsulting.com.br" to attend the webinar, but you did not complete the survey. So you have not received the voucher code.
- 1 kudos
- 825 Views
- 0 replies
- 0 kudos
Disaster Recovery for Databricks Unity catalog enab;led workspace
Hi I have a unity catalog enabled workspaces in us-east-1 and would like to setup DR Databricks workspace in us-east-2. How can we achieve as I don't see a clear path for syncing metadata and delta tables across regions.
- 825 Views
- 0 replies
- 0 kudos
- 2246 Views
- 1 replies
- 0 kudos
Spark Excel Library Insufficient Privileges
HiWe have a shared access mode cluster in which we have installed a maven library for reading excel files into a Spark DataFrame. When using an account with admin rights everything works fine, however when we run it as a standar user we always get `o...
- 2246 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello James, this issue seems to be related to shared cluster limitations, as per docs: Libraries used as JDBC drivers or custom Spark data sources on Unity Catalog-enabled shared compute require ANY FILE permissions.Moving to a single user cluster m...
- 0 kudos
- 2044 Views
- 1 replies
- 0 kudos
How to escape column comments when adding them programmatically
I would like to add comments to all of our columns, programmatically. The only way I can find to do this is through SQL DDL - e.g. `alter table sometable alter column somecolumn comment 'some comment string`. However, I want to read this comment stri...
- 2044 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @JameDavi_51481 ,I do not believe this is supported currently, please see this line in the Parameter Marker documentation: > You must not reference a parameter marker in a DDL statement...Ref: https://docs.databricks.com/en/sql/language-manual/sql...
- 0 kudos
- 2028 Views
- 2 replies
- 0 kudos
Resolved! how to clone a table using Column and row level mask
I am working on use case to clone a table which has column and row level masking implemented.Can i clone the table, based on documentation it is not possible. what are the other alternatives i have ?
- 2028 Views
- 2 replies
- 0 kudos
- 0 kudos
@amit-agarwal4 At the current moment, I'm not aware of any other way than disabling the RLS.
- 0 kudos
- 4042 Views
- 6 replies
- 0 kudos
Resolved! Retrieve error column/row when writing to sqlmi
Databricks notebook, Scala, .read() .write(), source data csv. Got this error when trying to write data to sqlmi. I understand the error indicated one of the source column value's length exceeded the database column's value length. But the message is...
- 4042 Views
- 6 replies
- 0 kudos
- 0 kudos
Thanks JamesY, I'm not familiar with the limitations of the SQL Server `nvarchar` data type but is there a way that we can filter out the rows that will fail using spark such as: spark.read.format("csv").option("header", "true").load("/path/to/csvs")...
- 0 kudos
- 5571 Views
- 5 replies
- 1 kudos
Resolved! [TABLE_OR_VIEW_ALREADY_EXISTS] when running create or replace view
When I'm running `dbt run -s model` for different models in parallel on databricks general compute cluster. Im getting the error: TABLE_OR_VIEW_ALREADY_EXISTS. Also, at the same time, the view/table was not created at all.But I run them in sequence, ...
- 5571 Views
- 5 replies
- 1 kudos
- 1 kudos
@raphaelblg yes! Im the owner. However, these views are inside the hive_metastore catalog. Could it be the reason?Many thaaanks!
- 1 kudos
- 2337 Views
- 1 replies
- 0 kudos
Running JAR jobs in parallel on a cluster
Hi everyone, I'm trying to find out if databricks has support for clusters which can scale out with more drivers to run new jobs in parallel. If not, then is there a work around for this? I've noticed that all-purpose and job compute clusters both fe...
- 2337 Views
- 1 replies
- 0 kudos
- 0 kudos
@AchintyaSingh Databricks does not support clusters with multiple drivers to run new jobs in parallel. Each Databricks cluster has a single driver node, allowing only one job at a time.Workarounds for Achieving Parallel Job Execution: 1. Multiple Cl...
- 0 kudos
- 4639 Views
- 2 replies
- 0 kudos
InconsistentReadException: The file might have been updated during query - CSV backed table
I have some CSV files that I upload to DBFS storage several times a day. From these CSVs, I have created SQL tables: CREATE TABLE IF NOT EXISTS masterdata.lookup_host USING CSV OPTIONS (header "true", inferSchema "true") LOCATION '/mnt/masterdata/...
- 4639 Views
- 2 replies
- 0 kudos
- 0 kudos
One approach I'm testing (positive results so far, but still early).%sql # Prep and cleanup REFRESH TABLE masterdata.lookup_host; DROP TABLE IF EXISTS t_hosts; # Forcibly cache the needed columns before using the data in another query. CACHE TABLE...
- 0 kudos
- 2287 Views
- 1 replies
- 0 kudos
Add Raw Tabless to Unity Catalog?
Hello everyone,Hope someone here can help me out as I am a bit stuck I am currently loading some data from number of sources to parquet using ADF. This ends up in a ADLS2 storage account as .parquet. This is the staging / landing zone area.From there...
- 2287 Views
- 1 replies
- 0 kudos
- 15252 Views
- 0 replies
- 0 kudos
Change adls gen2 attached to Unity Catalog metastore from premium to standard
Hello,Our cloud platform engineer created Azure storage for the production Unity Catalog metastore in our environment, but mistakenly chose the Premium tier instead of the Standard tier.Unfortunately, this decision is impacting our costs on Azure, as...
- 15252 Views
- 0 replies
- 0 kudos
- 3059 Views
- 2 replies
- 0 kudos
Accessing ADLS Gen2 related Hadoop configuration in notebook
I have a cluster in which I have the required configuration to access an ADLS Gen2, and it works without any problems.I want to access this storage using the Hadoop filesystem APIs. To achieve this, I am trying to get the Hadoop configuration from th...
- 3059 Views
- 2 replies
- 0 kudos
- 0 kudos
By the way how do you achieve inline code highlighting in the editor I tried `` but it didn't work.
- 0 kudos
- 1843 Views
- 1 replies
- 2 kudos
Resolved! DAIS24 Attendee Badge - Oops
I wasn't at DAIS24, but I received one of these emails and it appears to have come from Databricks. I think I was given the badge in error. Can we have it removed?Just Wondering,Shawn
- 1843 Views
- 1 replies
- 2 kudos
- 2 kudos
Hi @Shawn_Eary Thank you for bringing this to our attention. We were conducting a test on badges, and some of our community members may have received this email by accident. We have revoked the changes now, please ignore the message.
- 2 kudos
- 2687 Views
- 1 replies
- 0 kudos
Tableau Prep Save Output to Databricks
Has anyone run into use cases where your data scientist/data engineer end users build Tableau Prep Flows and steps in Tableau Prep Flow require saving output back into Databricks? There appears to be no native support for this in Tableau Prep if the ...
- 2687 Views
- 1 replies
- 0 kudos
- 0 kudos
These are awesome suggestions. To expand on our setup, we also have Informatica Cloud - IICS (CMI, CDI, etc.) connected to the entire setup generally used for bringing data from a source (PaaS, SaaS, On-prem SQL, Flat Files or streaming devices) to D...
- 0 kudos
