- 2640 Views
- 3 replies
- 3 kudos
Level of databricks spark certificate exam
I am willing to take spark certificate exam , i have solved the practice test and it was very good , but i am afraid that the level of exam is harder than the practice exam . So does it really harder ?
- 2640 Views
- 3 replies
- 3 kudos
- 3 kudos
Hi @Aly Ayman​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers you...
- 3 kudos
- 3574 Views
- 2 replies
- 1 kudos
Resolved! DLT Security in Transit and in Rest
do you have docs that explain more specifics? is it end-to-end encrypted in transit? for in rest, is it just the encryption we get from e.g. S3?
- 3574 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Frank Munz​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!
- 1 kudos
- 3039 Views
- 1 replies
- 5 kudos
When are you gonna fix this site?
Unacceptable user experience for this forum: What markdown support?My colleagues agree the email verification looks sketchy.The website is SUPER slow. (10-56 seconds per page)Uses color red for email verified?!No feedback on repeated logins.The fonts...
- 3039 Views
- 1 replies
- 5 kudos
- 5 kudos
Hi @Elon Musk​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedback wi...
- 5 kudos
- 1798 Views
- 2 replies
- 1 kudos
I would like to get rid of the error
the SPN we use for the mount points has access to the dataset in question, but for some reason I get this errorPlease find the attached screenshot for the error details.
- 1798 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @sai chandu palkapati​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from y...
- 1 kudos
- 6251 Views
- 3 replies
- 0 kudos
Resolved! Job aborted due to stage failure: ModuleNotFoundError
I'm getting this Failure Reason on a fairly simple streaming job. I'm running the job in a notebook. The notebook relies on a python module that I'm syncing to DBFS with `dbx`. Within the notebook generally, the module is available, i.e. `import mymo...
- 6251 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @Benjamin Dean​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Than...
- 0 kudos
- 4615 Views
- 3 replies
- 4 kudos
Resolved! Load data into Azure SQL Database from Azure Databricks ( restricted table not a whole workspace tables)
Hi ,I want to share limited tables in my databricks workspace and users will connect to my databricks through Azure Data factory and will load data into Azure SQL. Is this possible using Delta Sharing? Or any other method or tool?
- 4615 Views
- 3 replies
- 4 kudos
- 4 kudos
Hi @Dayananthan Marimuthu​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your...
- 4 kudos
- 4130 Views
- 3 replies
- 3 kudos
Unable to find input by typing input in the Multiselect Widget
In the AWS databricks widgets.multiselect, I'm unable to find input by typing input in the mulitselect bar. It was working before. Although I can find the inputs by scrolling down the list, it's annoying if the list is long.​​Here's my script:measlis...
- 4130 Views
- 3 replies
- 3 kudos
- 3 kudos
Hi @Philip Teu​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!
- 3 kudos
- 7333 Views
- 3 replies
- 4 kudos
Resolved! Confusion in string comparison
Hello expertI am new to spark. I am using same price of code but getting different resultsWhen i am using below piece of code, i am getting errorpy4j.Py4JException: Method or([class java.lang.String]) does not existdf.filter(F.col("state").isNull() ...
- 7333 Views
- 3 replies
- 4 kudos
- 4 kudos
Hi @Saswata Dutta​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedbac...
- 4 kudos
- 6551 Views
- 2 replies
- 3 kudos
Databricks driver logs
I am running jobs on databricks clusters. When the cluster is running I am able to find the executor logs by going to Spark Cluster UI Master dropdown, selecting a worker and going through the stderr logs. However, once the job is finished and cluste...
- 6551 Views
- 2 replies
- 3 kudos
- 3 kudos
Hi @Atul Arora​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedback w...
- 3 kudos
- 9007 Views
- 2 replies
- 2 kudos
How do I configure managed identity to databricks cluster and access azure storage using spark config
Partner want to use adf managed identity to connect to my databricks cluster and connect to my azure storage and copy the data from my azure storage to their azure storage storage
- 9007 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @SAI PUSALA​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedback w...
- 2 kudos
- 3394 Views
- 2 replies
- 2 kudos
Failure to initialize configuration' on SQL Warehouse Tables
Yesterday I had a basic DLT pipeline up and running, and was able to query the hive_metastore tables successfully. The pipeline uses autloader to ingest a few csv files from cloud storage to streaming live bronze and silver tables. Today after star...
- 3394 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @Jennette Shepard​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feed...
- 2 kudos
- 2594 Views
- 2 replies
- 4 kudos
Resolved! DLT code examples and notebooks?
we like the examples that you show in webinars especially with DLT and Huggingface or DLT with ingestion from Kafka, are they publicly available?
- 2594 Views
- 2 replies
- 4 kudos
- 4 kudos
Hi @Frank Munz​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedback w...
- 4 kudos
- 4416 Views
- 4 replies
- 3 kudos
- 4416 Views
- 4 replies
- 3 kudos
- 3 kudos
Hi @Vijay Gadhave​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Than...
- 3 kudos
- 2730 Views
- 2 replies
- 2 kudos
To collect the elements of a SparkDataFrame and coerces them into an R dataframe.
Hello Everyone,I am facing the challenge while collecting a spark dataframe into an R dataframe, this I need to do as I am using TraMineR algorithm whih is implemented in R only and the data pre-processing I have done in pysparkI am trying this:event...
- 2730 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @Niraj Tanwar​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thank...
- 2 kudos
- 3606 Views
- 4 replies
- 3 kudos
Automating the initial configuration of dbx
Hi Team,Good morning.As of now, for the deployment of our code to Databricks, dbx is configured providing the parameters such as cloud provider, git provider, etc., Say, I have a code repository in any one of the git providers. Can this process of co...
- 3606 Views
- 4 replies
- 3 kudos
- 3 kudos
Hi @Arunsundar Muthumanickam​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear fr...
- 3 kudos
| User | Count |
|---|---|
| 1629 | |
| 790 | |
| 511 | |
| 349 | |
| 287 |
