- 133 Views
- 3 replies
- 0 kudos
Supporting Material for self phased Data Analysis with Databricks Course
Hi All,Newbie here, Any idea where I can find the supporting materials that are used in the online "Data Analysis with Databricks Course" that the instructor is using?. It seems to be having the scripts to create schema, tables, etcThanks in advance
- 133 Views
- 3 replies
- 0 kudos
- 0 kudos
Hello @BSalla, here is our suggested learning path. I hope it helps you!
- 0 kudos
- 93 Views
- 2 replies
- 1 kudos
Finding Materials for Databricks Course
Hi All,Where can I find the supporting materials used by the instructor in the online "Data Analysis with Databricks" course? It appears to include scripts for creating schemas, tables, and other database structures.Thanks in advance.
- 93 Views
- 2 replies
- 1 kudos
- 1 kudos
Hello @RoseCliver1 and @BSalla! To access the course supporting materials, please raise a support ticket here.
- 1 kudos
- 842 Views
- 2 replies
- 0 kudos
Talend ETL code to Databricks
Hi Team,What is the best way to transfer Talend ETL code to Databricks and what are the best methods/practices for migrating Talend ETL's to Databricks (notebook, code conversion/migration strategy, workflow's etc)?Regards,Janga
- 842 Views
- 2 replies
- 0 kudos
- 0 kudos
You can have a look at BladeBridge converters. They support Talend to Databricks route. www.bladebridge.com
- 0 kudos
- 61 Views
- 1 replies
- 0 kudos
Integrating SAP HANA with Databricks: Exploring Data Transformation and Optimization
Hi everyone,I'm currently working on a project that involves integrating SAP HANA with Databricks to transform and analyze data. I’m using methods like JDBC/ODBC connectors to extract data from SAP HANA into Databricks, but I’ve run into a few hurdle...
- 61 Views
- 1 replies
- 0 kudos
- 0 kudos
hey @edisionthomas are you directly connecting to underlying HANA database and reading the tables? That would not be quite efficient as by default with jdfc, data sourced will be scanned sequentially. You would need to work on the ways to parallelise...
- 0 kudos
- 441 Views
- 4 replies
- 2 kudos
Resolved! Issue with Non-Bulk Inserts Using JDBC on Databricks Runtime 14.1
Hello team,I am experiencing an issue with insert operations on Databricks using the JDBC driver. In my SAS Viya system, the DatabricksJDBC42.jar driver version 2.6.40 is configured. I’ve noticed that, up to Databricks Runtime version 13.1, insert op...
- 441 Views
- 4 replies
- 2 kudos
- 2 kudos
Were you using parameterized queries? I think its native support starts from version 14.1.See if this can mitigate the issue by EnableNativeParameterizedQuery=0
- 2 kudos
- 3527 Views
- 2 replies
- 0 kudos
Databricks Notebook says "Connecting.." for some users
For some users, after clicking on a notebook the screen says "connecting..." and the notebook does not open.The users are using Chrome browser and the same happens with Edge as well.What could be the reason?
- 3527 Views
- 2 replies
- 0 kudos
- 0 kudos
Same issue here, just tried to get set up with community edition but no luck
- 0 kudos
- 113 Views
- 1 replies
- 1 kudos
Resolved! read file from local machine(my computer) and create a dataframe
I want to create a notebook and add a widget which will allow the user to select a file from local machine(my computer) and read the contents of the file and create a dataframe. is it possible? and how? in dbutils.widgets i dont have any options for ...
- 113 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @khaansaab ,Currently, there is now out of the box mechanism that will allow you to that. As a workaround,you can create a UC volume and tell your users to upload files into that volume. Then you can create notebook that will have file_name parame...
- 1 kudos
- 3254 Views
- 2 replies
- 0 kudos
Resolved! Configure Databricks in VSCode through WSL
Hi,I am having a hard time configuring my Databricks workspace when working in VSCode via WSL. When following the steps to setup Databricks authentication I am receiving the following error on the Step 5 of "Step 4: Set up Databricks authentication"....
- 3254 Views
- 2 replies
- 0 kudos
- 0 kudos
What worked for me was NOT opening the browser using the pop-up (which generated the 3-legged-OAuth flow error), but clicking on the link provided by the CLI (or copy paste the link on the browser)
- 0 kudos
- 5093 Views
- 1 replies
- 0 kudos
SAP Successfator
Hi Team,We are working on a new Data Product onboarding to the current Databricks Lakehouse Platform.The first step is foundation where we should get data from SAP success factors to S3+ Bronze layer and then do the initial setup of Lakehouse+Power B...
- 5093 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi Phani1, Were you able to get any success with this?
- 0 kudos
- 7292 Views
- 3 replies
- 0 kudos
Space in Column names when writing to Hive
All,I have the following code.df_Warehouse_Utilization = ( spark.table("hive_metastore.dev_ork.bin_item_detail") .join(df_DIM_Bins,col('bin_tag')==df_DIM_Bins.BinKey,'right') .groupby(col('BinKey')) .agg(count_distinct(when(col('serial_lo...
- 7292 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi,I have faced this issue a few times. When we are overwriting the dataframes to hive catalog in databricks, it doesn't naturally allow for column names to have spaces or special characters. However, you can add an option statement to bypass that ru...
- 0 kudos
- 4094 Views
- 18 replies
- 4 kudos
Mounting Data IOException
Hello,I am currently taking a course from Coursera for data science using SQL. For one of our assignments we need to mount some data by running a script that has been provided to us by the class. When I run the script I receive the following error. I...
- 4094 Views
- 18 replies
- 4 kudos
- 4 kudos
I have resolved this issue. Please see the Databricks notebook below. Thanks to Tawfeeq for the helpful method.https://databricks-prod-cloudfront.cloud.databricks.com/public/4027ec902e239c93eaaa8714f173bcfc/2108650195107345/4043517972039275/874892524...
- 4 kudos
- 568 Views
- 1 replies
- 0 kudos
Connect to SQL Developer using Custom JDBC
Hello,I'm trying to connect databricks SQL to the SQL Developer using custom JDBC.I'm getting errorjdbc:databricks:<server>:443;HttpPath=<HttpPath>;UID=token;PWD=<password> RegardsNaga
- 568 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi,We are trying to test if we can connect sql developer to databricks. did it work for you?Regards, shalini
- 0 kudos
- 199 Views
- 1 replies
- 0 kudos
Is it possible to configure Databricks to leverage an AI PC’s NVMe storage for faster I/O?
Hello Databricks Community,I’m working on improving the performance of my Databricks workflows and exploring different storage options. I have an AI PC with NVMe storage, and I want to know if it’s possible to set up Databricks to use this storage fo...
- 199 Views
- 1 replies
- 0 kudos
- 0 kudos
This is not how you should be using Databricks. Databricks is SaaS/Paas and it's main operating model is operate on data stored in Cloud Object Storage (GCS, S3, ADLS Gen 2). It is optimized for cloud storage, morever it is designed to be very fast...
- 0 kudos
- 466 Views
- 6 replies
- 0 kudos
Unity Catalog About Metastore
Registered on 2024/10 from AWS marketplace.We have created a customer management VPC and manually created the workspace.No specific metastore settings were made when the workspace was created.In the catalog screen of the account console,unity catalog...
- 466 Views
- 6 replies
- 0 kudos
- 0 kudos
Hello @tyorisoo,I hope you are doing well!Metastore manages metadata, not catalog information, schema information, table information, function information, access control information, etc. In the current state, the metastore configuration is not done...
- 0 kudos
- 450 Views
- 3 replies
- 0 kudos
Databricks CI/CD
Hi Team,How can we implement CI/CD in Databricks and its best practices, and tools to consider?Regards,Janga
- 450 Views
- 3 replies
- 0 kudos
