- 3548 Views
- 8 replies
- 5 kudos
create an external connection to oracle
Hi! I've been trying to create an external connection to oracle but getting the following error message "Detailed error message: ORA-00604: error occurred at recursive SQL level 1 ORA-01882: timezone region not found" I searched online and found some...
- 3548 Views
- 8 replies
- 5 kudos
- 5834 Views
- 6 replies
- 0 kudos
Connect Oracle Fusion (ERP / HCM) to Databricks
Any suggestion to connect Oracle Fusion (ERP/HCM) to Databricks?I have explored a few options including the use of Oracle Integration Cloud but it requires a lot of customization.
- 5834 Views
- 6 replies
- 0 kudos
- 0 kudos
Check out BI Connector(https://www.biconnector.com/oracle-fusion-data-warehouse-integration/), which offers direct connectivity from Oracle Fusion/FDI/OAC to DW/Lakehouse/Power BI/Tableau and more. It's widely deployed among Oracle Fusion & Analyti...
- 0 kudos
- 1888 Views
- 4 replies
- 3 kudos
Resolved! Data Pipeline for Bringing Data from Oracle Fusion to Azure Databricks
I am trying to bring Oracle Fusion (SCM, HCM, Finance) Data and push to ADLS Gen2. Databricks used for Data Transformation and Powerbi used for Reports Visualization.I have 3 Option.Option 1 :Option 2 : Option 3May someone please help me which is bes...
- 1888 Views
- 4 replies
- 3 kudos
- 3 kudos
BICC is suitable for certain use cases, but it has several limitations and is not particularly user-friendly. BICC uses PVOs which cause a huge operational gap among the users:IT/DW teams: Its a multi-hop(BICC-file system-OCI-ADW-delta share) proces...
- 3 kudos
- 1258 Views
- 4 replies
- 2 kudos
Support Request: Issue Running Multiple Ingestion Gateway Concurrently
Hi, we are ingesting data using Databricks Lake flow SQL connector from two different SQL Server databases hosted on separate servers. As part of the setup:We created two separate Ingestion Gateways.We created two separate ingestion pipelines.Both pi...
- 1258 Views
- 4 replies
- 2 kudos
- 2 kudos
Hi @Louis_Frolio , I’ve successfully ingested one SQL database using the Lakeflow SQL connector. As part of the setup, I created an ingestion pipeline along with a gateway, and it is working as expected - when I run or re-run the pipeline, it picks u...
- 2 kudos
- 1277 Views
- 2 replies
- 0 kudos
Serverless compute cannot access internet
I'm experiencing "Network is unreachable" errors when trying to access external APIs from serverless compute jobs, despite having a network policy configured to allow access to all destinations. I have the "Serverless egress control" in the account s...
- 1277 Views
- 2 replies
- 0 kudos
- 0 kudos
The ongoing "Network is unreachable" errors in Databricks serverless compute suggest that network egress is being blocked, even though you have "Full access" set for Serverless Egress Control and a permissive network policy. The partial DNS resolutio...
- 0 kudos
- 9146 Views
- 6 replies
- 2 kudos
Resolved! Trouble Enabling File Events For An External Location
Hello all,I am trying to enable file events on my Azure Workspace for the File Arrival Trigger trigger mode for Databricks Workflows. I'm following this documentation exactly (I think) but I'm not seeing the option to enable them. As you can see here...
- 9146 Views
- 6 replies
- 2 kudos
- 2 kudos
I also have an external location that is a ADLS v2 however from databricks I only want to grant read access to the managed identity. I want to use file arrival trigger but want to have option of using more than 50 such triggers. Is it possible to onl...
- 2 kudos
- 8247 Views
- 12 replies
- 1 kudos
Resolved! Options to access files in the community edition
As of now DBFS option is disabled in the Databricks community edition. What are the other ways to use file in the Databricks notebooks for learning? When I go to catalog it show default option only with the AWS S3. Is it the only option to access the...
- 8247 Views
- 12 replies
- 1 kudos
- 2822 Views
- 3 replies
- 0 kudos
Resolved! How do I choose between a standard cluster and a shared cluster in Databricks?
When should I use a single-user cluster, and when should I use a multi-user/shared cluster? What’s the difference and how do I pick the right one?
- 2822 Views
- 3 replies
- 0 kudos
- 0 kudos
Agree with previous responses BUT consider using a dedicated cluster if using it under an "automation security principal" identity for a subset of your jobs, if that makes sense. To summarize, you need to run a job, under a non-human identity and you...
- 0 kudos
- 1035 Views
- 3 replies
- 0 kudos
POC on spark 4.x
I need to do some POC with spark 3.5.7 and 4.x and need some local setup with some sample Kafka source. The POC would read data from Kafka via streaming job and write to delta table and I would like to do this on spark-4.x ..Do you know of any quick ...
- 1035 Views
- 3 replies
- 0 kudos
- 0 kudos
Hello @RevanthV , I did some digging and here are some helpful tips. Got it — here are fast, reproducible ways to stand up a local Kafka source and run a Spark Structured Streaming job that writes to a Delta table, plus the common fixes for the conne...
- 0 kudos
- 1250 Views
- 2 replies
- 1 kudos
Dashboard Filters (Showing Description) but selecting the id value for use query parameters
HiIs there a way to have a Single or multiple filter in a Dashboard that shows titles/names but on selection passes in the identifier as query parameter filters. The cost management dashboard shipped by Databricks seems to do this for the workspace s...
- 1250 Views
- 2 replies
- 1 kudos
- 1 kudos
I wanted to share my solution to this, hope this helps. Create a SQL function that accepts an ARRAY<STRING>, extracts a numeric ID enclosed in parentheses from the end of each string, and returns an ARRAY<BIGINT>.Example UsageInput: ["Item (1)", "Ite...
- 1 kudos
- 1266 Views
- 3 replies
- 2 kudos
Resolved! Cannot view nested MLflow experiment runs without changing URL
Hello,I've recently been testing out Databricks experiments for a project of mine. I wanted to nest runs, and then see these runs grouped by their parent in the experiments UI. For the longest time, I couldn't figure out how to do this. I was seeing ...
- 1266 Views
- 3 replies
- 2 kudos
- 2 kudos
@africke , If you’re happy with the results, please go ahead and accept this as the solution so others know it worked.
- 2 kudos
- 1029 Views
- 4 replies
- 1 kudos
Resolved! Got an empty query file when cloning Query file.
Hello Community,In our AWS Databricks environment, we’ve encountered some behavior we don’t understand while performing the following operation.When we clone a query file that already has content, a new file is created with the same name and “(clone)...
- 1029 Views
- 4 replies
- 1 kudos
- 1 kudos
@kyeongmin_baek - There is no aut-save or CMD+S for Query as it get saved only once it is attached to a cluster AND 'SAVE' icon is used. However, it still stays in cache as unsaved in that 'query' window but cloning or other file operations may lose ...
- 1 kudos
- 701 Views
- 2 replies
- 0 kudos
Error while creating databricks custom app
I am trying to create a simple databricks custom app but I am getting Error: Could not import 'app'. error.app.yaml fileenv: - name: FLASK_APP value: '/Workspace/Users/sam@xxx.com/databricks_apps/hello-world_2025_11_13-16_19/Gaap_commentry/app'comm...
- 701 Views
- 2 replies
- 0 kudos
- 0 kudos
Thanks, I have modified the yaml file but still getting Error: Could not import 'app' errorenv: - name: FLASK_APP value: '/Workspace/Users/xxx@zzz.com/databricks_apps/hello-world_2025_11_13-16_19/Gaap_commentry'command: [ "flask", "--app", "...
- 0 kudos
- 515 Views
- 1 replies
- 2 kudos
Resolved! Usage Dashboard from Cody Austin Davis displays only DBUs or overall cost including the VM uptime?
Hello,I have been looking at the new Dashboard created by @CodyA ( great job! ) and I was wondering if the cost displaying only provides visibility to only the databricks mark-up on each job ( i.e. $ DBUs ) or to the overall cost including cloud prov...
- 515 Views
- 1 replies
- 2 kudos
- 2 kudos
As the dashboard uses System Tables (system.billing.usage) to show spend across Jobs, SQL, and Notebooks, I dont beleive it includes cloud provider VM costs.
- 2 kudos
- 3949 Views
- 3 replies
- 4 kudos
Resolved! how to know which join type was used (broadcast, shuffle hash or sort merge join) for a query?
What is the best way to know what kind of join was used for a SQL query between broadcast, shuffle hash and sort merge? How can the spark UI or the query plan be interpreted?
- 3949 Views
- 3 replies
- 4 kudos
- 4 kudos
@smoortema , Spark performance tuning is one of the hardest topics to teach or learn, and it’s even tougher to do justice to in a forum thread. That said, I’m really glad to see you asking the question. Tuning is challenging precisely because there a...
- 4 kudos
| User | Count |
|---|---|
| 1644 | |
| 793 | |
| 571 | |
| 349 | |
| 287 |
