- 698 Views
- 1 replies
- 0 kudos
How do i find total number of input tokens to genie ?
I am calculating usage analytics for my work, where they use genie.I have given the following for my genie as definition:(1) instructions (2) example SQL queries (3) Within catalog, i went to those relevant table schema and added comments, descriptio...
- 698 Views
- 1 replies
- 0 kudos
- 0 kudos
Or is there any set of tables and functions to determine the number of input and output tokens per query?
- 0 kudos
- 1104 Views
- 7 replies
- 0 kudos
Cluster logs folder
Hi, I can't see to find the cluster_logs folder, anyone that can help me find where the cluster logs are stored? Best regards
- 1104 Views
- 7 replies
- 0 kudos
- 0 kudos
Thank you for the help! I have enabled predictive optimization for unity catalog, thinking it would automatically preform VACCUM on the tables i have in my delta lake. With that in mind, I assumed VACCUM wouldn't require further attention.Would it be...
- 0 kudos
- 4088 Views
- 1 replies
- 1 kudos
Resolved! requirements.txt with cluster libraries
Cluster libraries are supported from version 15.0 - Databricks Runtime 15.0 | Databricks on AWS.How can I specify requirements.txt file path in the libraries in a job cluster in my workflow? Can I use relative path? Is it relative from the root of th...
- 4088 Views
- 1 replies
- 1 kudos
- 1 kudos
To use the new "requirements.txt" feature in your cluster do the following:Change your cluster's "Databricks Runtime Version" to 15.0 or greater (example: "15.4 LTS ML (includes Apache Spark 3.5.0, Scala 2.12)"). Navigate to the cluster's: "Libraries...
- 1 kudos
- 1147 Views
- 1 replies
- 0 kudos
Can we share Delta table data with Salesforce using OData?
Hello!I'm seeking recommendations for streaming on-demand data from Databricks Delta tables to Salesforce. Is OData a viable choice?Thanks.
- 1147 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @ChristopherQ1, Salesforce has released a zero-copy connection that relies on the SQL Warehouse to ingest data when needed. I suggest you consider that instead of OData. Matthew
- 0 kudos
- 287 Views
- 0 replies
- 0 kudos
Paralellizing XGBoost Hyperopt run using Databricks
Hi there!I am implementing a classifier for classifying documents to their respective healthcare type.My current setup implements the regular XGBClassifier of which the hyperparameters are to be tuned on my dataset, which is done using Hyperopt. Base...
- 287 Views
- 0 replies
- 0 kudos
- 2688 Views
- 5 replies
- 1 kudos
Variables in databricks.yml "include:" - Asset Bundles
HI,We've got an app that we deploy to multiple customers workspaces. We're looking to transition to asset bundles. We would like to structure our resources like: -src/ -resources/ |-- customer_1/ |-- job_1 |-- job_2 |-- customer_2/ |-- job_...
- 2688 Views
- 5 replies
- 1 kudos
- 1 kudos
I have a similar use case. We have two different host for databricks, EU and NA. In some case we need to deploy a similar job in both hosts. To fix that, here how I did:- Into job folder I created different job files, each one for one host. In aditio...
- 1 kudos
- 892 Views
- 1 replies
- 0 kudos
Databricks Apps is now available in Public Preview
Databricks Apps is a new way to build and deploy internal data and AI applications is now available in Public Preview.Databricks Apps let developers build native apps using frameworks like Dash, Shiny and Streamlit, enabling data applications for non...
- 892 Views
- 1 replies
- 0 kudos
- 0 kudos
How to enable this preview in account console?
- 0 kudos
- 654 Views
- 3 replies
- 0 kudos
Embed Dashboard - GraphQL Operation Not Authentic
I have added a domain to my list of approved domains for embedding dashboards from my Databricks instance. This domain hosts my Docusaurus site. When the page with the embedded dashboard loads, it makes some network requests to Databricks that are fa...
- 654 Views
- 3 replies
- 0 kudos
- 0 kudos
is it possible that this is happening because the website is not HTTPS?
- 0 kudos
- 14888 Views
- 4 replies
- 4 kudos
Permissions on Unity Catalog Table Constraints
Hi all.I've used new options to add constraints to UC tablesEven granting permissions to an user (ALL PRIVILEGES) on particular schema we have errors when trying to add PKs. The message doesn't make sense (PERMISSION_DENIED: User is not an owner of T...
- 14888 Views
- 4 replies
- 4 kudos
- 1060 Views
- 4 replies
- 0 kudos
Unity Catalog
I want to create Unity Catalog but can't find option "Manage Account" in drop down. I am using Azure one month free trial subscription. Is it because of free trial account?
- 1060 Views
- 4 replies
- 0 kudos
- 0 kudos
If you are an Account admin, you should see it under the workspace name. Please check whether you logged in as Account Admin.
- 0 kudos
- 693 Views
- 1 replies
- 0 kudos
Connection between Azure Databricks workspace and Microsoft Power BI on Remote Server ( Jump Box)
Both (Azure Databricks workspace & Microsoft Power) resided on Jump box server (Remote Environment) Azure Databricks connector is not visible their, the connection is possible through Third Party tool but not directly with the built in connector, a...
- 693 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Murtaza-007-007 ,You can take a look at below thread. In my company it was due to firewall rules blocking some dns required for connector.https://community.fabric.microsoft.com/t5/Desktop/PowerBi-Desktop-App-missing-databricks-connector/td-p/3474...
- 0 kudos
- 779 Views
- 1 replies
- 0 kudos
Resolved! Lakehouse Fundamentals Training Videos Not Playing
Hello, I am new to learning about Azure Databricks and decided to take the free online training to learn about it. When I try to access the videos, they will not work for me. I keep seeing a message that says to click here and accept cookies, but not...
- 779 Views
- 1 replies
- 0 kudos
- 0 kudos
Nevermind. I figured it out. It was because I have Malwarebytes browser guard enabled on my browser. Once I paused it, I could play the videos.
- 0 kudos
- 403 Views
- 0 replies
- 0 kudos
Problem with ray train and Databricks Notebook (Strange dbutils error)
Hi everyone,I'm running some code to train a multimodal Hugging Face model with SFTTrainer and TorchTrainer to use all GPU workers. When trying to execute trainer.fit() it gives me a dbutils serialization error,even I am not using dbutils directly in...
- 403 Views
- 0 replies
- 0 kudos
- 759 Views
- 1 replies
- 0 kudos
Data Ingestion into DLT from Azure Event hub batch processing
I am building my first DLT pipeline and I want to ingest data from Azure event hub for batch processing.But, I can just see documentation for streaming by using kafka.Can we do batch processing with DLT & Azure Event hub?
- 759 Views
- 1 replies
- 0 kudos
- 0 kudos
Hey @pranay , There seems to be a new documented way to achieve this: https://learn.microsoft.com/en-us/azure/databricks/delta-live-tables/event-hubs Thanks, Gab
- 0 kudos
- 201 Views
- 0 replies
- 0 kudos
save page views in Databricks?
Hi everyone,I'm considering an architecture that will store page views for later analysis on Dynamo so to move them later on in Databricks. I wonder if there's a use case to save those pages views in Databricks directly with the same level of perform...
- 201 Views
- 0 replies
- 0 kudos
