Databricks Community

zmsoft · 04-02-2025

Hi there,The example description of custom event hooks in the documentation is not clear enough, I do not know how to implement it inside python functions. event-hooks My Code: %python # Read the insertion of data raw_user_delta_streaming=spark.rea...

zmsoft · 03-09-2025

Hi there, How do I use the azure databricks dlt pipeline to consume azure Event Hub dataCode :TOPIC = "myeventhub" KAFKA_BROKER = "" GROUP_ID = "group_dev" raw_kafka_events = (spark.readStream .format("kafka") .option("subscribe", EH_NAME) .opt...

zmsoft · 02-06-2025

Hi there, How to copy file from UC volume to external location folder Thanks&Regards, zmsoft

zmsoft · 12-29-2024

Hi there, I would like to know how to load power bi dataset into databricks Thanks&Regards, zmsoft

zmsoft · 10-29-2024

Hi there,I would like to know the difference between Azure Purview and Unity catalog? Respective advantages and disadvantages.Thanks & Regards,zmsoft

zmsoft

Hi @Priyanka_Biswas , from pyspark.sql import SparkSession, functions as F, types as T from pyspark.sql.streaming import DataStreamWriter import smtplib from email.mime.text import MIMEText from email.mime.multipart import MIMEMultipart import os imp...

zmsoft · 04-07-2025

Hi @Priyanka_Biswas ,Thanks for your answer.What I want to implement is to set a security threshold for a field in a streaming table, and when the custom event detects that new data exceeds the security threshold, it triggers an alert, notifies the u...

zmsoft · 10-30-2024

I think INIT script is the only way, because when you run the script in notebook, you will get error message, it says you are not root need password.

zmsoft · 10-29-2024

In Unity catalog environment, if you want to using odbc driver to update database rows, you need to create a volumn, and put the odbc install script file to volumn, then add allow list. After that you can modify computer configuration to add init scr...

zmsoft · 10-15-2024

Hi @ShresthaBaburam ,Thank you for your response. My storage account has hierarchical namespaces enabled, and I have chose a directory not a file.

Databricks Community

User Stats

User Activity

How to set DLT pipeline warning alert?

How do I use the azure databricks dlt pipeline to consume azure Event Center data

How to copy file from UC volume to external location folder

How to load PowerBI Dataset into databricks

Azure Purview VS Unity Catalog

Re: How to set DLT pipeline warning alert?

Re: How to set DLT pipeline warning alert?

Re: Error: ('01000', "[01000] [unixODBC][Driver Manager]Can't open lib 'ODBC Driver 17 for SQL

Re: Error: ('01000', "[01000] [unixODBC][Driver Manager]Can't open lib 'ODBC Driver 17 for SQL

Re: Why is mounts = dbutils.fs.mounts () not available now?