Databricks Community

Thanks @Kaniz_Fatma that helps!  What is the commitment term?  one month? one year?

Hi @Kaniz_Fatma Thanks for getting back with so valuable information.SystemFile sizeDurationSystemDurationCommentsComments1EMR225 GB22 minsDatabricks63 minsEMR is cheaper than Databricks by 5 timesThis involves various S3 writes with m5d4xlargeEMR225...

Hi @haseeb2001, It seems you’re encountering an issue after logging your Spark pipeline model using the fe.log_model function in MLflow. Let’s break down the steps and address the error: Pipeline Stages: You’ve mentioned several stages in your S...

It could be, but I can still list the job permissions, so it's creating some kind of job... Is there a way of adding from the begining/updating tags into that job?

Hi @Kaniz_FatmaThanks for your response. I was able to generate the token of the service principal following this doc, later saved it in the <Databricks Token> variable prompted when running databricks-connect configure command in terminal. And was a...

Hi Team, We don't see option at UCX command level  passing parameters as json /config file, could you please help me in this case how we can automate the installation.    

Hi @nidhin , Good Day!  The reason behind the below error while trying to access the external dbfs mount file using "with open" is that you are using a shared access mode cluster. 'FileNotFoundError: [Errno 2] No such file or directory: '/dbfs/mnt/ra...

Hi @Phani1, The UCX Toolkit is a powerful tool for upgrading your Databricks workspace to Unity Catalog. It helps you migrate various assets within your workspace, including: Legacy Table ACLsEntitlementsAWS instance profilesClusters and cluster p...

Hi @Phani1,  Understand Databricks Units (DBUs): A DBU (Databricks Unit) is the fundamental unit of consumption within the Databricks platform.DBUs are based on the number of nodes and the computational power of VM instance types in your clusters...

Hi @Ramacloudworld, It seems you’re encountering an issue with the surrogate key generation in your merge code. Let’s break it down and address the problem. Surrogate Keys: A surrogate key is a system-assigned unique value used to identify an ent...

Hi @Eric76, Welcome to the Databricks community! Let’s address the issue you’re facing with importing data in your notebook. The example notebook you’re trying to run relies on a dataset located at /dbfs/databricks-datasets/wine-quality/winequalit...

Hey there! Thanks a bunch for being part of our awesome community!  We love having you around and appreciate all your questions. Take a moment to check out the responses – you'll find some great info. Your input is valuable, so pick the best solution...

Hi @Kaniz_Fatma , thanks for your quick answer.There is no other way to monitor notebook runs. I ask this because adding tags to the cluster and workspace does not solve my problem, considering that everyone uses the same cluster and the same workspa...