Databricks Community

Yuki

I want to delete tables that haven't been selected or otherwise accessed for several months.I can see the Delta table history, but I can only catch the DDL or update/insert/delete and can't catch "select".I realized that the Unity Catalog insight, ht...

Yuki

My team is currently using an instance profile to upload data to S3 since we only have Hive Metastore.I like Unity Catalog a lot, but my code uses multipart upload to S3 for efficiency.https://docs.aws.amazon.com/AmazonS3/latest/userguide/mpuoverview...

Yuki · 04-17-2025

Hi, I'm Yuki,I'm considering when I should use register_model.In my case, I'm running the training batch once a week and if the model is good, I want to update the champion.I have created the code to register the model if the score is the best.# star...

Yuki · 04-13-2025

One of the solution of [FAILED_READ_FILE.NO_HINT] Error while reading file, when display() or SELECTI got stuck with the above error when using `spark.read.table().display()` or directly query the table using %sql.While the display method is just one...

Yuki · 03-10-2025

I want to try Lakehouse monitoring in Unity Catalog.But it was failed in three table patterns.All of the drift metrics and profile metrics are No Data.I used the sample data "nyc taxi trips"And I configured the details like the following image.

Yuki

Hi @Renu_ ,I appreciate for your clear response. I now have a better understanding and will work with our admin team to develop a strategy.Thank you.

Yuki

Hi @LRALVA ,Thank you for your excellent response. I really appreciated it.I couldn't find the mention that says "Instance profiles are still supported but should be used for specific, advanced access cases." I will use it for now, recognizing that m...

Yuki · 03-11-2025

Hi @koji_kawamura ,Thank you for your prompt reply.I'm sorry I missed to read that.As you said, I changed the time columns recently 30 days, it has worked well.I could understand better about it and avoid misunderstanding.Thank you so much, I will tr...

Yuki · 03-05-2025

Hi @Advika_ ,Thank you for the clear answer.It made perfect sense to me, and I found that my understanding was correct as well.Knowing that there are clear cases where the .py format is better is reassuring for me. Thank you so much for your prompt r...

Yuki · 11-06-2024

Hello,When I had the same issue even using 14.3+, I tried this codes.```pythonimport sysimport pprintpprint.pprint(sys.path)```And I noticed that the path was throwed by old(Legacy) Repos folder. I managed the same name of the folder & Repos.Then I r...

Databricks Community

User Stats

User Activity

Can we implement Unity Catalog table lifecycle?

How do you think continuing to use instance profile to S3 multi part upload?

When does everyone utilize the model register?

One of the solution of [FAILED_READ_FILE.NO_HINT] Error while reading file, when display() or SELECT

How can I use lakehouse monitoring correctly?

Re: Can we implement Unity Catalog table lifecycle?

Re: How do you think continuing to use instance profile to S3 multi part upload?

Re: How can I use lakehouse monitoring correctly?

Re: Why is the ipynb format recommended?

Re: Import from repo