Databricks Community

thomas_berry

Hello,I am working on an ML project for text classification and I have a problem.The following piece of code stalls completely. It prints 'start' but never 'end'.from transformers import TrainingArguments print("start") args = TrainingArguments(outpu...

thomas_berry · 05-13-2025

Hello,I am trying to migrate some spark reads away from JDBC into the federated queries based in unity catalog.Here is an example of the spark read command that I want to migrate:spark.read.format("jdbc").option("driver", "org.postgresql.Driver").opt...

thomas_berry · 04-09-2025

Hello,I want to be able to run an arbitrary query on the source before its result gets sent to databricks. I want to create something like this: create table gold.bigqueryUSING org.apache.spark.sql.jdbcoptions( url "jdbc:postgresql://---:---/---",dri...

thomas_berry

Hello @lingareddy_Alva ,Thank you for your reply. I have since been given a cluster with the ML Runtime and the code now works. So I consider the problem solved.

thomas_berry · 05-14-2025

Thank you for your reply. I will mark your answer as accepted solution but I hope that in the future this options, as you explained, gets added!

Databricks Community

User Stats

User Activity

TrainingArguments fails

federated queries on PostgreSQL - TimestampNTZ option

Federated query on the source

Re: TrainingArguments fails

Re: federated queries on PostgreSQL - TimestampNTZ option