Databricks Community

thib · 06-14-2022

I have a job running multiple tasks :Task 1 runs a machine learning pipeline from git repo 1Task 2 runs an ETL pipeline from git repo 1Task 2 is actually a generic pipeline and should not be checked in repo 1, and will be made available in another re...

thib · 02-01-2022

For timeseries feature tables, an inner join is made at the creation of the feature table. For the other type of feature tables, a left join is made, so NaN values can show up in the training set. Can the inner join in create_training_set() method be...

thib · 01-28-2022

I have created a feature table (Databricks runtime ML 10.2) that includes a timestamp column as a primary key, that is not used as a feature but as a column to join on.I have then created a model that trains from this feature table and some additiona...

thib · 06-16-2022

Hi @Prabakar Ammeappin , task2 depends on task1, as it sends out the results from task1.I also tried removing the dependency and edited the git reference, but it changes the git reference for all the tasks in the job.Do you know if that is a feature...

thib · 03-15-2022

Hi, it did not, but at least I know they are not fully supported so a workaround is to avoid timestamps, so I suppose you can mark this as resolved

thib · 02-02-2022

Thank you Hubert, that's a good alternative, I just thought I'd stick to the api as much as possible, but this solves it.

thib · 01-29-2022

Thanks for your reply Hubert. Yes, casting it to long or int does solve the issue, but it is a workaround and I would like to keep the data as-is, with directly interpretable timestamps, especially when there is no reason why they should trigger an e...

Databricks Community

User Stats

User Activity

Can we use multiple git repos for a job running multiple tasks?

Feature store : Can create_training_set() be implemented to execute an inner join?

Feature Store : for sklearn flavored models, are timestamps fully supported?

Re: Can we use multiple git repos for a job running multiple tasks?

Re: Feature Store : for sklearn flavored models, are timestamps fully supported?

Re: Feature store : Can create_training_set() be implemented to execute an inner join?

Re: Feature Store : for sklearn flavored models, are timestamps fully supported?