Databricks Community

lauraxyz

I have user input as a Notebook, which process data and save it to a global temp view. Now I have my caller notebook to execute the input Notebook with dbutils.notebook API. Since the user can do anything in their notebook, I would like to analyze...

lauraxyz

Hi all, according to this doc, we can pass data back through temp views, DBFS, or JSON data.However, in my case, i need to pass both a temp view, as well as some metadata in JSON. is there a way to exit with BOTH a view AND json, something likedbuti...

lauraxyz

I have a job to move notebook from Volume to workspace, then execute it with dbutils.notebook.run(). Instead of directly running the notebook, i want to append some logic (i.e. Save results to a certain able) at the end of the notebook, is there a su...

lauraxyz

Hi team!I have a Notebook (notebook A) in workspace and I'd like to execute it with %run command from another Notebook (notebook B). It works perfect with command: %run /workspace/path/to/notebook/ANow, i want to specify above path in a variable, an...

lauraxyz

Hi!I have a workflow job to trigger a refresh of an online table. How can I get the update_id with this specific refresh?Also, is it possible to get the status from this specific update_id?Thanks!

lauraxyz

I can have a try and see if it's the same like exit(view_name) in that the view is created in global_temp_db and that the lifecycle is with the job compute.

lauraxyz

Thanks I think dbutils.notebook.run will work well in my use case.I was following this, and was able to store the results in a temp view in callee notebook (A), and access results from the caller notebook (B). Just a quick question: how often will th...

lauraxyz

%run commands is preferred in my use case because I need to access the dataframe generated in notebook A from notebook B. with %run, that's very straightforward, since A is executed inline with the same context. If using dbutils.notebook.run, noteb...

lauraxyz

Thanks Riz! I think you are right, the sync mode was already specified when online table was created.

lauraxyz

Another qq: Since online table has 3 sync mode: Snapshot, Triggered, and Continuous. when refreshing the online table with w.pipelines.start_update(pipeline_id='{pipeline_id}', full_refresh=True) which sync mode is used by default?

Databricks Community

User Stats

User Activity

Is there a way to analyze/monitor WRITE operations in a Notebook

dbutils.notebook API: pass data back to caller notebook

Programmatically edit notebook

%run command: Pass Notebook path as a parameter

refresh online table: How to get update_id and check status of a specific update

Re: dbutils.notebook API: pass data back to caller notebook

Re: %run command: Pass Notebook path as a parameter

Re: %run command: Pass Notebook path as a parameter

Re: refresh online table: How to get update_id and check status of a specific update

Re: refresh online table: How to get update_id and check status of a specific update