Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-26-2025 03:43 PM
Hi @jrod123 , Can you please try the below method?
1. Create a DLT view to store the api data first. If possible, get only incremental data from the API
@dlt.view
def api_data_view():
return api_df
2. Define your DLT table and append the view to your target table
@dlt.table
def target_table():
df=sparkread.table("api_data_view") #append view data
return df
This way we are separating the api transformations in a view and then appending the data.
