We have a Catalog pointing to an External Data Source (Google BigQuery).
1) In a notebook, create a cell where it runs a query to populate a Dataframe. Display results.
2) Create another cell below and display the same Dataframe.
3) I get different results! Why? Code below. This does not happen when querying databricks tables.
##-- First cell --##
df_sample_ids = (spark.table('`catalog_external`.my_schema.my_table')
.filter(F.col('date_created').between('2025-01-17', '2025-01-18')))
display(df_sample_ids)
##-- 2nd cell --##
display(df_sample_ids)