Auto-Update API Data

- - Certifications
- - Learning Paths
- - Databricks Product Tours
- - Get Started Guides
- - Product Platform Updates

- - Get Started Resources
- - Events
- - Support FAQs
- - Technical Blog
- - Knowledge Sharing Hub
- - Announcements
- - DatabricksTV

- - Private Groups
  - Farfetch Databricks User Community
- - Skills@Scale

- - Databricks Community Champions
- - Khoros Community Forums Support (Not for Databricks Product Questions)
- - Databricks Community Code of Conduct

Get Started Discussions

Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.

Not sure if this has come up before, but I'm wondering if Databricks has any kind of functionality to "watch" an API call for changes?

E.g. Currently I have a frequently running job that pulls data via an API call and overwrites the old data. This seems pretty inefficient since the data from the API call may or may not change between each overwrite. In fact, the data from the API call changes in an "ad-hoc" basis so it would be nice to pull data from the API *only* when there are data changes.