Without downloading the files directly every time, you have to create a sql warehouse cluster and connect to it via jdbc connection. This way you just use the requests library in python (or an equal one in another language like axios for javascript) and will get the response back in its format within the table. I haven't done this myself but if you do, let me know how it works out.
