Generally speaking, I think people use the Databricks SQL connector for Python to connect Streamlit to Databricks data. I think you would run the web server on a container or different server. Not necessarily a databricks cluster.

https://docs.databricks.com/dev-tools/python-sql-connector.html

This example uses pandas but I would recommend the connector I linked above here.