Containerized Databricks/Spark database
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-08-2022 01:33 AM
Hello. I'm fairly new to Databricks and Spark.
I have a requirement to connect to Databricks using JDBC and that works perfectly using the driver I downloaded from the Databricks website ("com.simba.spark.jdbc.Driver")
What I would like to do now is have a locally running instance of a database in docker that I can connect to using the same driver. I'd like to automatically initialise the database by creating tables when it starts up. Very much like how you would use docker-entrypoint-initdb.d when creating tables on startup for Postgresql.
I'd then like to insert some data and run some tests locally.
Is any of this possible?
Labels:
- Labels:
-
Containerized Databricks
-
Database