Databricks Community

DataAlchemist28

Note: This blog post is a summary of a Databricks Genie step-by-step tutorial. The full tutorial and code are available for free on GitHub. Tutorial: Databricks Genie for Data Engineers and Data Scientists “Take a quick look at the data and assess ho...

DataAlchemist28 · 05-30-2023

DataAlchemist28 · 05-30-2023

DataAlchemist28 · 05-30-2023

DataAlchemist28 · 03-16-2023

we like the examples that you show in webinars especially with DLT and Huggingface or DLT with ingestion from Kafka, are they publicly available?

DataAlchemist28 · 03-16-2023

yes. check out the public github, for example:https://github.com/databricks/delta-live-tables-notebooks/tree/main/twitter-dlt-huggingface-demo

DataAlchemist28 · 08-12-2021

more details and programmatic options can be found in the Porting Guide.

DataAlchemist28 · 08-12-2021

Kinesis streams is the Kinesis streaming service. Select this!Kinesis Firehose reads data from a Kinesis stream and writes it e.g. to S3 or Redshift. or Splunk (more details here)

DataAlchemist28 · 08-12-2021

Also, unlike other servers, Delta Sharing internally uses pre-signed URLs to S3, GCS, or ADSL, so data transfer from a client happens at the bandwidth of the underlying cloud object-store. This way the Delta Sharing server scales extremely well and d...

DataAlchemist28 · 06-23-2021

yes. it is actually quite fun to build Looker dashboards on top of delta lake. here is a Databricks on Looker tutorial that I created when Databricks on GCP was released.

Databricks Community

User Stats

User Activity

Tutorial: Databricks Genie for Data Engineers and Data Scientists

If we're doing geospatial work using Mosaic, can DLT handle the complex geospatial joins?

When and why would you use a WHERE clause in the DML SQL instead of DLT expectations?

Can DLT be used to ingest from JDBC and/or and on-prem database?

DLT code examples and notebooks?

Re: DLT code examples and notebooks?

Re: Can I convert parquet files to Delta?

Re: For Databricks on AWS, when I set up a Kinesis Endpoint as shown here https://docs.databricks.com/administration-guide/cloud-configurations/aws/customer-managed-vpc.html#firewall-appliance-infrastructure should I use Kinesis Firehose or Kinesis Streams?

Re: What is the differentiator between delta sharing and other cloud sharing platform

Re: Does Looker and Delta Lake work together? Can I do BI directly on the Lakehouse?