- 4481 Views
- 7 replies
- 11 kudos
Resolved! databricks
what new anounce is most interest for you in DAIS 2023 ？
- 4481 Views
- 7 replies
- 11 kudos
- 17351 Views
- 2 replies
- 5 kudos
Resolved! Delta table with Varchar column vs string column
Databricks support string data type. But I can still create delta table with varchar data type. Just wonder what is different between delta table with string and delta table with varchar:-- delta table with stringCREATE TABLE persons(first_name STRIN...
- 17351 Views
- 2 replies
- 5 kudos
- 5 kudos
VARCHAR allows you to specify the size of the string expected in the column. This is useful when you know your column cannot exceed a set size (ie for a name, a code etc).It is equivalent to a CHECK contraint on the size. Trying to insert a value tha...
- 5 kudos
- 3969 Views
- 3 replies
- 4 kudos
Resolved! ParseException: mismatched input 'PRIMARY'
I got parseException issue and I have no idea what cause the problem:ParseException: mismatched input 'PRIMARY' expecting {')', ',', 'CONSTRAINT'}(line 2, pos 44)== SQL == CREATE TABLE persons(first_name STRING NOT NULL, last_name STRING NOT NULL, ni...
- 3969 Views
- 3 replies
- 4 kudos
- 4 kudos
You can only declare Primary and foreign keys on fields on Unity Catalog. You also need Databricks Runtime 11.1+Otherwise only NOT NULL and CHECK constraints are supported.More info : https://docs.databricks.com/tables/constraints.html
- 4 kudos
- 7482 Views
- 3 replies
- 6 kudos
Resolved! ON VIOLATION DROP ROW Question!
What exactly does "ON VIOLATION DROP ROW" do?
- 7482 Views
- 3 replies
- 6 kudos
- 6 kudos
Hi @chorongs , There is a feature available in Delta Live tables where you can check the quality of your dataset at the time of your load to target table and take action like dropping those invalid records that did not meet your conditions, making yo...
- 6 kudos
- 4570 Views
- 4 replies
- 4 kudos
How to create a new group in the databricks community?
Can a member create a new group in the databricks community, if yes can anyone let me know the steps, or where can I able to create a new group?
- 4570 Views
- 4 replies
- 4 kudos
- 4 kudos
Any updates to this topic ? I'd like to create a group for my company as well.
- 4 kudos
- 3133 Views
- 2 replies
- 2 kudos
medium.com
Hi All, I recently published a streaming data comparison between Snowflake and Databricks. Hope you enjoy! Please let me know what you think! https://medium.com/@24chynoweth/data-streaming-at-scale-databricks-and-snowflake-ca65a2401649
- 3133 Views
- 2 replies
- 2 kudos
- 872 Views
- 0 replies
- 0 kudos
Visualization to Dashboard for Map Display does not work
I want to put the above Map in a Dashboard, but it only displays table (see below) for me. Please help.
- 872 Views
- 0 replies
- 0 kudos
- 923 Views
- 0 replies
- 0 kudos
From Visualization to Dashboard -- months order is gone
On my notebook for Visualization, it is perfect which the months are sorted correctly, as it is ordered by month_numeric. However, when I bring over to the Dashboard, its month is not sorted in the order which I need (see below). Where do I miss some...
- 923 Views
- 0 replies
- 0 kudos
- 6606 Views
- 4 replies
- 0 kudos
Fundamentals of the Databricks Lakehouse Platform Accreditation (V2)
Hi,After 48 hours after passing the exam, I didn´t receive any certification. My ID: E-03DK31. This is the prevous ticket Ticket URL: https://help.databricks.com/s/case/5008Y00002AAdImQAL
- 6606 Views
- 4 replies
- 0 kudos
- 2186 Views
- 4 replies
- 2 kudos
Resolved! Please provide more information about Photon
Please provide more information about Photon
- 2186 Views
- 4 replies
- 2 kudos
- 2 kudos
There is some information here, in case you haven't checked yet, this may help gaining some knowledge. https://www.databricks.com/product/photon
- 2 kudos
- 970 Views
- 1 replies
- 0 kudos
Cross region DR setup.
Does anybody have any guidance on the best practices in setting up a DR env on a different region or on a different cloud ?
- 970 Views
- 1 replies
- 0 kudos
- 0 kudos
@ariforu cross region you can setup, but different cloud looks as of now it is not supported. did you get a chacne to go through this https://docs.databricks.com/administration-guide/disaster-recovery.html
- 0 kudos
- 7531 Views
- 5 replies
- 1 kudos
How to register a JDBC Spark dialect in Python?
I am trying to read from a databricks table. I have used the url from a cluster in the databricks. I am getting this error: java.sql.SQLDataException: [Simba][JDBC](10140) Error converting value to int.After these statements:jdbcConnUrl= "jdbc:spark:...
- 7531 Views
- 5 replies
- 1 kudos
- 19942 Views
- 3 replies
- 11 kudos
How do I access the account console of Databricks in Azure?
To create a Unity metastore the docs refer me to the account console in Databricks, see:https://docs.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/create-metastoreHowever when I go to manage account, I get redirected to select wo...
- 19942 Views
- 3 replies
- 11 kudos
- 11 kudos
Please refer here - https://community.databricks.com/s/question/0D58Y000098lIqgSAE/unity-catalog-azure-account-console-how-to-accessYou must be an Azure Databricks account admin.The first Azure Databricks account admin must be an Azure Active Directo...
- 11 kudos
- 42388 Views
- 10 replies
- 12 kudos
How to efficiently process a 50Gb JSON file and store it in Delta?
Hi, I'm a fairly new user and I am using Azure Databricks to process a ~50Gb JSON file containing real estate data. I uploaded the JSON file to Azure Data Lake Gen2 storage and read the JSON file into a dataframe.df = spark.read.option('multiline', '...
- 42388 Views
- 10 replies
- 12 kudos
- 12 kudos
The spark connector is super slow. I found loading json into Azure cosmos dB then writing queries to get sections of data out was 25x times faster because cosmos dB indexes the json. You can stream read data from cosmosdb. You can find python code sn...
- 12 kudos
- 1799 Views
- 2 replies
- 1 kudos
Refresh delta
How refresh delta table with New raw from CDC Json file.
- 1799 Views
- 2 replies
- 1 kudos
- 1 kudos
To refresh a delta table with new raw data from a CDC JSON file, you can use change data capture (CDC) to update tables based on changes in source data. Here are the steps:1. Create a streaming table using the CREATE OR REFRESH STREAMING TABLE statem...
- 1 kudos
| User | Count |
|---|---|
| 1613 | |
| 771 | |
| 349 | |
| 286 | |
| 253 |
