Databricks

HelpSign In
  • Get Started With Databricks
    • Get Started Discussions
    • Get Started Resources
  • Databricks Platform
    • Technical Blog
    • Databricks Platform Discussions
      • Data Engineering
      • Machine Learning
      • Warehousing & Analytics
      • Data Governance
      • Administration & Architecture
    • What's New in Databricks
  • Learning
    • Learning Discussion
      • Training Offerings
      • Certifications
    • Learning Paths
    • Certifications
  • Groups
    • Regional and Interest Groups
      • Americas
      • APAC
      • Interest Groups
  • Events
  • Community Cove
    • Community Discussions
    • Community News & Member Recognition
Showing results for 
Search instead for 
Did you mean: 
Search Options
  • Subscribe to RSS Feed for this Search
Advanced Hide Advanced
  • Posts
  • Users
  • Places
  • Products
Advanced Search Options
Search Modifiers:
You can apply modifiers to the terms you enter in the search field.
Use quotes to search for an "exact phrase".
Use the plus sign to search for +one +or +more +words.
Use the minus sign to -exclude -certain -words from your search.
Limits search results to topics that have no replies.
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
  • in accepted solutions Remove in accepted solutions filter
  • solved Remove solved filter
  • in Data Engineering Remove in Data Engineering filter
2,000 results
Sorted by:
Solution Date
  • Date
  • Views
  • Kudos
  • Replies
  • Best Match

How can I create a new calculated field in databri...

by kazinahian in Data Engineering
Wednesday
Wednesday
Hello: Great people. I am new to Databricks and pyspark learning. How can I create a new column called "sub_total"? Where I want to group by "category" "subcategory" and "monthly" sales value. ...
  • Tags:
  • calculation
Labels:
  • Labels:
  • Delta Lake
  • Spark
  • Workflows

SHOW CREATE TABLE does not return catalog prefix

by dbruehlmeier in Data Engineering
Wednesday
Wednesday
If you need the create statement of a table/view in unity catalog. The SHOW CREATE TABLE statement does not return the catalog information.  Example query of "view_c": show create table catalo...
  • Tags:
  • sql

Terminating cluster programmatically

by MichaelO in Data Engineering
Tuesday
Tuesday
Is there any python script that allows me to terminate (not delete)  a cluster in the notebook, similar to this R equivalent of terminate_cluster(cluster_id, workspace, token = NULL, verbose = ...
  • Tags:
  • cluster

MongoDB Spark Connector v10.x read error on Databr...

by silvadev in Data Engineering
‎07-26-2023 03:32 PM
‎07-26-2023 03:32 PM
...onf.mongodb.read_uri, 2 'database': 'setorizacao', 3 'collection': 'outlet', 4 'outputExtendedJson': 'true'} ----> 6 mongo_outl = s...
  • Tags:
  • mongodb
  • spark

Z-ordering optimization with multithreading

by yliu in Data Engineering
Monday
Monday
Hi,  I am wondering if multithreading will help with the performance for z-ordering optimization on multiple delta tables. We are periodically doing optimization on thousands of tables and it ...

Azure Service Bus

by Gilg in Data Engineering
Sunday
Sunday
Hi Team, My client has Azure Service Bus and wants to do streaming using DLT. In my previous client we use Event Hub to get the data. Not sure if we can do this with Service Bus. Thanks in advance,...

Apply Changes Statistics

by Gilg in Data Engineering
a week ago
1 Kudo
a week ago
1 Kudo
Hi Team, I just wanted to know why APPLY_CHANGES do not show how many rows it got upserted in the graph? Is this something in the works in the future? Cheers, G

Databricks Python Import Bug

by alvaro_databric in Data Engineering
‎05-08-2023 05:21 AM
1 Kudo
‎05-08-2023 05:21 AM
1 Kudo
Hello, I am reaching to the community in order to shed some light into a Bug I have been encountering recently. The two setups are as follows: SETUP-1 (WORKS): Python Notebook in Workspace Fi...
Labels:
  • Labels:
  • Community
  • Databricks Repos

git integration with volumes?

by werners1 in Data Engineering
2 weeks ago
2 weeks ago
Volumes in unity are said to be ideal for "storing library and config files of arbitrary formats such as .whl or .txt centrally and providing secure access across workspaces to it". So basically t...

404 on GET Billing usage data (API)

by vdeorios in Data Engineering
‎08-16-2023 11:04 AM
‎08-16-2023 11:04 AM
I'm trying to get my billing usage data from Databricks API (documentation: https://docs.databricks.com/api/gcp/account/billableusage/download) but I keep getting an 404 error. Code: import...
  • « Previous
    • 1
    • 2
  • Next »

Product

  • Platform Overview
  • Pricing
  • Open Source Tech
  • Try Databricks
  • Demo

Learn & Support

  • Documentation
  • Glossary
  • Training & Certification
  • Help Center
  • Legal
  • Online Community

Solutions

  • By Industries
  • Professional Services

Company

  • About Us
  • Careers at Databricks
  • Diversity and Inclusion
  • Company Blog
  • Contact Us
Simple Administration See Careers
at Databricks
Databricks
  • Linkedin
  • Facebook
  • Twitter
  • Feed
  • Glassdoor
  • Youtube
Databricks Inc.
160 Spear Street, 13th Floor
San Francisco, CA 94105
1-866-330-0121
© Databricks 2023. All rights reserved. Apache, Apache Spark, Spark and the Spark logo are trademarks of the Apache Software Foundation.
  • Privacy Notice
  • |Terms of Use
  • |Your Privacy Choices
  • |Your California Privacy Rights
  • Global Privacy Control Icon