- 4423 Views
- 2 replies
- 0 kudos
Resolved! Unable to edit Catalog Owner
I created a Catalog and ownership was assigned to meI created databricks account-group on UC, added my user to this account-group, Assigned ownership of the catalog to this account-group.I deleted the account-groupNow, the catalog ownership is showin...
- 4423 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi, In addition to the previous message, you can refer to https://docs.databricks.com/en/data-governance/unity-catalog/manage-privileges/index.html#assign-a-metastore-admin to get more information on metastore and etc.
- 0 kudos
- 2765 Views
- 2 replies
- 0 kudos
Merge version data files of Delta table
Hi,I am having one CDC enabled Delta table. In 256th version, table is having 50 data files. I want all to merge and create a single file. How can I merge all 50 data file and when I query for 256th version, I should get 1 data file? Is there any com...
- 2765 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi, ae you talking about merging CSV files? https://community.databricks.com/t5/machine-learning/merge-12-csv-files-in-databricks/td-p/3551#:~:text=Use%20Union()%20method%20to,from%20the%20specified%20set%2Fs.
- 0 kudos
- 2027 Views
- 1 replies
- 0 kudos
validating record count at SQL server database tabbles with migrated azure data lake gen2
we are migrating out project from on-premise to azure , so on-premise database is the SQL server that we are using and azure data lake gen2 is the storage location where store data currently and so far we are currently validating record count of each...
- 2027 Views
- 1 replies
- 0 kudos
- 1722 Views
- 0 replies
- 0 kudos
Deleting external table takes 8 hrs
Hi,I am trying to delete the data from the external partitioned table, it has around 3 years of data, and the partition is created on the date column.I am trying to delete each partition first and then the schema of the table, which takes around 8hrs...
- 1722 Views
- 0 replies
- 0 kudos
- 2280 Views
- 0 replies
- 0 kudos
why the code breaks below?
from pyspark.sql import SparkSessionfrom pyspark.ml.regression import LinearRegressionfrom pyspark.ml.feature import VectorAssemblerfrom pyspark.ml.evaluation import RegressionEvaluatorfrom pyspark.ml import Pipelineimport numpy as np# Create a Spark...
- 2280 Views
- 0 replies
- 0 kudos
- 1867 Views
- 2 replies
- 0 kudos
Having trouble with ARC (Automated Record Connector) Python Notebook
I'm trying to use Databricks ARC (Automated Record Connector) and running into an object issue. I assume I'm missing something rather trivial that's not related to ARC. #Databricks Python notebook #CMD1 import AutoLinker from arc.autolinker import A...
- 1867 Views
- 2 replies
- 0 kudos
- 0 kudos
https://www.databricks.com/blog/improving-public-sector-decision-making-simple-automated-record-linking and https://github.com/databricks-industry-solutions/auto-data-linkage#databricks-runtime-requirements
- 0 kudos
- 2528 Views
- 1 replies
- 0 kudos
Databricks Certified Data Engineer Associate Exam suspended
Initially, My exam was suspended after 20 mins on me into the exam. I stated that there was some internet issue from my end(however there wasn't any). However, I immediately reached out to Kryterion folks but they responded after 50 minutes and allow...
- 2528 Views
- 1 replies
- 0 kudos
- 0 kudos
Adding my username - akhil.inala@tredence.comexam - Databricks Certified Data Engineer Associate Exam
- 0 kudos
- 1860 Views
- 2 replies
- 0 kudos
Delta Sharing CDF API error: "RESOURCE_LIMIT_EXCEEDED"
Hi, When attempting to read a particular version from the Databricks Delta Sharing CDF (Change Data Feed) API, even when that version contains only one data file, an error occurs due to a timeout with following message:"errorCode": "RESOURCE_LIMIT_EX...
- 1860 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi Data_Analytics1Use Optimize on your delta tables. Refer https://docs.databricks.com/en/sql/language-manual/delta-optimize.html
- 0 kudos
- 1194 Views
- 1 replies
- 0 kudos
Databricks Pricing Model
Hello Everyone!!I'm new on Databricks Platform & I'm using Databricks for learning purposes.I want to undetstand pricing model of databricks. How Databricks calculates DBU from Compute Type & Instance Type For AWS, Azure & GCP.Can Anyone Explain It.T...
- 1194 Views
- 1 replies
- 0 kudos
- 0 kudos
I would like to share the following url https://www.databricks.com/product/pricing/product-pricing/instance-types it will help you to get a price estimation
- 0 kudos
- 3691 Views
- 0 replies
- 0 kudos
Databricks job runs - metadata tables
Hello experts,Do you know if there are available metadata/log tables with information on databricks job runs instead of using the Workflows UI?Thank you!
- 3691 Views
- 0 replies
- 0 kudos
- 1021 Views
- 1 replies
- 0 kudos
Databricks certification
I joined two events on 7th Sept,2023 and it was told that by oct 1st week 50% discounted voucher will be given .Also after joining I filled survey by attaching lakehouse fundamentals certificate. Still I didn't get any mail regarding this voucher cou...
- 1021 Views
- 1 replies
- 0 kudos
- 0 kudos
@SouvikngTo expedite your request, please list your concern on our ticketing portal. Our support staff would be able to act faster on the resolution (our standard resolution time is 24-48 hours). Thank you for posting your concern on Community!
- 0 kudos
- 2236 Views
- 2 replies
- 0 kudos
Disable personal compute for everyone including workspace admins
If we disable personal compute feature in the account console, it gets deactivated only for non-admin users but still admin users are able to create personal compute clusters. Is there way to restrict to everyone? If not, can you raise a feature requ...
- 2236 Views
- 2 replies
- 0 kudos
- 0 kudos
@DebayanI am talking about the personal compute feature here not the way how clusters are created. If personal compute feature is set to delegate, it should be disable for workspace admin users as well. If this is not supported, it's good to have fea...
- 0 kudos
- 1122 Views
- 0 replies
- 0 kudos
Cloning Github Repository Accessibility
Hi all,I am trying to clone GitHub repository on the databricks notebook, but there are some accessibility issues faced here.Already linked the GitHub in the User Settings but still not working in the command on the notebook.
- 1122 Views
- 0 replies
- 0 kudos
- 2295 Views
- 1 replies
- 0 kudos
how to upgrade pip associated with the default python
We have a job scheduled and submitted via Airflow to Databricks using api: api/2.0/jobs/runs/submit. Each time the job runs an ephemeral cluster will be launched and during the process a virtual env named: /local_disk0/.ephemeral_nfs/cluster_librarie...
- 2295 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, I got an interesting article on the same. You can follow and let us know if this helps. Please tag @Debayan with your next comment which will notify me!
- 0 kudos
- 3194 Views
- 1 replies
- 1 kudos
How connect connection ORACLE onpremise in Databricks for extract data
Hello, How Connect in Databricks Enterprise connection Oracle Onpremise and that permissions is necessary.Thank you
- 3194 Views
- 1 replies
- 1 kudos
