- 10360 Views
- 8 replies
- 3 kudos
403 FORBIDDEN You don't have permission to access this page 2023-07-02 08:03:23 | Error 403 | https:
I am getting above message when trying to access the quiz for Generative AI Fundamentals.
- 10360 Views
- 8 replies
- 3 kudos
- 8477 Views
- 5 replies
- 3 kudos
Databricks Asset Bundles and Dashboards
Hi Databricks Team! I saw in the documentation that Databricks Asset Bundles will support Dashboards as well in the future. Could you please share, when we can expect that feature to be available? Is it coming only for the new Lakeview dashboards or ...
- 8477 Views
- 5 replies
- 3 kudos
- 3 kudos
It is now supported with asset bundles, an example in github can be found here : https://github.com/databricks/bundle-examples
- 3 kudos
- 1756 Views
- 3 replies
- 1 kudos
How to Set Custom Expiration Time for TOKEN Authentication in Databricks Recipient using Terraform?
Hello Databricks Community,I am using Terraform to create a Databricks recipient for sharing data with a non-Databricks user. The recipient is set up with authentication_type = "TOKEN", which generates a temporary URL to download a credentials file....
- 1756 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @Sudheer2, Could you please try enabling debug logs? TF_LOG=DEBUG DATABRICKS_DEBUG_TRUNCATE_BYTES=250000 terraform apply -no-color 2>&1 |tee tf-debug.log
- 1 kudos
- 3763 Views
- 1 replies
- 0 kudos
Delta Live Tables and GIT
Notebooks that runs in a delta live table are GIT enabled, but what about the Delta Live Table pipeline?I'm looking for a good way to deploy pipelines from DEV to TEST and TEST to PROD that not just deploy the notebooks but also the pipeline.What pos...
- 3763 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @Henrik , Databricks Asset Bundles would help you do this - https://docs.databricks.com/en/dev-tools/bundles/pipelines-tutorial.html Also this is a wonderful post addressing your query - https://www.databricks.com/blog/applying-software-develop...
- 0 kudos
- 881 Views
- 2 replies
- 0 kudos
Enable delta sharing oss using pyspark.
I have started the delta sharing server.Using guide on https://github.com/delta-io/delta-sharing.But I am not able to create a profile.How can I correctly create profile and share the table through delta sharing with the data stored in MinIO?
- 881 Views
- 2 replies
- 0 kudos
- 0 kudos
@gupta_tanmay wrote:I have started the delta sharing server.Using guide on https://github.com/delta-io/delta-sharing.But I am not able to create a profile.How can I correctly create profile and share the table through delta sharing with the data stor...
- 0 kudos
- 953 Views
- 1 replies
- 0 kudos
Migration to new Tools
Has anyone else taken a migration journey from SAS to a different language/platform?? Love to hear about your journey…
- 953 Views
- 1 replies
- 0 kudos
- 0 kudos
@cannonball111 Yes, we have done using Travinto Technologies tool
- 0 kudos
- 1788 Views
- 1 replies
- 0 kudos
Use DataBricks migration tool to export query
Dear all,I tried to use Databricks migration tool (https://github.com/databrickslabs/migrate) to migrate objects from one Databricks instance to another. I realized that notebooks, clusters, jobs can be done but queries can not be migrated by this to...
- 1788 Views
- 1 replies
- 0 kudos
- 0 kudos
@yjiao If you're planning to migrate from your current technology to Databricks, Travinto Technologies' Code Converter Tool is here to make the process seamless. This powerful tool enables you to migrate data, ETL workflows, and reports across platf...
- 0 kudos
- 3149 Views
- 1 replies
- 0 kudos
URGENT - Databricks workspace deletion & recovery
Hi Team,I accidentally deleted our databricks workspace, which had all our artefacts and control plane, and was the primary resource for our team's working environment.Could anyone please help on priority, regarding the recovery/ restoration mechanis...
- 3149 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello data-warriors Note: Users cannot recover the deleted Databricks instance directly from Azure Portal. Deleted databricks instance can be only recovered by opening a support ticket, where our core engineering team will help you to recover the Da...
- 0 kudos
- 2850 Views
- 1 replies
- 0 kudos
Unity catalog Migration
Hi Team,Could you please help me to understand, 1)Why we need to migrate Unity catalog? if we are not migrating what benefits we will not get?2) How to migrate Unity catalog (What all are objects needs to migrate and any tool) ? Regards,Phanindra
- 2850 Views
- 1 replies
- 0 kudos
- 0 kudos
@Phani1 if you're planning to migrate from your current technology to Databricks, Travinto Technologies' Code Converter Tool is here to make the process seamless. This powerful tool enables you to migrate data, ETL workflows, and reports across platf...
- 0 kudos
- 1180 Views
- 2 replies
- 0 kudos
Disable mlflow autologging in a helper notebook
We have a helper function that uses a sklearn estimator. We don't want to to be logged to mlflow.I can dodef myfunc(): import mlflow with mlflow.autolog.ignore: # train model # use model return predictionsBut I get info prints:...
- 1180 Views
- 2 replies
- 0 kudos
- 0 kudos
mlflow.autolog(disable=True, silent=True) fixes the printing. But my other problem with setting autologging back to previous state is still unsolved. I can't find any information about that problem in the docs.
- 0 kudos
- 1530 Views
- 1 replies
- 1 kudos
end-to-end lineage using Unity Catalog
Hi Team,what is the Possibilities of getting end-to-end lineage using Unity CatalogRegards,Phanindra
- 1530 Views
- 1 replies
- 1 kudos
- 1 kudos
Hello Phanindra, Inside Databricks ecosystem, you can easily get end-to-end lineage. The data lineage will be build automatically as you ingest and transform data inside the lakehouse. Here is a technical view on how this is achieved: On the other ha...
- 1 kudos
- 1813 Views
- 1 replies
- 0 kudos
Data Masking issue
Hi Team,After successfully creating a group and populating it with members, I am facing the problem of the is_member() function always returning False, despite the user being part of the group. This issue is specific to my sandbox Databricks Account....
- 1813 Views
- 1 replies
- 0 kudos
- 0 kudos
Can you post your code? I use the 'is_account_group_member' in my code as follows. Also note there is a alternative to Dynamic Views that is preferred. It's named 'Row filtering and Column masking'. Go here to learn more: https://docs.databricks...
- 0 kudos
- 2730 Views
- 6 replies
- 0 kudos
databricks asset bundle error-terraform.exe": file does not exist
Hi,I am getting below error while I am deploying databricks bundle using azure devops release 2024-07-07T03:55:51.1199594Z Error: terraform init: exec: "xxxx\\.databricks\\bundle\\dev\\terraform\\xxxx\\.databricks\\bundle\\dev\\bin\\terraform.exe": ...
- 2730 Views
- 6 replies
- 0 kudos
- 0 kudos
Using Git Bash for bash execution and to setup variables we did this by going to control panel -> system -> environment varibales
- 0 kudos
- 2534 Views
- 3 replies
- 0 kudos
Foreign table to delta streaming table
I want to copy a table from a foreign catalog as my streaming table. This is the code I used but I am getting error: Table table_name does not support either micro-batch or continuous scan.; spark.readStream .table(table_name) ...
- 2534 Views
- 3 replies
- 0 kudos
- 0 kudos
What is the underlying type of the table you are trying to stream from? Structured Streaming does not currently support streaming reads via JDBC, so reading from MySQL, Postgres, etc are not supported. If you are trying to perform stream ingestion fr...
- 0 kudos
- 1946 Views
- 1 replies
- 0 kudos
cross join issue generating surrogate keys in delta table
I used below code to populate target table, it is working as expected but expect for surrogatekey column. After I inserted dummy entry -1 and did run merge code, it is generating the numbers in surrogatekey column like this 1,3,5,7,9 odd numbers, it ...
- 1946 Views
- 1 replies
- 0 kudos
- 0 kudos
This is expected. Identity columns can have gaps, or per the documentation: Values assigned by identity columns are unique and increment in the direction of the specified step, and in multiples of the specified step size, but are not guaranteed to b...
- 0 kudos
