- 682 Views
- 1 replies
- 0 kudos
Databricks Widget
Hi,I was previously working databricks runtime 10.0 and now just upgraded to 13.0 runtime.I was using dashboard to display the widgets. Before it was just showing the widget label, but now it shows the widget name below it as well. Also it shows the ...
- 682 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @aman_yadav007, which widget type did you use? Can you please try a different widget type or check the widget type and its arguments from this example: https://docs.databricks.com/en/notebooks/widgets.html#databricks-widgets
- 0 kudos
- 2161 Views
- 1 replies
- 1 kudos
Resolved! Is there an automated way to strip notebook outputs prior to pushing to github?
We have a team that works in Azure Databricks on notebooks.We are not allowed to push any data to Github per corporate policy.Instead of everyone having to always remember to clear their notebook outputs prior to commit and push, is there a way this ...
- 2161 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @jimbender, Yes, there are ways to automate the process of clearing notebook outputs in Azure Databricks. Here are a couple of options: Manual Clearing: Azure Databricks provides options to clear the notebook state and outputs. You can select...
- 1 kudos
- 353 Views
- 0 replies
- 0 kudos
L'importance de Databricks dans le SEO
Le SEO est un domaine dynamique et complexe qui évolue constamment avec les technologies et les algorithmes de recherche. L'utilisation de Databricks, une plateforme d'analyse basée sur le cloud, a révolutionné la manière dont les spécialistes du SEO...
- 353 Views
- 0 replies
- 0 kudos
- 1148 Views
- 1 replies
- 1 kudos
Resolved! Updates on a column in delta table with downstream autoloader
I've got the following questions:1. Can I pause autoloader jobs, delete cluster that was used to run these jobs, create a new cluster and run jobs with newer version cluster?2. I have one autoloader job that ingests JSONs and transforms this to a del...
- 1148 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Wijnand, Pausing Autoloader Jobs and Updating Clusters: Yes, you can pause autoloader jobs, delete the cluster that was used to run these jobs, create a new cluster, and run jobs with a newer version cluster. You can pause a job in the Jobs UI in...
- 1 kudos
- 9724 Views
- 2 replies
- 0 kudos
Creating High Quality RAG Applications with Databricks
Retrieval-Augmented-Generation (RAG) has quickly emerged as a powerful way to incorporate proprietary, real-time data into Large Language Model (LLM) applications. Today we are excited to launch a suite of RAG tools to help Databricks users build hig...
- 9724 Views
- 2 replies
- 0 kudos
- 0 kudos
It seems like you're sharing an announcement or promotional content related to Databricks and their launch of a suite of tools for Retrieval-Augmented-Generation (RAG) applications. These tools are aimed at helping Databricks users build high-quality...
- 0 kudos
- 2766 Views
- 2 replies
- 1 kudos
Power BI Import Model Refresh from Databricks SQL Whse - Query has been timed out due to inactivity
We have an intermittant issue where occasionally a partition in our Power BI Import Dataset times out at 5 hours. When I look at Query History in Databricks SQL, I see a query that failed with the following error message: "Query has been timed out ...
- 2766 Views
- 2 replies
- 1 kudos
- 1 kudos
The only solution we have been able to come up with was to create a Notebook in Databricks that uses the Power BI API to check the status of a Refresh. We schedule it a bit after we expect the Refresh to complete. If it is still running, we kill th...
- 1 kudos
- 1398 Views
- 1 replies
- 0 kudos
Resolved! Is it possible to pass a Spark session to other python files?
I am setting up pytest for my repo. I have my functions in separate python files and run pytest from one notebook. For each testing file, I have to create a new Spark session as follows:@pytest.fixture(scope="session")def spark(): spark = ( SparkSe...
- 1398 Views
- 1 replies
- 0 kudos
- 0 kudos
I was able to do it by placing the Spark session fixture in the conftest.py file in the root directory.
- 0 kudos
- 1122 Views
- 1 replies
- 0 kudos
Cluster
I’m not able to have any workspace view or cluster
- 1122 Views
- 1 replies
- 0 kudos
- 0 kudos
Hey , could you be more precise with your question ?
- 0 kudos
- 2200 Views
- 1 replies
- 0 kudos
How to ingest files from volume using autoloader
I am doing a test run. I am uploading files to a volume and then using autoloader to ingesgt files and creating a table. I am getting this error message:-----------------------------------------------------------com.databricks.sql.cloudfiles.errors....
- 2200 Views
- 1 replies
- 0 kudos
- 0 kudos
Hey, i think you are mixing DLT syntaxt with pyspark syntax:In DLT you should use:CREATE OR REFRESH STREAMING TABLE <table-name> AS SELECT * FROM STREAM read_files( '<path-to-source-data>', format => '<file-format>' )or in Python@dlt....
- 0 kudos
- 1986 Views
- 2 replies
- 1 kudos
Resolved! Power BI keeps SQL Warehouse Running
Hi,I have a SQL Warehouse, serverless mode, set to shut down after 5 minutes. Using the databricks web IDE, this works as expected. However, if I connect Power BI, import data to PBI and then leave the application open, the SQL Warehouse does not s...
- 1986 Views
- 2 replies
- 1 kudos
- 1 kudos
Repeating this test today, the SQL Warehouse shut down properly. Thanks for your helpful reply.
- 1 kudos
- 369 Views
- 0 replies
- 0 kudos
How to Migrate specific notebooks from one Azure Repo to another Azure Repo
Team,I need to migrate only specific notebooks which has changes committed to be pulled from one repo to another repoEnvironment/Repo Setup:Master -> Dev -> Feature Branch -> Developer commits the code in Feature Branch -> Dev has the changes from D...
- 369 Views
- 0 replies
- 0 kudos
- 989 Views
- 1 replies
- 1 kudos
Resolved! Is the Databricks Community Edition still available?
Hello,I am a professor of IT in the Price College of Business at The University of Oklahoma. In the past, I have used the Databricks Community Edition to demonstrate the principles of building and maintaining a data warehouse. This spring semester ...
- 989 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @OU_Professor, The Databricks Community Edition is the free version of the cloud-based big Databricks Platform that allows users to access a micro-cluster, cluster manager, and notebook environment. It also comes with a rich portfolio of award-win...
- 1 kudos
- 1094 Views
- 2 replies
- 0 kudos
SQL Warehouse cluster is always running when configure metabase conneciton
I encountered an issue while using the Metabase JDBC driver to connect to Databricks SQL Warehouse: I noticed that the SQL Warehouse cluster is always running and never stops automatically. Every few seconds, a SELECT 1 query log appears, which I sus...
- 1094 Views
- 2 replies
- 0 kudos
- 0 kudos
Will try to remove "preferredTestQuery" or add "idleConnectionTestPeriod" to avoid keep send select 1 query.
- 0 kudos
- 843 Views
- 3 replies
- 1 kudos
utils.add_libraries_to_model creates a duplicated model
Hello,When I call this function,mlflow.models.utils.add_libraries_to_model(MODEL_URI)It register a new model into the Model Registry. Is it possible to do the same but without registering a new model?Thanks,
- 843 Views
- 3 replies
- 1 kudos
- 1 kudos
I ended up publishing the library to AWS CodeArtifact repository. Now, how can I tell MLFlow to use AWS CodeArtifact private repository instead of PyPi?
- 1 kudos
- 1544 Views
- 0 replies
- 2 kudos
Exciting Update! 🚀 Check out our fresh Community upgrades
Hello Community Members, We are thrilled to announce a fresh look for our Community platform! Get ready for an enhanced user experience with our brand-new UI changes. Our team has worked diligently to bring you a more intuitive and visually appealing...
- 1544 Views
- 0 replies
- 2 kudos
