- 1980 Views
- 2 replies
- 0 kudos
Databricks keeps notebooks in its cloud account free of cost?
I was reading the architecture of Databricks from the following video. And I came through this If notebooks are stored in control plane on the databricks cloud account, then does that mean databricks allocates storage for the client free of cost? I j...
- 1980 Views
- 2 replies
- 0 kudos
- 0 kudos
Notebooks are stored in the client's cloud storage. The diagram might have confused you, but it just goes to show that you access the notebooks via control plane, not that they're stored there. Azure Databricks automatically creates the workspace sto...
- 0 kudos
- 1005 Views
- 1 replies
- 0 kudos
Concurrent installation of UCX in Multiple workspaces
I am trying to install ucx concurrently into multiple workspaces with bash script. Is it possible to install concurrently into multiple workspaces. If possible, explain it. I'm getting below error. Error: lib: cleanup: remove all: open C:\Users\offer...
- 1005 Views
- 1 replies
- 0 kudos
- 0 kudos
try to upgrade databricks cli and also UCX to the last version
- 0 kudos
- 7360 Views
- 5 replies
- 1 kudos
How to change the OAuth token lifetime and the maximum number of OAuth tokens
Hi team,I’m working on generating an OAuth token using a service principal, following the instructions here: https://docs.databricks.com/en/dev-tools/auth/oauth-m2m.html#language-CLI, specifically the section on manually generating a workspace-level ...
- 7360 Views
- 5 replies
- 1 kudos
- 1 kudos
Thank you for your reply @szymon_dybczak service principal added to admins group: This is the problem @szymon_dybczak, we don't want that service principal to get the admin privilege, it should have access to some tables/schemas in our workspace but ...
- 1 kudos
- 708 Views
- 0 replies
- 0 kudos
Venicold G@l: G@l per alleviare le vene varicose? Recensioni e costi? (Italy)
Una terapia per le vene varicose che utilizza sostanze botaniche. Venicold G@l è efficace. La forza del G@l aiuta a riparare i vasi sanguigni lacerati. Venicold G@l riduce l'edema e migliora la circolazione sanguigna. Usa la soluzione quotidianamente...
- 708 Views
- 0 replies
- 0 kudos
- 678 Views
- 0 replies
- 0 kudos
Venicold G@l: na żylaki koszt i opinie w Poland
Dzięki Venicold G@l naprawa naczyń krwionośnych w nogach następuje natychmiast. Ten nieinwazyjny, szybko działający lek rozpuszcza skrzepy krwi, co zatrzymuje krwawienie, ale prowadzi do upośledzenia przepływu krwi, cieńszych ścianek naczyń, wyższej ...
- 678 Views
- 0 replies
- 0 kudos
- 1911 Views
- 2 replies
- 2 kudos
Great Databricks Notebooks overview video
This video has a good overview of Databricks features, both existing and incoming: https://youtu.be/N9f_6Aoxeqg?si=LBkEJKvCY1IFCYZmGood for both those new and experienced on the platform, as new changes have added features. If anyone has a Keyboard s...
- 1911 Views
- 2 replies
- 2 kudos
- 2 kudos
Thanks @szymon_dybczak - got those shortcuts now and trying to memorize some of them. Maybe Ill try and get these on a sheet of paper so I can keep it by my desk.
- 2 kudos
- 1840 Views
- 1 replies
- 1 kudos
SQL to Spark Dataframe
Hi there,Have a simple question. Not sure if Databricks supports this, but I'm wondering if there's a way to store the results of a sql cell into a spark dataframe? Or vice-versa, is there a way to take a sql query in python (saved as a string variab...
- 1840 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @ChristianRRL, results of sql cell are automatically made available as a python dataframe using the _sqldf variable. You can read more about it here. For the second part not sure why you would need it when you can simply run the query like:spark.s...
- 1 kudos
- 10438 Views
- 0 replies
- 2 kudos
Pyspark Interview Question: Inside a Walmart Data Engineering Interview
Hey Everyone, Hope you’re all doing great!A friend of mine recently went through a data engineering interview at Walmart and shared his experience with me. I thought it would be really useful to pass along what he encountered. The interview had some ...
- 10438 Views
- 0 replies
- 2 kudos
- 681 Views
- 0 replies
- 0 kudos
zoom call never got communication
Never got the zoom call information for my training that has started:
- 681 Views
- 0 replies
- 0 kudos
- 1476 Views
- 1 replies
- 0 kudos
autoloader data processing
Hi Team,Can you share the best practices for designing the autoloader data processing?We have data from 30 countries data coming in various files. Currently, we are thinking of using a root folder i.e country, and with subfolders for the individual ...
- 1476 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Phani1 ,Structure of folders that you are going to use make sense to me. Since you've mentioned that there will be thousands of files, the best practice will be to use autoloader with file notification mode. Also, you can read about databricks r...
- 0 kudos
- 5091 Views
- 4 replies
- 0 kudos
Accessing the S3 Files
I am using the Unity Catalog Cluster. I have a requirement to read the files placed by the source team in a specific location (landing) in S3. I am already using a metastore pointing to a different bucket. Do I need to use an external location pointi...
- 5091 Views
- 4 replies
- 0 kudos
- 0 kudos
did anyone get any solution on this topic? I am also facing the challenges reading the file from s3 using the boto3 with unity enabled cluster, created the s3 external location and granted the enough access. any help on this ?same path and data acce...
- 0 kudos
- 12902 Views
- 5 replies
- 1 kudos
databricks vscode profile
Hello,I'm trying to connect to our databricks instance using the vscode extension. However, when following this guide we cannot get the configuration to proceed past the point that it asks for our instance URL.when i am creating profile [DEFAULT]host...
- 12902 Views
- 5 replies
- 1 kudos
- 2816 Views
- 1 replies
- 0 kudos
Alert Notifications not firing. Inconsistent Success Rate
Hi there,I have a few alerts for a query where if the column is set to >= 1, it will send an email notification to me and 2 others. The 2 individuals are already added as a destination.The query works because the results are populating that column wi...
- 2816 Views
- 1 replies
- 0 kudos
- 0 kudos
I'm facing the same issue.Don't see anything missing but still no emails even when status of the alert is triggered.@DangEdmond did you find the solution?
- 0 kudos
- 9746 Views
- 9 replies
- 3 kudos
Unable to login to databricks community edition
Hi, I was using databricks and it was working fine. Im using community edition. Suddenly, it logged me out. I also clicked on forgot password, changed the password and when i tried to login again, i keeps me redirecting to login page without any erro...
- 9746 Views
- 9 replies
- 3 kudos
- 3 kudos
I am still facing this issue. Is there any update ? It says "Session expired, Log back in" and goes to login window.
- 3 kudos
- 1909 Views
- 2 replies
- 3 kudos
Session Expires every few seconds after logging into community edition
Session Expires every few seconds after logging into community edition
- 1909 Views
- 2 replies
- 3 kudos
- 3 kudos
It automatically disconnects and then connects after 1 min, destroying overall concentration.
- 3 kudos
