- 696 Views
- 1 replies
- 0 kudos
Databricks data engineer associate Exam got suspended.
Hello Team, I encountered Pathetic experience while attempting my 1st DataBricks certification. Abruptly, Proctor asked me to show my desk, after showing he/she asked multiple times.. wasted my time and then suspended my exam. I want to file a compla...
- 696 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Sivaji Sorry to hear you had a bad experience, and that you got a slow response here in the community. I see that you have taken and passed the exam, Congratulations!For the future, our support team handles cases from here first so it tends to be...
- 0 kudos
- 1380 Views
- 1 replies
- 0 kudos
Records are missing while creating new dataframe from one big dataframe using filter
Hi,I have data in file like belowI have different types of row in my input file, column number 8 defines the type of the record.In the above file we have 4 types of records 00 to 03My requirement is:There will be multiple files in the source path, ea...
- 1380 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Policepatil , The issue you're experiencing with missing records could be due to a variety of reasons. It could be related to how Spark handles data partitioning, or it might be due to some data quality issues in your input files. One possible ex...
- 0 kudos
- 1027 Views
- 1 replies
- 0 kudos
Github "Danger Zone"
There is a "Danger zone" appearing in the Github indicating that the repositories I share on Databricks should be Suspended and possibly that Databricks should be uninstalled. This may be something standard in Github. Has anyone run across it?
- 1027 Views
- 1 replies
- 0 kudos
- 0 kudos
It's not telling you that you should do these things. It's telling you that you may break stuff by doing these things. Yes the "Danger Zone" is a thing on Github, it tries to warn you before you do things like click to delete a repo.
- 0 kudos
- 313 Views
- 0 replies
- 0 kudos
Notebook Langchain ModuleNotFoundError Problem
Specific line of code:from langchain.retrievers.merger_retriever import MergerRetrieverAll other langchain import works when this is commented out. Same line works on my local VS Code.Appreciate any help with this issue. Thanks!
- 313 Views
- 0 replies
- 0 kudos
- 454 Views
- 0 replies
- 0 kudos
How to switch from free trial to Community Edition of Databricks in my Azure workspace?
hello,I am trying to switch into Databricks Community Edition after a 14 day trial. I was able to register, but when I try to start my new cluster, I get an error message, "Cluster start feature is currently disabled, and the cluster does not run".In...
- 454 Views
- 0 replies
- 0 kudos
- 2911 Views
- 3 replies
- 3 kudos
Resolved! Databricks community edition still available?
Is Databricks platform still available in its Community edition (outside Azure, AWS or GCP)? Can someone share the updated link?Thanks,Elisa
- 2911 Views
- 3 replies
- 3 kudos
- 3 kudos
Look : it is still available but afaik always linked to azure/gcp/aws
- 3 kudos
- 11981 Views
- 2 replies
- 1 kudos
Resolved! Notebook Langchain ModuleNotFoundError: No module named 'langchain.retrievers.merger_retriever'
Hi,As mentioned in the title, receiving this error despite%pip install --upgrade langchainSpecific line of code:from langchain.retrievers.merger_retriever import MergerRetriever All other langchain import works when this is commented out. Same line w...
- 11981 Views
- 2 replies
- 1 kudos
- 1 kudos
More specifically: langchain releases a new update every few days, and it is likely that you are using code or a library that needs a later version of langchain than you have (or, perhaps, a later version that removed whatever part of langchain you r...
- 1 kudos
- 1230 Views
- 2 replies
- 1 kudos
Databricks notebook execution using only one task
I am running a databricks notebook. While running, i only see one task on one worker getting started. My cluster has min 6 workers but seems like they are not getting used.I am performing a read operation from Cosmos DB.Can someone please help me her...
- 1230 Views
- 2 replies
- 1 kudos
- 1 kudos
If your code does not use Spark, it will not use any machines except the driver. If you're using Spark but your source data that you operate on has 1 partition, there will be only 1 task. Hard to say more without knowing what you are doing in more de...
- 1 kudos
- 2791 Views
- 4 replies
- 2 kudos
Resolved! MIT License and Fine-tuning
Some questions related to fine-tuning and the MIT License, I read the MIT license but still confusing about some points.If I fine-tune the Dolly-v2 model, say using LoRA and my own dataset,Do I "own" the fine-tuned model?Am I allow to change the name...
- 2791 Views
- 4 replies
- 2 kudos
- 2 kudos
I am not sure I agree with the discussion so far. While none of here are lawyers, I think it's fairly straightforward to reason about the licensing.You have created a combined, derivative work from the Dolly weights in this case. You have copyright i...
- 2 kudos
- 2264 Views
- 2 replies
- 0 kudos
c# connector for databricks Delta Sharing
Any plans for adding c# connector? What are alternate ways in current state?
- 2264 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @shrikant_kulkar, Based on the information provided, no explicit plans are mentioned for adding a C# connector. However, Microsoft is reportedly building a connector that they will support, but it's not specified that this connector is specifical...
- 0 kudos
- 4368 Views
- 6 replies
- 3 kudos
Resolved! Using databricks for end to end flow? rather than using ADF for extracting data
Currently, in our company we are using ADF+DATABRICKS for all batch integration. Using ADF first data is copied to ADLS gen 2 (from different sources like on prem servers, ftp solution file sharing, etc), then it is reformatted to csv and it is copie...
- 4368 Views
- 6 replies
- 3 kudos
- 3 kudos
@-werners- Is there any benefit of doing the extract part in databricks itself? Unlike our current architecture, where we first load to adls using adf. I guess it is worth doing all end to end using databricks if there is better processing, lower lat...
- 3 kudos
- 1550 Views
- 3 replies
- 0 kudos
Records are missing while creating new data from one big dataframe using filter
Hi,I have data in file like below I have different types of row in my input file, column number 8 defines the type of the record.In the above file we have 4 types of records 00 to 03My requirement is:There will be multiple files in the source path, e...
- 1550 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @Kaniz_Fatma ,If i run again with same files sometimes records will be missed from same files of the previous run or records will be missed from different file.Example:run1: 1 record missing in file1, no issue with other filesrun2: 1 record missin...
- 0 kudos
- 2249 Views
- 1 replies
- 0 kudos
Resolved! Dashboard backup/download
Hola all, I'm trying to download all the dashboard definitions, however, I can only download the folder structure with no file inside. The procedure I'm using is* Go to the dashboard folder* Download it as DBC or source archiveUnfortunately, the DBC ...
- 2249 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @6502, To download a dashboard as a PDF file, click the vertical ellipsis at the top-right of the dashboard and select Download as PDF. [Source: Docs: index](https://docs.databricks.com/sql/user/dashboards/index.html) • You can download a query ...
- 0 kudos
- 1328 Views
- 2 replies
- 0 kudos
Error while creating external table in unity catalog
I am trying to create an external table using csv file which is stored in ADLS gen2 My account owner has created a storage credential and an external location I am a databricks user who all privileges on external location when trying to create a tabl...
- 1328 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Shubhanshu , Could you please try https://learn.microsoft.com/en-us/answers/questions/1314651/error-invalid-configuration-value-detected-for-fs and see if this is working?
- 0 kudos
- 1127 Views
- 1 replies
- 0 kudos
Issue with Databricks notebooks and 'requests' python library. Incosistent output.
I have a strange issue with Databricks notebooks and Google Colab notebooks, where I cannot get the results from requests library that would be consistent to what I get on my local computer. Dir Surveys (wyo.gov) ("http://pipeline.wyo.gov/r_Direction...
- 1127 Views
- 1 replies
- 0 kudos
- 0 kudos
Additional information: when I download html file from the above mentioned website, I still get not the same html page as I get from the same code that I run on my computer or any other computer. The size of downloaded html file is the same as I get ...
- 0 kudos
