by
Krish1
• New Contributor II
- 2393 Views
- 1 replies
- 0 kudos
I have several gz files (file.csv.gz) in a ADLS folder which are of pretty big size. All of these files are extractd from the same base table so it has the similar data but of different dates. How can I transfer them in delta lake/delta table. We wou...
- 2393 Views
- 1 replies
- 0 kudos
Latest Reply
Hi, You can read GZ files through spark. https://stackoverflow.com/questions/42761912/how-to-read-gz-compressed-file-by-pysparkPlease let us know if this helps. Also, please tag @Debayan with your next comment so that I will get notified. Thank you!
by
Dinu2
• New Contributor III
- 2866 Views
- 0 replies
- 3 kudos
Hi , Could anyone please help to know the steps for connecting Cassandra from Azure Databricks? I have followed the steps in https://learn.microsoft.com/en-us/azure/databricks/_static/notebooks/azure/cassandra-azure.html But I am getting below error....
- 2866 Views
- 0 replies
- 3 kudos
by
Soma
• Valued Contributor
- 4529 Views
- 3 replies
- 3 kudos
Hi Team for secure connection we created secured cluster withNPIP(https://learn.microsoft.com/en-us/azure/databricks/security/secure-cluster-connectivity) WORKSPACE hosted in a private VNET.We had a hub vnet with private endpoint for key vault ,We pe...
- 4529 Views
- 3 replies
- 3 kudos
Latest Reply
Hi @somanath Sankaran , did you face any error? if yes, could you please paste the error snapshot here?
2 More Replies
- 4246 Views
- 5 replies
- 3 kudos
Hello all,We are working on one of the client requirements to implement suitable data encryption in Azure Databricks.We should be able to encrypt and decrypt the data based on the access, we explored fernet library but client denied it saying it degr...
- 4246 Views
- 5 replies
- 3 kudos
Latest Reply
Hi @purushotham Chanda Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you...
4 More Replies
- 2264 Views
- 2 replies
- 8 kudos
HI,Is there any way to disable launch workspace option in Azure portal for ADB.We have user accesses at resource group, so we need to restrict users who are part of owner or contributor role to launch ADB worksapce as admin.Thank you
- 2264 Views
- 2 replies
- 8 kudos
Latest Reply
Deny Assignments don't block subscription contributor to launch workspace and become admin. Actually I haven't find any way to block that after many tries of different methods.
1 More Replies
- 2352 Views
- 1 replies
- 2 kudos
Do I always need to manually invite members of my AAD tenant to ADB workspace, if I don't have SCIM integration configured?EDIT: solved, it works when you go through Azure Portal and get in with "Launch Workspace" button on the ADB resource overview ...
- 2352 Views
- 1 replies
- 2 kudos
Latest Reply
Hello @pawelmitrus For users with Owner or Contributor roles, they should click on the "Launch Workspace" button in the Azure portal. For other users they should be explicitly granted access to the workspace to be able to login.Regards,Arvind
- 4719 Views
- 8 replies
- 6 kudos
In workspace one folder I have around 100+ pyspark scripts, all these scripts need to be compiled before running the main program. In order to compile all these files, we are using the %run magic command like %run ../prod/netSales. Since we have 100+...
- 4719 Views
- 8 replies
- 6 kudos
Latest Reply
Problem is that you can list all files in workspace only via API call and than you can run every one of them using:dbutils.notebook.run()This is the script to list files from workspace (probably you need to add some filterning):import requests
ctx = ...
7 More Replies
- 3058 Views
- 3 replies
- 5 kudos
Can anyone help me in configuring the CI/CD for a ADB terraform code .The problem I am facing authentication something went wrong in there . Can anyone help me on this .Pipeline implementation in Azure DevOps.
- 3058 Views
- 3 replies
- 5 kudos
Latest Reply
Hi @Rithwik Aditya Manoj Malla , as requested by @Prabakar Ammeappin earlier could you please share the code block and the error details. Also, you can refer to the below doc to authenticate ADB from TF code.https://registry.terraform.io/providers/...
2 More Replies
