- 2149 Views
- 3 replies
- 3 kudos
woahhh #Excel plug in for #DeltaSharing.Now I can import delta tables directly into my spreadsheet using Delta Sharing.It puts the power of #DeltaLake into the hands of millions of business users.What does this mean?Imagine a data provider delivering...
- 2149 Views
- 3 replies
- 3 kudos
Latest Reply
If you have any uncertainties, feel free to inquire here or connect with me on my LinkedIn profile for further assistance.https://whatsgbpro.org/
2 More Replies
- 8074 Views
- 3 replies
- 3 kudos
I have setup my Databricks notebook to use Service Principal to access ADLS using below configuration.service_credential = dbutils.secrets.get(scope="<scope>",key="<service-credential-key>")
spark.conf.set("fs.azure.account.auth.type.<storage-accou...
- 8074 Views
- 3 replies
- 3 kudos
Latest Reply
found the solution, need one additional configuration. spark._jsc.hadoopConfiguration().set("fs.azure.account.key.<account name>.dfs.core.windows.net",'<account key>')
2 More Replies
- 104240 Views
- 34 replies
- 6 kudos
0
I have a excel file as source file and i want to read data from excel file and convert data in data frame using databricks. I have already added maven dependence for Excel file format. when i a tring below code it is giving error .(Error: java.io....
- 104240 Views
- 34 replies
- 6 kudos
Latest Reply
To read an Excel file using Databricks, you can use the Databricks runtime, which supports multiple programming languages such as Python, Scala, and R. Here are the general steps to read an Excel file in Databricks using Python:1. **Upload the Excel ...
33 More Replies
- 1008 Views
- 1 replies
- 3 kudos
i am trying to extract some data into databricks but tripping all over openpyxl, newish user of databricks..from openpyxl import load_workbookdirectory_id="hidden"scope="hidden"client_id="hidden"service_credential_key="hidden"container_name="hidden"s...
- 1008 Views
- 1 replies
- 3 kudos
Latest Reply
Hi @Vanessa Van Gelder​ Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
- 1950 Views
- 2 replies
- 3 kudos
I'm having an issue accessing the excel through dlt pipeline. the file is in ADLS I'm using pandas to read the Excel. It seems pandas are not able to understand abfss protocol is there any way to read Excel with pandas in dlt pipeline?I'm getting thi...
- 1950 Views
- 2 replies
- 3 kudos
Latest Reply
Thanks for the info. It works just need to install an additional library using "%pip install openpyxl".
1 More Replies
- 1615 Views
- 4 replies
- 2 kudos
I have uploaded small Excel files on my DBFS. I then use function read_xlsx() from the "readxl" package in R to import the file into the R memory. I use a standard cluster (12.1, non ML). The function works but it takes ages. E.g. a simple Excel tabl...
- 1615 Views
- 4 replies
- 2 kudos
Latest Reply
Hi @Marcel Baumgartner​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best an...
3 More Replies
- 1253 Views
- 0 replies
- 5 kudos
To connect Delta Lake with Microsoft Excel, you can use the Microsoft Power Query for Excel add-in. Power Query is a data connection tool that allows you to connect to various data sources, including Delta Lake. Here's how to do it:Install the Micros...
- 1253 Views
- 0 replies
- 5 kudos
by
CBull
• New Contributor III
- 957 Views
- 3 replies
- 2 kudos
Is there a way to create a notebook that will take the SQL that I want to put into the Notebook and populate Excel daily and send it to a particular person?
- 957 Views
- 3 replies
- 2 kudos
Latest Reply
@Aviral Bhardwaj​ thanks for this, I was needed this info
2 More Replies
- 3308 Views
- 5 replies
- 18 kudos
Hi all,Is anyway that we can access or push data in delta sharing by using Microsoft excel?
- 3308 Views
- 5 replies
- 18 kudos
Latest Reply
hey @Ajay Pandey​ yes recently the new excel feature also comes in the market that we can enable the delta sharing from excel also so whatever the changes you will made to delta , it will automaticaly get saved in the excel file also ,refer this lin...
4 More Replies
by
pkgltn
• New Contributor III
- 1342 Views
- 2 replies
- 2 kudos
Hi, How can I load an Excel File (located in Databricks Repo connected to Azure DevOps) into a dataframe? When I pass the full path into the load method, it displays an error.java.io.FileNotFoundException Has someone done it previously?
- 1342 Views
- 2 replies
- 2 kudos
Latest Reply
Hi,Just managed to do it.Upgraded the cluster to the latest version because Files in Repos only works in most recent versions of the cluster.When loading the dataframe, specify the path as follows: file:/Workspace/Repos/user@email.com/filepath/filena...
1 More Replies
- 9438 Views
- 3 replies
- 2 kudos
I am working on microsoft azure databrick, I have a final dataframe of shape (3276*23) , I want to share it in form of excel file? How can I do it ( I am using ->df.to_excel('fileOutput.xlsx', sheet_name = 'Sheet1', index = False) , command is runn...
- 9438 Views
- 3 replies
- 2 kudos
Latest Reply
You could try this way, convert Pyspark Dataframe to Pandas Dataframe then export to excel file.
2 More Replies
- 7612 Views
- 3 replies
- 1 kudos
My cluster has Scala 2.12I've installed Maven Library com.crealytics:spark-excel_2.12:0.14.0I get an error java.lang.IllegalStateException: Cannot get a STRING value from a NUMERIC cellwhen trying to execute the following%pythonexcelFileName="/mnt/dl...
- 7612 Views
- 3 replies
- 1 kudos
Latest Reply
Another way also help for your case is usign Pandas to read excel then convert Pandas Dataframe to Pyspark Dataframe
2 More Replies
- 2503 Views
- 5 replies
- 12 kudos
The date field is getting changed while reading data from source .xls file to the dataframe. In the source xl file all columns are strings but i am not sure why date column alone behaves differentlyIn Source file date is 1/24/2022.In dataframe it is ...
- 2503 Views
- 5 replies
- 12 kudos
Latest Reply
Hi Team, @Merca Ovnerud​ I am also facing same issue , below is the code snippet which I am using df=spark.read.format("com.crealytics.spark.excel").option("header","true").load("/mnt/dataplatform/Tenant_PK/Results.xlsx")I have a couple of date colum...
4 More Replies
- 3012 Views
- 0 replies
- 0 kudos
I am trying to read a excel file which has 3 sheets which have integers as there names,sheet 1 name = 21sheet 2 name = 24sheet 3 name = 224i got this data from a user so I can't change the sheet name, but with spark reading these is an issue.code -v...
- 3012 Views
- 0 replies
- 0 kudos
- 1174 Views
- 1 replies
- 0 kudos
Using Python-3, I am trying to compare an Excel (xlsx) sheet to an identical spark table in Databricks. I want to avoid doing the compare in Databricks. So I am looking for a way to read the spark table via the Databricks api. Is this possible? How c...
- 1174 Views
- 1 replies
- 0 kudos
Latest Reply
What is the format of the table - if It is delta, you could use the python bindings for the native Rust API and read the table from your python code and compare bypassing the metastore.
