cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Uploading CSV to Databricks community edition

Khaled
New Contributor III

When I upload a csv file of size 1 GB from my PC the in the upload place, it is uploadโ€‹ing untill the file reach some point and disappear for example it reach 600 MB and disappear from that place

4 REPLIES 4

Prabakar
Databricks Employee
Databricks Employee

Hi @Khaled ALZHARANIโ€‹ , as the community edition is free for learning there are certain limitations. To understand why this is failing, you can get the HAR traces while uploading the file. This will show you the progress and if it fails you might get the status in the HAR.

Khaled
New Contributor III

Where can I find HAR and is it a shortcut for what ?โ€‹

Prabakar
Databricks Employee
Databricks Employee

This is the procedure for Google Chrome. For other browsers, see G Suite Toolbox HAR Analyzer.

  1. Open Google Chrome and go to the page where the issue occurs.
  2. In the Chrome menu bar, select View > Developer > Developer Tools.
  3. In the panel at the bottom of your screen, select the Network tab.
  4. Look for a round Record button in the upper left corner of the Network tab, and make sure it is red. If it is grey, click it once to start recording.
  5. Check the box next to Preserve log.
  6. Click Clear to clear out any existing logs from the Network tab.
  7. Reproduce the issue while the network requests are being recorded.
  8. After you reproduce and record the issue, right-click anywhere on the grid of network requests to open a context menu, select Save all as HAR with Content, and save the file to your computer.
  9. Analyze the file using the HAR Analyzer tool.

jose_gonzalez
Databricks Employee
Databricks Employee

Hi @Khaled ALZHARANIโ€‹ ,

I would also recommend to split up your CSV files into smaller files.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group