- 2043 Views
- 1 replies
- 0 kudos
- 2043 Views
- 1 replies
- 0 kudos
- 0 kudos
Please see: https://docs.databricks.com/en/compute/configure.html
- 0 kudos
- 938 Views
- 1 replies
- 0 kudos
How do you import training notebooks, following the data engineer course
In the databricks community edition, I am trying to follow the course and they pull variables and others through notebooks which is supplied for training purposes. I can't see to import any
- 938 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Lakshay_leo ,Datbricks community edition is limited in terms of functionality. If you follow course on databricks academy it's better to use databricks premium account. You can start free trial on azure.
- 0 kudos
- 2388 Views
- 3 replies
- 0 kudos
Unable to create folder in dbfs view
When trying to create a folder in dbfs view, the folder doesn't get created. I am using the community edition to practice. Can somebody help ?is it due to community edition or it is intended use ?
- 2388 Views
- 3 replies
- 0 kudos
- 0 kudos
@Lakshay_leo I understand. I also tried it, and I couldn’t create the folder either.To create a new folder, you can specify the desired folder name in the "DBFS Target Directory" field when uploading a file to DBFS. For example, as shown in the image...
- 0 kudos
- 851 Views
- 1 replies
- 0 kudos
an issue when trying to connect to my AWS S3 bucket from my local Python environment
Hi everyone,I’m having an issue when trying to connect to my AWS S3 bucket from my local Python environment using the boto3 library. import boto3s3 = boto3.client('s3')response = s3.list_objects_v2(Bucket='my-bucket-name')print(response)I keep gettin...
- 851 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @grisma56giga, The error typically indicates that your Python environment does not have SSL support enabled Can you run to validate: import sslprint(ssl.OPENSSL_VERSION)
- 0 kudos
- 1346 Views
- 1 replies
- 0 kudos
Essential-PySpark-for-Scalable-Data-Analytics "wordcount-sql.ipynb"
I'm working through the code at the following, but getting an error:https://github.com/PacktPublishing/Essential-PySpark-for-Scalable-Data-Analytics/blob/main/Chapter01/wordcount-sql.ipynbCode:%sql DROP TABLE IF EXISTS word_counts; CREATE TABLE word_...
- 1346 Views
- 1 replies
- 0 kudos
- 0 kudos
Correction: The error message from the screenshot is when I tried to add the dbms: prefix to the URL. The error message without that prefix is the following:UnityCatalogServiceException: [RequestId=dbda5aee-b855-9ed9-abf8-3ee0e0dcc938 ErrorClass=IN...
- 0 kudos
- 1783 Views
- 1 replies
- 0 kudos
I get error
Hi everyone,I'm trying to connect my local Python environment to an AWS S3 bucket using the boto3 library. However, when I try to run the code to list the files in my S3 bucket, I encounter an authentication error:import boto3s3 = boto3.client('s3')r...
- 1783 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @dona168lee ,Can you share additional details how your environment is setup or which DBR version you are using?Followed with how you installed boto3 package and which version of boto3 is installed?
- 0 kudos
- 1414 Views
- 1 replies
- 0 kudos
queries are running extremely slow
Hello everyone,I’m encountering an issue when querying large Parquet files in Databricks, particularly with files exceeding 1 GB in size. The queries are running extremely slow, and at times, they even time out. I’ve tried optimizing the file size an...
- 1414 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @nathan45shafer, Thanks for your question, you can refer to: https://www.databricks.com/discover/pages/optimize-data-workloads-guide it covers good practices and actions to optimize your workflow, please let me know if you have questions.
- 0 kudos
- 1604 Views
- 2 replies
- 1 kudos
Access denied for Course
I can't access this course. https://www.databricks.com/training/catalog/advanced-machine-learning-operations-3508When I register this course , display below error.Access deniedYou do not have permission to access this page, please contact your admin...
- 1604 Views
- 2 replies
- 1 kudos
- 1 kudos
Hello, @ash1127! It looks like this post duplicates the one you recently posted. The original post has already been answered. I recommend continuing the discussion there to keep the conversation focused and organized.Let me know if you have any furth...
- 1 kudos
- 669 Views
- 1 replies
- 0 kudos
when attempting to load a large 800 MB CSV file
Hello everyone,I’m facing an issue when attempting to load a large 800 MB CSV file from ADLS using Auto Loader. Unfortunately, the notebook crashes during the loading process. Has anyone experienced something similar or have any suggestions on how to...
- 669 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @violeta482yee, Have you checked the resource availability of the compute attached to the notebook? One solution could be: to usecloudFiles.maxBytesPerTriggerOption: This option allows you to control the maximum number of bytes processed in each t...
- 0 kudos
- 1200 Views
- 1 replies
- 0 kudos
please enter your credentials...
Hi everyone,I'm trying to connect my local Jupyter Notebook environment to Databricks Community Edition, and I’ve followed the setup guide on the Databricks website. I’m attempting to use the mlflow library, but I’m facing an issue where the authenti...
- 1200 Views
- 1 replies
- 0 kudos
- 0 kudos
What is the process you are following to create the PAT token? In community Edition the PAT token is not allowed, instead you need to use Oauth token https://docs.databricks.com/en/dev-tools/auth/oauth-u2m.html
- 0 kudos
- 1874 Views
- 2 replies
- 1 kudos
I was about to signup to community edition but mistakenly signed up to regular edition
I was about to signup to community edition but mistakenly signed up to regular edition, I want to convert my subscription into community edition how do i do it.When i try to login i get a error that, we are not able to find community edition workspac...
- 1874 Views
- 2 replies
- 1 kudos
- 1 kudos
Same issue here. Couldn't use community edition using any other email as well
- 1 kudos
- 5378 Views
- 11 replies
- 1 kudos
Resolved! Generate a temporary table credential fails
Hi Team,I am trying to execute the below API, and it is failing.API:curl -v -X POST "https://dbc-xxxxxxxx-xxxx.cloud.databricks.com/api/2.0/unity-catalog/temporary-stage-credentials" -H "Authentication: Bearer xxxxxxxxxxxxxxxx" -d '{"table_id":"exte...
- 5378 Views
- 11 replies
- 1 kudos
- 1 kudos
Your endpoint also seems to be incorrect, as per doc https://docs.databricks.com/api/gcp/workspace/temporarytablecredentials/generatetemporarytablecredentials it has to be /api/2.0/unity-catalog/temporary-table-credentials and you are using /api/2.0...
- 1 kudos
- 3971 Views
- 10 replies
- 0 kudos
Resolved! API access via python script
Hello,I try to access an API via a python script.I have access using postman. But if I try to access it via python in databricks, it will not work (timeout).Here is my code:import requestsimport socketurl = 'https://prod-api.xsp.cloud.corpintra.net/t...
- 3971 Views
- 10 replies
- 0 kudos
- 2166 Views
- 7 replies
- 0 kudos
Databricks - Subscription is not Active
Hello TeamMy databricks free trial has been extended till 2030 but somehow my account is showing "Subscription is not Active". Currently, I have one workspace running in my account and it is not letting me create another workspace. I am also unsure...
- 2166 Views
- 7 replies
- 0 kudos
- 1280 Views
- 2 replies
- 0 kudos
Community Edition isnt't supporting importing .dbc file
Hello Databricks Community Support Team,I am using Databricks Community Edition for exploring Databricks features.It has been observed that, Importing .DBC file is no more supported in community edition. The below snippet shows the error message we a...
- 1280 Views
- 2 replies
- 0 kudos
- 0 kudos
I was informed that this feature of importing workspace files does not work and it's expected for Community Edition.
- 0 kudos
