- 6749 Views
- 1 replies
- 1 kudos
Resolved! Find root path to Repo for .py file import
I want to import a Python function stored in the following file path:`<repo>/lib/lib_helpers.py`I want to import the function from any file in my repo. For instance from these:`<repo>/notebooks/etl/bronze/dlt_bronze_elt``<repo>/workers/job_worker`It ...
- 6749 Views
- 1 replies
- 1 kudos
- 1 kudos
Ok, I figured it out. If you just make it a Python module by adding an empty `__init__.py`, Databricks will load it on start. Then, you can just import it.
- 1 kudos
- 1198 Views
- 0 replies
- 0 kudos
Could it be possible we can retrieve DBU used by cluster in Databricks notebooks?This Data we get in Active DBU/hr in Compute tab for all clusters.
Could it be possible we can retrieve DBU used by cluster in Databricks notebooks?This Data we get in Active DBU/hr in Compute tab for all clusters.
- 1198 Views
- 0 replies
- 0 kudos
- 11969 Views
- 7 replies
- 4 kudos
Resolved! Cannot create table The associated location ('dbfs:/mnt/[REDACTED]/folder/table_location') is not empty but it's not a Delta table
Hi Team, I have created new databricks workspace for using private network. I want to read/write/update delta table created in old databricks and stored in ADLS as delta.Any one please help me on this?.....I tried to create delta table in same loca...
- 11969 Views
- 7 replies
- 4 kudos
- 4 kudos
Hi @Ancil P A​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!
- 4 kudos
- 5866 Views
- 5 replies
- 6 kudos
Resolved! Databricks Community Edition Not able to Login Account
hello, I'm not able to log in to my Databricks community account, I'm getting the following error when trying to log in:You entered an invalid email or password, or your workspace access is locked because of unusual activity. For help, see Community ...
- 5866 Views
- 5 replies
- 6 kudos
- 6 kudos
hi @Vidula Khanna​, I appreciate your help, I will try to contact them using help@databricks.com.thank you for your assistance.best regards.
- 6 kudos
- 8991 Views
- 3 replies
- 0 kudos
Resolved! Deploying Databricks via ARM, then configuring via databricks-cli: creating a repo results in INVALID_STATE error.
Hi,I'm using databricks-cli to configure a newly-deployed Azure Databricks instance. The ARM deployment works fine, and then the databricks cli commands to create a secrets scope and add users also works just fine.Then I add a GitCredential to Datab...
- 8991 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @Chris Platts​ Help us build a vibrant and resourceful community by recognizing and highlighting insightful contributions. Mark the best answers and show your appreciation!Thanks and Regards
- 0 kudos
- 10030 Views
- 6 replies
- 9 kudos
Resolved! Databricks cluster Init scripts on ABFSS location
HI,I have an init script which works on DBFS location during the cluster start up, but when the same shell script file is placed on ABFSS location (ADLS Gen 2 storage) I get the following init script failure error and the cluster is unable to start.E...
- 10030 Views
- 6 replies
- 9 kudos
- 9 kudos
Hi @Saravana KJ​ I'm sorry you could not find a solution to your problem in the answers provided.Our community strives to provide helpful and accurate information, but sometimes an immediate solution may only be available for some issues.I suggest pr...
- 9 kudos
- 3831 Views
- 1 replies
- 5 kudos
Resolved! sudden decrease in rewards point in Rewards portal
@Vidula Khanna​ May I know why the reward points decreased in Databricks community rewards portal. Could anyone help on this. I haven't ordered for anything. But today when I checked there was sudden decrease in points and the no of points came from ...
- 3831 Views
- 1 replies
- 5 kudos
- 3237 Views
- 1 replies
- 0 kudos
The hire react js developer from the best react js development company. We provide the most experienced hire reactjs developer as per the requirements...
The hire react js developer from the best react js development company. We provide the most experienced hire reactjs developer as per the requirements cost.
- 3237 Views
- 1 replies
- 0 kudos
- 0 kudos
Thanks for sharing! By the way, if you are interested in the costs of hire react js developers, I advise you to read this: https://www.cleveroad.com/blog/how-much-does-it-cost-to-hire-a-react-developer/
- 0 kudos
- 12519 Views
- 2 replies
- 0 kudos
Issue with Pyspark GroupBy GroupedData
Hi Guys,I am working on streaming data movement from bronze to silver. My bronze table is having a entity_name column, based on the entity_name column i need to create multiple silver tables.I tried the below approach, But it is failing with error "'...
- 12519 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Harun Raseed Basheer​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best ...
- 0 kudos
- 7720 Views
- 2 replies
- 2 kudos
Resolved! Error while using Array_contains function in left join condition
'Item_id' is column in array format like ["ba1b-5fbe1547ddd5", "88f9-ac3b93334f69", "8bba-4075a47eb814"] in table1 and table2 has column Id with single value like ba1b-5fbe1547ddd5.While join two table select table1.*,table2.*from table1left join tab...
- 7720 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @Rishabh Shanker​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Th...
- 2 kudos
- 3969 Views
- 2 replies
- 1 kudos
Resolved! How does pyspark work in these two scenarios?
I have two scenarios with different outcomes:Scenario 1:from pyspark.sql.functions import *# create sample dataframesdf1 = spark.createDataFrame([(1, 2, 3), (2, 3, 4)], ["a", "b", "c"])df2 = spark.createDataFrame([(1, 5, 6, 7), (2, 8, 9, 10)], ["a", ...
- 3969 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Direo Direo​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers y...
- 1 kudos
- 5318 Views
- 3 replies
- 1 kudos
read base64 json column with Autoloader and inferschema.
I have json files falling in our blob with two fields, 1. offset(integer), 2. value(base64).This value column is json with unicode. so they sent it as base64. Challenge is this json is very large with 100+ fields. so we cannot define the schema. We c...
- 5318 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @MerelyPerfect Per​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you....
- 1 kudos
- 13636 Views
- 1 replies
- 1 kudos
Resolved! How to get today's date in the local time zone?
I am trying to get today's date in the local time zone:from pyspark.sql.functions import * date = to_date(from_utc_timestamp(current_timestamp(), 'Australia/Melbourne'))What I get using the above code is a column object. How can I get its value in a...
- 13636 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Mohammad Saber​ , you can use pytz and datetime python package for your usecase,, attaching code snippet in below screen shot.
- 1 kudos
- 2477 Views
- 2 replies
- 2 kudos
- 2477 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @may may​ Your input matters! Help our community thrive by coming back and marking the most helpful and accurate answers. Together, we can make a difference!Regards
- 2 kudos
- 3931 Views
- 2 replies
- 1 kudos
How install a library that is under the /Workspace/Shared/ directory using the init.sh script in a cluster?
I would like to install a library that is under the /Workspace/Shared/ directory using the init.sh script in a cluster. How to access the /Workspace/Shared/ folder in shell? This page only shows how to access manually but doesn't show how to access i...
- 3931 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Juned Mala​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!
- 1 kudos
| User | Count |
|---|---|
| 1644 | |
| 793 | |
| 553 | |
| 349 | |
| 287 |
