- 8444 Views
- 5 replies
- 3 kudos
Resolved! Best way of loading several csv files in a table
What would be the best way of loading several files like in a single table to be consumed?https://s3.amazonaws.com/nyc-tlc/trip+data/yellow_tripdata_2019-10.csvhttps://s3.amazonaws.com/nyc-tlc/trip+data/yellow_tripdata_2019-11.csvhttps://s3.amazonaws...
- 8444 Views
- 5 replies
- 3 kudos
- 3 kudos
Thanks Kaniz, I already have the files. I was discussing about the best way to load them
- 3 kudos
- 1084 Views
- 0 replies
- 0 kudos
PLogo
Best kurta set for womenPlain, printed, weaved, adorned, these are only a couple of the choices of Kurta sets for ladies accessible on Purley rich, and that also at the best cost. You will likewise observe a gigantic determination of creator base wea...
- 1084 Views
- 0 replies
- 0 kudos
- 843 Views
- 0 replies
- 0 kudos
�� hi everyone, I am a product manager in Amsterdam. I work on Jobs and Databricks SQL. In my spare time, I cook �� and send emojis ...
hi everyone, I am a product manager in Amsterdam. I work on Jobs and Databricks SQL. In my spare time, I cook and send emojis . Looking forward to working with this community!
- 843 Views
- 0 replies
- 0 kudos
- 1136 Views
- 0 replies
- 0 kudos
Hi. I have been trying to sign up for Databricks for past 3 hours but its giving me this error every time. I am not using any ad blocker or private mo...
Hi.I have been trying to sign up for Databricks for past 3 hours but its giving me this error every time. I am not using any ad blocker or private mode. I tried to sign up using different web browsers and experienced the same issue. Is it still possi...
- 1136 Views
- 0 replies
- 0 kudos
- 6086 Views
- 5 replies
- 2 kudos
Resolved! Mounting an Azure Storage Account in a cluster init script?
We are trying to configure our environment so when our cluster starts up, it checks to see if we have mounted our Azure storage account container and if is not, mount it. We can do this fine in a notebook however have no luck doing this through an in...
- 6086 Views
- 5 replies
- 2 kudos
- 2 kudos
@David Kruetzkamp - Would you be happy to mark whichever answer helped the most as best? That will help other members find the solution more quickly.
- 2 kudos
- 5835 Views
- 6 replies
- 1 kudos
Resolved! Group vs User rights
I have a small question: How does the combination of group and user rights work? Is it like in azure, that if i have for example databricks sql acces threw a (databricks) group i am member of, but in my personal account databricks sql is not enabled...
- 5835 Views
- 6 replies
- 1 kudos
- 1 kudos
@Mirko Ludewig - Good morning (or evening depending on where you hail), would you be happy to mark whichever answer resolved the problem for you as best? That helps other members find the solutions more quickly.
- 1 kudos
- 2548 Views
- 0 replies
- 2 kudos
Spark Structred Streaming, An Aggregation DF with Watermark in Append mode to Delta table is not writing the most recent aggregation to the Delta table even after crossing the water mark boundary. This is causing dataloss
Team, I am struggling with a unique issue. I am not sure if my understanding is wrong or this is a bug with spark. I am reading a stream from events hub ( Extract) Pivoting and Aggregating the above dataframe ( Transformation). This is a WATERMARKED...
- 2548 Views
- 0 replies
- 2 kudos
- 7381 Views
- 9 replies
- 0 kudos
Resolved! Query AWS Redshift from Databricks SQL
Greetings,In the documentation for Databricks SQL it states that it supports JDBC connections, however when connecting to AWS Redshift via the built in PostgreSQL driver ("CREATE TABLE sample USING JDBC" and "jdbc://postgresql:/..." URI) I'm getting ...
- 7381 Views
- 9 replies
- 0 kudos
- 0 kudos
@Bilal Aslam anytime! Is there a place where customers could follow the timeline when such features are introduced?
- 0 kudos
- 6976 Views
- 7 replies
- 3 kudos
Resolved! Issue with AWS Glue metacatalogue and DBR 9.1 ... 10.1
I have a simple SparkSQL Select statementoffers_df = (spark.sql(""" SELECT * FROM delta.`{}` """.format(TABLE_LOCATION)))It runs under DBR 9.0 and previous. When changing the DBR to 9.1 ...10.1 I get an exceptionorg.apache.spark.SparkException: Una...
- 6976 Views
- 7 replies
- 3 kudos
- 3 kudos
Retest in DBR 10.3 beta SUCCESSFUL.Problem does not occur in DBR 10.3 beta
- 3 kudos
- 42091 Views
- 4 replies
- 4 kudos
Resolved! Spark is not able to resolve the columns correctly when joins data frames
Hello all, I m using pyspark ( python 3.8) over spark3.0 on Databricks. When running this DataFrame join:next_df = days_currencies_matrix.alias('a').join( data_to_merge.alias('b') , [ days_currencies_matrix.dt == data_to_merge.RATE_DATE, days...
- 42091 Views
- 4 replies
- 4 kudos
- 4 kudos
@Alessio Palma - Howdy! My name is Piper, and I'm a moderator for the community. Would you be happy to mark whichever answer solved your issue so other members may find the solution more quickly?
- 4 kudos
- 7584 Views
- 6 replies
- 4 kudos
Resolved! SQL Analytics: Is it possible to configure the default number format
HiWhen querying an integer value, the default format is '0.0' which results in an integer value 202111, displayed as 202,111. I can resolve the issue by updating the visualisation or using formatnumber in my query, however I would like to set a defa...
- 7584 Views
- 6 replies
- 4 kudos
- 4 kudos
@Bilal Haniff - Would you be happy to mark whichever answer helped you the most as best? That helps others find solutions more quickly.
- 4 kudos
- 2373 Views
- 1 replies
- 15 kudos
Resolved! Write to Azure Delta Lake - optimization request
Databricks/Delta team could optimize some commands which writes to Azure Blob Storage as Azure display that message:
- 2373 Views
- 1 replies
- 15 kudos
- 15 kudos
Hey there. Thank you for your suggestion. I'll pass this up to the team.
- 15 kudos
- 4697 Views
- 2 replies
- 4 kudos
Resolved! How to show the properties of the folders/files from DBFS ?
Hello,How to show the properties of the folders/files from DBFS ?Currently i am using this command :display(dbutils.fs.ls("dbfs:/"))But it only shows :pathnamesizeHow to show these properties ? : CreatedBy (Name)CreatedOn (Date)ModifiedBy (Name)Modi...
- 4697 Views
- 2 replies
- 4 kudos
- 4 kudos
Only one idea is to use %sh magic command but there is no name (just root)
- 4 kudos
- 952 Views
- 0 replies
- 0 kudos
Not having a standard height becomes quite a challenge for many growing adolescents, which is said to be a condition of idiopathic short stature. So, ...
Not having a standard height becomes quite a challenge for many growing adolescents, which is said to be a condition of idiopathic short stature. So, while we can think it will be “ok” with time, we can’t ignore the elephant in the room. To diagnose ...
- 952 Views
- 0 replies
- 0 kudos
- 1745 Views
- 0 replies
- 0 kudos
Inventory Management System Handling the inventory and keeping track of everything is the most difficult, yet important aspect of leading a business...
Inventory Management System Handling the inventory and keeping track of everything is the most difficult, yet important aspect of leading a business. Inventory never stays the same. Due to sales, return, purchases, etc your business’ inventory is alw...
- 1745 Views
- 0 replies
- 0 kudos
| User | Count |
|---|---|
| 1644 | |
| 793 | |
| 554 | |
| 349 | |
| 287 |
