cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
brickster_2018
by • Databricks Employee
  • 2843 Views
  • 1 replies
  • 0 kudos

Resolved! Can I connect to Eventhub using Kafka API? Which is the preferred way?

Data Engineering
Reply
  • 2843 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
brickster_2018
Databricks Employee
  • 0 kudos

Yes, it's possible to use Kafka API to connect to the eventhub. Eventhub supports the usage of Kafka API to stream the data from the EventhubReference: https://docs.microsoft.com/en-us/azure/event-hubs/event-hubs-for-kafka-ecosystem-overviewSample pr...

  • 0 kudos
User16826987838
by • Contributor
  • 1195 Views
  • 1 replies
  • 1 kudos

Is there a way to add users to workspace programmatically (through API?) instead of going manually adding them through the Admin console?

Data Engineering
Reply
  • 1195 Views
  • 1 replies
  • 1 kudos
View Replies
Latest Reply
User16783855534
New Contributor III
  • 1 kudos

https://docs.databricks.com/dev-tools/api/latest/scim/scim-users.html#create-user

  • 1 kudos
Anonymous
by • Not applicable
  • 1218 Views
  • 1 replies
  • 1 kudos

Resolved! Can I use mlflow locally on my machine or does it always have to be through Databricks?

Would it require DB connect / DB CLI / API?

Data Engineering
Reply
  • 1218 Views
  • 1 replies
  • 1 kudos
View Replies
Latest Reply
sajith_appukutt
Honored Contributor II
  • 1 kudos

mlflow is an open source framework and you could pip install mlflow in your laptop for example. https://mlflow.org/docs/latest/quickstart.html

  • 1 kudos
User15787040559
by • Databricks Employee
  • 3951 Views
  • 2 replies
  • 0 kudos

How to do a unionAll() when the number and the name of columns are different?

Looking at the API for Dataframe.unionAll() when you have 2 different dataframes with different number of columns and names unionAll() doesn't work.How can you do it?One possible solution is using the following function which performs the union of tw...

Data Engineering
Reply
  • 3951 Views
  • 2 replies
  • 0 kudos
View Replies
Latest Reply
sean_owen
Databricks Employee
  • 0 kudos

I'm not sure union is the right tool, if the DataFrames have fundamentally different information in them. If the difference is merely column name, yes, rename. If they don't, then the 'union' contemplated here is really a union of columns as well as ...

  • 0 kudos
1 More Replies
Labels