- 7540 Views
- 3 replies
- 2 kudos
Resolved! Issues loading .txt files from DBFS into Langchain TextLoader()
Hello,I am working on building a Langchain QA application in Databricks. I currently have 13 .txt files loaded into the DBFS and am trying to read them in iteratively with TextLoader(), load them into the RecursiveCharacterTextSplitter() from Langcha...
- 7540 Views
- 3 replies
- 2 kudos
- 2 kudos
Hi @David Kersey​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers ...
- 2 kudos
- 6676 Views
- 5 replies
- 3 kudos
Sample Datasets URL in Azure Databricks / access sample datasets when NPIP and Firewall is enabled
Hi,I have an Azure Databricks instance configured to use VNet injection with secure cluster connectivity. I have an Azure Firewall configured and controlling all traffic ingress and egress locations as per this article: https://learn.microsoft.com/en...
- 6676 Views
- 5 replies
- 3 kudos
- 3 kudos
Hi @Alex Bush​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we ...
- 3 kudos
- 6240 Views
- 5 replies
- 5 kudos
How to change the feature store delta table default path on DBFS?
Hi everyone,Would it be possible to change the default storage path of deature store, during creation and/or after creation? If you could also provide the python script to that I would appreciate. The current default path is:"dbfs/user/hive/warehouse...
- 6240 Views
- 5 replies
- 5 kudos
- 5 kudos
Hi @Saeid Hedayati​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us s...
- 5 kudos
- 11133 Views
- 4 replies
- 0 kudos
Resolved! I am saving a new feature table to the Databricks feature store, and it won't write the data sources of the tables used to create the feature table, because they are Hive tables that point to Azure Data Lake Storage Gen1 Delta tables
My notebook is pulling in Hive tables from DBFS, that point to ADLS Gen1 file locations for their data (Delta tables), creating the feature table as a data frame within the notebook, then calling on the feature store client to save down the feature t...
- 11133 Views
- 4 replies
- 0 kudos
- 0 kudos
@Jack Watson​ Could you please confirm the write is succeeding ? If yes, as per my understanding This is a warning for some validation that we will be removing shortly. We’ll likely remove the validation which save the data source.Thanks.
- 0 kudos
- 1581 Views
- 1 replies
- 0 kudos
- 1581 Views
- 1 replies
- 0 kudos
- 0 kudos
aws s3 ls --summarize --human-readable --recursive s3://root-bucket-name/Bucket owner could run this command or get the info from console. Would that work ?
- 0 kudos