How do i retrieve timestamp data from history in databricks sql not using DELTA table,its data is coming from SAP
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-02-2023 03:12 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-02-2023 04:22 AM
This depends on what database SAP is running.
First of all databricks SQL needs to have access to the SAP database (HANA, Oracle, DB2, ...)
To query changes to these tables, table logging has to be enabled OR you need to have access to the rollback log (or transaction log or ...).
Chances are small that you are allowed to run such a query.
But perhaps you mean something else with timestamp data?
![](/skins/images/F150478535D6FB5A5FF0311D4528FC89/responsive_peak/images/icon_anonymous_profile.png)
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-16-2023 10:37 PM
Hi @amruth D
Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help.
We'd love to hear from you.
Thanks!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-26-2023 03:15 AM
@amruth If you're working with data from SAP in Databricks and want to retrieve timestamps dynamically from a SAP table, you can utilize Databricks SQL to achieve this. You'll need to identify the specific SAP table that contains the timestamp or historical data. Once you've identified the table, you can construct a SQL query in Databricks that includes the appropriate columns and conditions to retrieve the timestamp dynamically. Consider using the SELECT statement to fetch the relevant timestamp column and apply any necessary filters based on your requirements. It's crucial to understand the structure of your SAP table and the naming conventions used for timestamp columns. If there's a specific column indicating historical data, you can use it in your query to retrieve timestamps dynamically. Ensure your Databricks environment is properly configured to connect to your SAP data source, and test your SQL query iteratively to ensure accurate results.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-17-2024 01:24 AM - edited 12-17-2024 01:24 AM
Hello,
If you’re trying to bring timestamp data or any other SAP Table from SAP (SAP HANA) into Databricks, our SAP HANA to Databricks Connector can help streamline this process. The connector enables you to extract data directly from SAP HANA tables and load it iteratively into Databricks for further processing.
The key benefits are:
- Incremental Data Transfer: Particularly helpful for managing very large datasets.
- Simple Usage: No complex configurations required.
With the connector, integrating your timestamped data should work seamlessly.
For more details, including implementation steps, please refer to our official documentation. If you need further support, don’t hesitate to contact us at info@dmesh.io.
I hope this helps you integrate SAP data into Databricks!
![](/skins/images/582998B45490C7019731A5B3A872C751/responsive_peak/images/icon_anonymous_message.png)
![](/skins/images/582998B45490C7019731A5B3A872C751/responsive_peak/images/icon_anonymous_message.png)