topic Re: Spark - API Jira in Data Engineering

Spark - API Jira

weldermartins — Thu, 06 Oct 2022 12:14:18 GMT

Hello guys. I use pyspark in my daily life. A demand has arisen to collect information in Jira. I was able to do this via Talend ESB, but I wouldn't want to use different tools to get the job done. Do you have any example of how to extract data from Jira API via PYSPARK?

Re: Spark - API Jira

Hubert-Dudek — Fri, 14 Oct 2022 11:46:28 GMT

Hi, in partner connect in databricks, you would find Fivetran, and they have a Jira connector. https://www.fivetran.com/connectors/atlassian-jira

Re: Spark - API Jira

weldermartins — Fri, 14 Oct 2022 12:05:00 GMT

hi, I'm using Python Requests, I'm already extracting the information via Jira's api. Thanks.

Re: Spark - API Jira

Anonymous — Mon, 14 Nov 2022 07:39:59 GMT

Hi @welder martins

Hope all is well!

Does @Hubert Dudek response answer your question?

If you could resolve your issue, would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help.

We'd love to hear from you.

Thanks!

Re: Spark - API Jira

weldermartins — Mon, 14 Nov 2022 13:15:49 GMT

Hello. I went the other way using Python Request. Below the reference

Manual:

https://support.atlassian.com/atlassian-account/docs/manage-api-tokens-for-your-atlassian-account/

Example:

https://developer.atlassian.com/cloud/jira/platform/rest/v3/api-group-issues#api-rest-api-3-events-get

Re: Spark - API Jira

Marty73 — Fri, 16 Feb 2024 04:33:45 GMT

Hi,

There is also a new Databricks for Jira add-on on the Atlassian Marketplace. It is easy to setup and exports are directly created within Jira. They can be one-time, scheduled, or real-time. It can also export additional Jira data such as Assets, Changelogs, Projects, Sprints, Users, JSM users/organizations, etc.

Best

Re: Spark - API Jira

rimaissa — Thu, 15 Aug 2024 15:48:35 GMT

@Marty73 does the connector work with Unity Catalog?