topic Re: How to read data from Azure Log Analitycs ? in Data Engineering

How to read data from Azure Log Analitycs ?

William_Scardua — Wed, 22 Feb 2023 23:53:29 GMT

Hi guys,

I need to read data from Azure Log Analitycs Workspace directaly, have any idea ?

thank you

Re: How to read data from Azure Log Analitycs ?

Ajay-Pandey — Thu, 23 Feb 2023 06:30:14 GMT

Hi @William Scardua

You can use Log Analytics REST API to extract the data from databricks.

Please refer below link for more information-

Log Analytics REST API | Microsoft Learn

Re: How to read data from Azure Log Analitycs ?

Priyag1 — Wed, 03 May 2023 15:39:24 GMT

Thank you for sharing best answers here

Re: How to read data from Azure Log Analitycs ?

alexott — Sun, 16 Feb 2025 12:13:49 GMT

You can use Kusto Spark connector for that: https://github.com/Azure/azure-kusto-spark/blob/master/docs/KustoSource.md#source-read-command

It heavily depends on how you access data, there could be a need for using ADX cluster for it: https://learn.microsoft.com/en-us/azure/data-explorer/query-monitor-data

Re: How to read data from Azure Log Analitycs ?

pregress — Tue, 15 Apr 2025 10:29:52 GMT

Here is a sample on how to do it using azure-kusto-spark connector with managed identity.

df = spark.read.format("com.microsoft.kusto.spark.datasource") \ .option("kustoCluster", "https://ade.loganalytics.io/subscriptions/{subscriptionid}/resourceGroups/{rg-name}/providers/microsoft.operationalinsights/workspaces/{log-analytics-name}") \ .option("kustoDatabase", "{log-analytics-name}") \ .option("kustoQuery", "Table| take 10") \ .option("managedIdentityAuth", "true") \ .option("managedIdentityClientId", "00000000-0000-0000-0000-000000000000") \ .load()