Pyspark API reference

[JohnJustus]

All,

I am using Azure Databricks and at times I refer to pyspark API's to interact with data in Azure datalake using python, SQL here https://spark.apache.org/docs/3.5.0/api/python/reference/pyspark.sql/index.html

Does databricks website has the list of API's OR I should refer only on the apache spark website?

Thanks,

John

[Kaniz]

Hi @JohnJustus, Yes, Databricks has its own API reference set, which you can refer to. However, as you use PySpark on Azure Databricks, you can also refer to the Apache Spark™ PySpark API reference for more detailed information. Both sources can be helpful depending on the specific API you are looking for.

[JohnJustus]

Thanks Kaniz.

Do you have the link handy  for API Reference in Databricks website?

[Kaniz]

Hi @JohnJustus , Here it is - https://docs.databricks.com/api/workspace/introduction