Pandas_Udod max batch size not working in notebook

[277745]

Hello 

I am trying to set max batch size for pandas-udf in Databricks notebook, but in my tests it doesn’t have any effect on size. spark.conf.set("spark.sql.execution.arrow.enabled", "true")

spark.conf.set('spark.sql.execution.arrow.maxRecordsPerBatch', 1000000)

should I set it in other way like during cluster configuration?

Thanks for clarification in advance!