To to convert pd df to a dict before passing on

E.g. createDataFrame(pd.read_csv('abc').to.dict())

In my case there was some non serializable attribute on pd df which is dropped when converting to dict.

Btw logging in here and answering was an insane obstacle. My large company subscription is set wrong so we can't login into community because our admin accounts does not have literal email accounts. Attempt to setup a personal account was only possible when not at all using the corp WiFi, I get kicked