cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

java.lang.Exception: Unable to start python kernel for ReplId-79217-e05fc-0a4ce-2, kernel exited with exit code 1.

Harsh_Paliwal
New Contributor

imageI am running a parameterized autoloader notebook in a workflow.

This notebook is being called 29 times in parallel, and FYI UC is also enabled.

I am facing this error:

java.lang.Exception: Unable to start python kernel for ReplId-79217-e05fc-0a4ce-2, kernel exited with exit code 1.

----- stdout -----

------------------

----- stderr -----

Another app is currently holding the xtables lock. Perhaps you want to use the -w option?

Traceback (most recent call last):

File "/databricks/spark/python/pyspark/wrapped_python.py", line 136, in <module>

do_all_setup_for_username(sys.argv[1])

File "/databricks/spark/python/pyspark/wrapped_python.py", line 104, in do_all_setup_for_username

subprocess.check_call(

File "/usr/lib/python3.9/subprocess.py", line 373, in check_call

raise CalledProcessError(retcode, cmd)

subprocess.CalledProcessError: Command '['iptables', '-I', 'OUTPUT', '-m', 'owner', '--uid-owner', '1014', '-d', '127.0.0.1', '-p', 'tcp', '--destination-port', '40491', '-j', 'ACCEPT']' returned non-zero exit status 4.

1 REPLY 1

Anonymous
Not applicable

@Harsh Paliwal​ :

The error message suggests that there might be a conflict with the xtables lock.

One thing you could try is to add the -w option as suggested by the error message. You can add the following command to the beginning of your notebook to attempt to release any held xtables lock:

%sh sudo iptables -w -F

If this does not resolve the issue, you might want to check if there are any running processes that are using xtables lock. You can do this by running the following command in a terminal:

sudo lsof /usr/sbin/xtables-multi

If there are any processes listed, you can try killing them with the following command:

sudo kill -9 <process_id>

If none of the above works, please let me know.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group