Hey PJ, short answer is - No, attaching more notebooks does not increase the price of the cluster, which is solely based on compute power. Attaching more notebooks to the cluster is a value-add of the platform.
If you're interested, you can find some information around best practices while configuring clusters to optimize costs here: https://docs.databricks.com/clusters/cluster-config-best-practices.html
