Walter_C
Databricks Employee
Databricks Employee

Hello @sjohnston2 here is some information i found internally:

Possible Causes

  1. Memory Access Issue: The segmentation fault suggests that the program is trying to access memory that it's not allowed to, which could be caused by an internal bug in XGBoost when processing certain feature weight configurations
  2. XGBoost Version: This could be a bug in the specific version of XGBoost you're using. Feature weights were added in version 1.3.0, so ensure you're using a recent, stable version
  3. Incompatible Feature Weights: The error occurs with certain feature weight configurations but not others, indicating that the issue might be related to how XGBoost handles specific weight patterns.

Try modifying your feature weights to avoid the configuration that causes the error. For example:

feature_weights = np.ones(X_train.shape[1])  # Start with all weights set to 1
feature_weights[:10] = 2.0  # Increase weights for the first 10 features

View solution in original post