Accumulated local effects
Accumulated local effects (ALE) is a machine learning interpretability method.[1]
Concepts
[edit]ALE uses a conditional feature distribution as an input and generates augmented data, creating more realistic data than a marginal distribution.[2]
It ignores far out-of-distribution (outlier) values.[1] Unlike partial dependence plots and marginal plots, ALE is not defeated in the presence of correlated predictors.[3]
It analyzes differences in predictions instead of averaging them by calculating the average of the differences in model predictions over the augmented data, instead of the average of the predictions themselves.[2]
Example
[edit]Given a model that predicts house prices based on its distance from city center and size of the building area, ALE compares the differences of predictions of houses of different sizes. The result separates the impact of the size from otherwise correlated features.[1]
Limitations
[edit]Defining evaluation windows is subjective. High correlations between features can defeat the technique.[1][3] ALE requires more and more uniformly distributed observations than PDP so that the conditional distribution can be reliably determined. The technique may produce inadequate results if the data is highly sparse, which is more common with high-dimensional data (curse of dimensionality).[2]
See also
[edit]References
[edit]- ^ a b c d Rodriguez, Jesus (27 December 2022). "Edge 255: Interpretability Methods: Accumulated Local Effects (ALE)". thesequence.substack.com. Retrieved 2022-12-27.
- ^ a b c "Accumulated Local Effects — ADS 2.7.0 documentation". docs.oracle.com. Retrieved 2022-12-31.
- ^ a b Gupta, Aman (2020-10-25). "Accumulated Local Effects (ALE)-Feature Importance Technique". Analytics Vidhya. Retrieved 2022-12-27.
External links
[edit]- Munn, Michael (2022). Explainable AI for Practitioners. O'Reilly Media, Incorporated. ISBN 978-1-0981-1910-2. OCLC 1350433516.