TY - JOUR
T1 - Top–Down Sparse Fuzzy Regression Modeling from Data with Improved Coverage
AU - Lughofer, Edwin
AU - Kindermann, Stefan
AU - Pratama, Mahardhika
AU - Rubio, Jose de Jesus
N1 - Publisher Copyright:
© 2016, Taiwan Fuzzy Systems Association and Springer-Verlag Berlin Heidelberg.
PY - 2017/10/1
Y1 - 2017/10/1
N2 - We propose a new fuzzy modeling algorithm from data for regression problems. It acts in a top–down manner by allowing the user to specify an upper number of allowed rules in the rule base which is sparsed out with the usage of an iterative constrained numerical optimization procedure. It is based on the combination of the least squares error and the sum of rule weights over all rules to achieve minimal error with lowest possible number of significantly active rules. Two major novel concepts are integrated into the optimization process: the first respects a minimal coverage degree of the sample space in order to approach ϵ-completeness of the rule base (an important interpretability criterion) and the second optimizes the positioning and ranges of influence of the rules, which is done synchronously to the optimization of the rule weights within an intervened, homogeneous procedure. Based on empirical results achieved for several high-dimensional (partially noisy) data sets, it can be shown that our advanced, intervened optimization yields fuzzy systems with a better coverage and a higher degree of ϵ-completeness compared to the fuzzy models achieved by related data-driven fuzzy modeling methods. This is even achieved with a significantly lower or at least equal number of rules and with a similar model error on separate validation data.
AB - We propose a new fuzzy modeling algorithm from data for regression problems. It acts in a top–down manner by allowing the user to specify an upper number of allowed rules in the rule base which is sparsed out with the usage of an iterative constrained numerical optimization procedure. It is based on the combination of the least squares error and the sum of rule weights over all rules to achieve minimal error with lowest possible number of significantly active rules. Two major novel concepts are integrated into the optimization process: the first respects a minimal coverage degree of the sample space in order to approach ϵ-completeness of the rule base (an important interpretability criterion) and the second optimizes the positioning and ranges of influence of the rules, which is done synchronously to the optimization of the rule weights within an intervened, homogeneous procedure. Based on empirical results achieved for several high-dimensional (partially noisy) data sets, it can be shown that our advanced, intervened optimization yields fuzzy systems with a better coverage and a higher degree of ϵ-completeness compared to the fuzzy models achieved by related data-driven fuzzy modeling methods. This is even achieved with a significantly lower or at least equal number of rules and with a similar model error on separate validation data.
KW - Constrained numerical optimization problem
KW - Coverage
KW - Homogeneous optimization
KW - Intervened
KW - Penalty term
KW - Rule base out-sparseing
KW - Top–down fuzzy system modeling
KW - ϵ-completeness
UR - http://www.scopus.com/inward/record.url?scp=85031775982&partnerID=8YFLogxK
U2 - 10.1007/s40815-016-0271-0
DO - 10.1007/s40815-016-0271-0
M3 - Artículo
SN - 1562-2479
VL - 19
SP - 1645
EP - 1658
JO - International Journal of Fuzzy Systems
JF - International Journal of Fuzzy Systems
IS - 5
ER -