{"id":706,"date":"2024-11-05T17:31:54","date_gmt":"2024-11-05T16:31:54","guid":{"rendered":"https:\/\/idea.gm.th-koeln.de\/?p=706"},"modified":"2024-11-05T17:31:57","modified_gmt":"2024-11-05T16:31:57","slug":"new-arxiv-preprint-enhancing-feature-selection-and-interpretability-in-ai-regression-tasks-through-feature-attribution","status":"publish","type":"post","link":"https:\/\/www.spotseven.de\/?p=706","title":{"rendered":"New arXiv Preprint: Enhancing Feature Selection and Interpretability in AI Regression Tasks Through Feature Attribution"},"content":{"rendered":"\n<p>The <a href=\"https:\/\/arxiv.org\/abs\/2409.16787\">article<\/a> is the result of an ongoing cooperation between the Institute of Data Science, Engineering, and Analytics (IDE+A) at TH K\u00f6ln (<a href=\"https:\/\/orcid.org\/0009-0002-7615-6952\">Alexander Hinterleitner<\/a>, <a href=\"https:\/\/orcid.org\/0000-0002-5938-5158\">Thomas Bartz-Beielstein<\/a>, <a href=\"https:\/\/orcid.org\/0009-0007-0834-9927\">Richard Schulz<\/a>), and <a href=\"https:\/\/www.man-es.com\/company\">MAN Energy Solutions<\/a> (<a href=\"https:\/\/www.researchgate.net\/profile\/Sebastian-Spengler\">Sebastian Spengler<\/a>, <a href=\"https:\/\/www.linkedin.com\/in\/thomas-winter-020643247?lipi=urn%3Ali%3Apage%3Ad_flagship3_profile_view_base_contact_details%3BQmiYBK5jSC2ep0iiOmscsw%3D%3D\">Thomas Winter<\/a>, <a href=\"https:\/\/www.linkedin.com\/in\/christoph-leitenmeier-a0a995144?lipi=urn%3Ali%3Apage%3Ad_flagship3_profile_view_base_contact_details%3BXWRMd6EHSIWDqbmb8f45Pg%3D%3D\">Christoph Leitenmeier<\/a>). The abstract reads as follows:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>Research in Explainable Artificial Intelligence (XAI) is increasing, aiming to make deep learning models more transparent. Most XAI methods focus on justifying the decisions made by Artificial Intelligence (AI) systems in security-relevant applications. However, relatively little attention has been given to using these methods to improve the performance and robustness of deep learning algorithms. Additionally, much of the existing XAI work primarily addresses classification problems. In this study, we investigate the potential of feature attribution methods to filter out uninformative features in input data for regression problems, thereby improving the accuracy and stability of predictions. We introduce a feature selection pipeline that combines Integrated Gradients with k-means clustering to select an optimal set of variables from the initial data space. To validate the effectiveness of this approach, we apply it to a real-world industrial problem &#8211; blade vibration analysis in the development process of turbo machinery.<\/p>\n<\/blockquote>\n\n\n\n<figure class=\"wp-block-image size-large\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"696\" data-attachment-id=\"707\" data-permalink=\"https:\/\/www.spotseven.de\/?attachment_id=707\" data-orig-file=\"https:\/\/i0.wp.com\/www.spotseven.de\/wp-content\/uploads\/2024\/11\/axiv_feature_attr_2.png?fit=2016%2C1370&amp;ssl=1\" data-orig-size=\"2016,1370\" data-comments-opened=\"0\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"axiv_feature_attr_2\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/i0.wp.com\/www.spotseven.de\/wp-content\/uploads\/2024\/11\/axiv_feature_attr_2.png?fit=1024%2C696&amp;ssl=1\" src=\"https:\/\/i0.wp.com\/idea.gm.th-koeln.de\/wp-content\/uploads\/2024\/11\/axiv_feature_attr_2-1024x696.png?resize=1024%2C696&#038;ssl=1\" alt=\"\" class=\"wp-image-707\" srcset=\"https:\/\/i0.wp.com\/www.spotseven.de\/wp-content\/uploads\/2024\/11\/axiv_feature_attr_2.png?resize=1024%2C696&amp;ssl=1 1024w, https:\/\/i0.wp.com\/www.spotseven.de\/wp-content\/uploads\/2024\/11\/axiv_feature_attr_2.png?resize=750%2C510&amp;ssl=1 750w, https:\/\/i0.wp.com\/www.spotseven.de\/wp-content\/uploads\/2024\/11\/axiv_feature_attr_2.png?resize=500%2C340&amp;ssl=1 500w, https:\/\/i0.wp.com\/www.spotseven.de\/wp-content\/uploads\/2024\/11\/axiv_feature_attr_2.png?resize=768%2C522&amp;ssl=1 768w, https:\/\/i0.wp.com\/www.spotseven.de\/wp-content\/uploads\/2024\/11\/axiv_feature_attr_2.png?resize=1536%2C1044&amp;ssl=1 1536w, https:\/\/i0.wp.com\/www.spotseven.de\/wp-content\/uploads\/2024\/11\/axiv_feature_attr_2.png?resize=720%2C489&amp;ssl=1 720w, https:\/\/i0.wp.com\/www.spotseven.de\/wp-content\/uploads\/2024\/11\/axiv_feature_attr_2.png?resize=560%2C381&amp;ssl=1 560w, https:\/\/i0.wp.com\/www.spotseven.de\/wp-content\/uploads\/2024\/11\/axiv_feature_attr_2.png?w=2016&amp;ssl=1 2016w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\"><em>Absolute feature attribution values based on Integrated Gradients for the subcategories of the data. The attribution values are accumulated over the entire dataset, with different colors representing different feature categories.<\/em><\/figcaption><\/figure>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>The article explores the integration of Explainable Artificial Intelligence (XAI) in enhancing deep learning performance. Focusing on regression problems, it introduces a feature selection pipeline using Integrated Gradients and k-means clustering, applied to blade vibration analysis in turbo machinery development.<\/p>\n","protected":false},"author":3,"featured_media":708,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"advanced_seo_description":"","jetpack_seo_html_title":"","jetpack_seo_noindex":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"The article explores the integration of Explainable Artificial Intelligence (XAI) in enhancing deep learning performance.","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false},"version":2}},"categories":[44,31,47,48,16,61,6],"tags":[60,18,35,58,59],"class_list":["post-706","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence","category-artikel","category-hyperparameter-tuning","category-industrie","category-kooperation","category-turbo-machinery","category-published","tag-ai","tag-kooperation","tag-th-koln","tag-turbo-machinery","tag-xai",""],"acf":[],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/www.spotseven.de\/wp-content\/uploads\/2024\/11\/arxiv_feature_attribution.png?fit=2462%2C1236&ssl=1","jetpack_likes_enabled":true,"jetpack_sharing_enabled":true,"jetpack-related-posts":[],"jetpack_shortlink":"https:\/\/wp.me\/p2DCPK-bo","_links":{"self":[{"href":"https:\/\/www.spotseven.de\/index.php?rest_route=\/wp\/v2\/posts\/706","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.spotseven.de\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.spotseven.de\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.spotseven.de\/index.php?rest_route=\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.spotseven.de\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=706"}],"version-history":[{"count":1,"href":"https:\/\/www.spotseven.de\/index.php?rest_route=\/wp\/v2\/posts\/706\/revisions"}],"predecessor-version":[{"id":709,"href":"https:\/\/www.spotseven.de\/index.php?rest_route=\/wp\/v2\/posts\/706\/revisions\/709"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.spotseven.de\/index.php?rest_route=\/wp\/v2\/media\/708"}],"wp:attachment":[{"href":"https:\/\/www.spotseven.de\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=706"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.spotseven.de\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=706"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.spotseven.de\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=706"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}