The RSS icon is added to your sidebar by the plugin_hook in Elgg's care. To remove the icon, it's enough to add the following line of code to your start.php init function:

elgg_unregister_plugin_hook_handler('output:before', 'layout', 'elgg_views_add_rss_link');