Also see: https://wordpress.org/plugins/comment-reply-email-notification/
This plugin was originally developed by Gustavo Henrique Mascarenhas Machado. Since he had no more time for it, I took over the maintenance and further development because I also use the plugin myself.
The source is available at bei GitHub.