Good Anchovies are delicious and bad are bad, just like anything else. But if you have an aversion to fish, then like my wife anchovies will smell very fishy to you.
However they are very salty and mainly used for that quality. I do have anchovies and anchovy paste and use them both with certain sauces. If mixed in the right proportions none of your guests will even know that there are anchovies in the sauce.
I just started using them in the last year and although I like fish I had the same fear of the fishy taste but found that it just was'nt so if you used the right amount.