(sorry, i posted comments to the wrong section.)
#3 Font should be more modern, emphasizing the First is important. If an ampersand is used it must be very strong and fully integrated into the logo. The tagline is clear, so that is good. The icon is not too large or overwhelming, but it needs to have some meaning. The icon in #2 relates to the @ symbol which points to the web, so that is a little closer. This one looks closer to a bank, which is a danger with our name, another reason to emphasize the "First". Think text and creating meaning out of text.