I liked the simplicity of it but it feels like it is almost too far in that direction? I don't think that orange is a realistic background choice for us (most likely white or black), so do you think this would translate over well?
I'd have to argue against the simplicity of it. I mean a bunch of the most famous and appreciated logos are minimalist in style, which is why they stand the test of time. For instance, nike...fedex...apple...etc. Logos don't need to be fancy to be effective. Ideally, you're after brand recognition...
As far as the orange background, you don't need it. That was just there to fulfill the color requirements you stated. It will work great on a white or black background. Keep the black color for a white back (even add orange or a blue accent if you like) and use white for a darker background which will pop nicely.