I blame Mike Lynch for me coming to terms early with the Bb chord - the man seems to play every other song in F... I am only just into my second month of playing, but I don't recall finding E that difficult. Mike Lynch uses a barre D most of the time, and if you just slide it up, it becomes E. By the way - I am really chuffed for you. Avoiding the B chord and also barre chords held me back for years on the guitar.