The baritone uke's longer neck demands a little more finger strength and agility than its smaller cousins, but not so much more that it should put you off. If you like the deep mellowness of the baritone uke, go for it!
I'd recommend if you start with a baritone uke that you invest in a uke capo as well (Shubb makes nice ones). With a capo on the fifth fret, a baritone is tuned exactly like a concert uke and has comparable neck length. That way, you can take advantage of all the online uke resources out there.
Viva la baritone!!!