Okay, but we've also been missing neopronouns--no hundreds of years of linguistic evolution for those!
Anyway, whether or not it's too hard for you and I is less important than whether it's generally too hard (centuries of linguistic evolution notwithstanding). Since getting the object form of the first-person pronoun is apparently too hard for a lot of people (see above), I think we need to have modest expectations regardless of what we decide.