From the little experience I had trying to learn it the hardest part by far is speaking. Sure learning to read symbols, no matter how many, is doable, but Chinese pronunciation is amazingly tricky... what sounds to you like exactly the same word could be 5 different words with the most minute differences in pronunciation... differences that your ear is totally untrained to detect
