To begin I would suggest Allen's newer work, so probably watch Vicky Christina Barcelona, Match Point, and Midnight in Paris. All good films. He is so good at making his location look beautiful and showcasing it for all that it is.
Next would be Annie Hall which he is most well known for and may be the birth of the modern romantic comedy, and Manhattan. Both are great movies from his early career.