Well, the Acropolis, and the Plaka, and the museums. I liked the Byzantine museum.
One of my favorite places near there was a little island called Aegina. It was about two hours from Pireus by ferry. It was beautiful, and the day we went, we were the only tourists there.