Rubber or Plastic mallet would be safer than a hammer, unless it is a ballpeen type. As always, proper eye protection should be used - some hammers will crack and fracture before you can damage the drum.
Try soaking the area around the wheel studs and center bore with penetrating fluid - remember to take the parking brake off (common mistake - will make the drums impossible to take off). get two bolts to thread into the face of the drum and press then off - and work the drum over with the mallet / hammer.
For an 2005 Corolla - I can't expect the rear brakes to be that worn, unless the car was driven around with the parking brake engaged for some distance. I think mine were only 10% worn at 60K miles, changed them at 90K for grins (still had more than 60-70% left - checked them every 30K miles).
You could also try spraying some penetrating fluid (I like to use PB Blaster) on the studs and center bore and then do a couple of hard stops back and forth to potentially loosen up the drum (will also heat them up - so becareful touching them). Might come loose after that.