@Nagaram The bookstore and the coffee shop are great, but of course I'm biased.
There are lots of great antique stores in town. I recommend Ellijay Antiques. There are *lots* though.
Good hiking, good fishing. One of the largest percentages of public land anywhere on the east coast, so if you're into outdoor rec that can be great. Big mountainbiking area too. The bigfoot museum is always a hoot, if you're into that kind of thing. Shockingly well done and very selfserious for how silly it is.
The pinball joint in blue ridge (the next town up) is great, as is the drive in. The old mule house in Jasper (one town down, other direction) is an incredible restaurant with a menu designed by a couple of celebrity chefs.
There are also some great restaurants in blue ridge, but they tend to be a bit more crowded and pricey.
There are ... fewer good restaurants in Ellijay, but I'll happily recommend Ellijay Woodfired Pizza which is way better than it should be all things considered.
Parking is a problem in downtown right now. You can park in the church lots for $5, but it *looks like* they are strictly private parking, so a lot of people don't realize it.
If you like wine, we have wineries. If you like art, there's a small art gallery here and another in Blue Ridge.
If you like beer or cider, there's beer and cider joints.
If you come in the spring or the summer, there are lots of family spots, petting zoos, putt putt etc. In Feb ... less so. The town will just be beginning to wake back up.