My car is also my daily driver; I drove it there and back. The only place around the track where I was concerned was coming down from the bridge turn, where the pit entrance used to be; that turn is quite fast, and before the wall, there was a ditch - That concerned me some; but what happens, is that the first few times you go around there conservatively, you start to feel that because as you turn the road levels, you have a tremendous amount of grip. The grip actually increases as you become more aggressive, and when you get it right, trust me; you'll feel it, and you'll feel safe.
Look - There may not be many places where a street car can go on a high quality road course; along with Laguna Seca, Mid Ohio and Road America, Road Atlanta stands among the best in the US. Go for it - just drive within your means, and work your speed up at the pace with which you are comfortable.
HAVE FUN!