I have talked with some friends who have thought about taking up golf in retirement. If you enjoy being outdoors, hitting a ball around without much concern about how competent you become, then do it. See an instructor, get some tips on clubs, take a few lessons and go for it! Whether one takes up the sport or not depends greatly on who you are.
On the other hand, if you want to be a good player who is competitive with peers, give the decision some thought. Unless you are a gifted athlete, you can count on hours of practice and instruction at times without too much progress. Taking on the game takes a considerable time and financial commitment. It is an exciting game that can be very satisfying, but it is daunting.