Antenna Gain on Trial

Most people think it's a good thing to have and the more the better. However, this is not always true - and the amount of gain is often not what it appears to be. Assuming higher gain is what you need, how do you determine what will give the best performance?