Its that simple. Your first visit to a Vet should be soon after, or even before you bring your bird home. Choosing a provider for any professional service can be difficult, but use common sense.
Find a Vet with experience with birds. Get some recommendations. These can come from many sources, the breeder of your bird, your canine vet, a bird owner you know or one of our members. After you identify a candidate, talk to them and make sure you are comfortable with them on a person-to-person basis. Make sure you communicate well with the Vet. Discuss their philosophy of regular care and be sure you are comfortable with it.
Since you are viewing this on the web, you have access to a world of resources. Here are just a few. These links are by no means exhaustive, and you can find more by plugging "Avian Veterinarian" into any major search engine.
With the usual disclaimers about leaving this site and not necessarily endorsing the following links, here you go...