Accepting that we're limited to a special needs adoption

My husband and I are just getting started in the adoption process and have found out that due to our age we are only eligible to adopt special needs children (older than 8 years, or under 8 years old with a physical or mental disability). Our concept of what our family would look like has undergone so many transformations as we went through a year of not getting pregnant naturally, then years of fertility treatments, and then some time exploring and getting excited about an infant adoption .... now this. I feel like we, and especially my husband, had finally opened ourselves to adoption when we found out about the special needs requirement and now we're back at the questioning phase. Any tips on coming to terms with this news? How can we decide if this is right for us, and how do we decide if a younger child with disabilities or an older child would be a better fit for us?