In Linux, a true software RAID can be made of any drives on any controller. Just add drives via the on-board connectors and when you run out, get an add-on controller. What hardware are you starting with?
I don't know about used drives (I don't trust them), but 500GB used to be the best GB/$...