We found out that if you go to the Nashua City Hall to apply for your marriage license, it costs $60 and they need a certified copy of your birth certificate.
However, if you drive across the bridge to Hudson, you can obtain your marriage license there WITHOUT a certified copy of your birth certificate and it only costs $45.