About the only downside I can come up with is that U.S. Customs and Border Protection is allowed to stop people within 100 miles of an international border. Not just Canada/Mexico but the entire seaboard as well. The ACLU has a section on this — IMO worth a read if you’re, erm… lacking documents.