Just your passport (non-US passport is ok!).
If you are a foreign company doing consulting or E-commerce, we recommend forming a Wyoming LLC. They have the lowest annual fees and are friendly to business.
For tech startups, the best option is forming a Delaware C Corporation.
$0 for non-residents thanks to taxation treaties, but you still need to file the paperwork (doola can do this for you!).