The only hitch in your plan might be that Amtrak is notoriously late, and especially on the longer routes.

You might need a contingency in the event you were to miss the last train out of Penn Station.

Joel