Fort Tryon Park: Not a castle itself, but it holds one and has the best retaining walls I've seen outside a textbook.