This paper ‘A Taxonomy of Global Optimization Methods Based on Response Surfaces’ by Donald Jones does a fantastic job of explaining the wide variety of options for response surfaces. It’s written with optimization in mind, but his explanation of the methods is much more general. It’s written clearly, and I strongly recommend it for anyone working with response surfaces.
Here’s a link to the paper.
Stay tuned for some updates from SIAM CSE13 — the conference that quadrupled my TODO list.