Marvel Studios really wanted the pool scene, and Whedon really wanted the farmhouse scene. They made an agreement to do each other's scenes. Most of the pool stuff got cut b/c of time which means it ended up feeling squeezed in and didn't make sense to anyone, including comic book nerds.