If you were one of the privileged, you would make it to the pleasure gardens in the Inner Sanctum where there were numerous pavillions, lawns and streams of water. The British used the Red Fort as a base camp, and saw no need for such frivolities. They removed most of the pavillions and the river, which used to run directly behind the palace was diverted and replaced with a road.