The church doesn't want the expense of maintaining a large building, but heritage fans want it preserved.