Fears raised over unknown plans for land cleared without planning permission