If party wall agreements apply, then yes. Other than that it is always a good courtesy to inform them that building work will be taking place anyway.