Based on GitHub docs you can delete the branch or the repository that the page is using as a publishing source.
Read more here: Unpublishing a GitHub Pages site — GitHub Docs

Another simpler solution is to push a blank index html for your angular application so that the page looks empty until you maintain your app.

Hope it helps!