Based on GitHub docs you can delete the branch or the repository that the page is using as a publishing source.
Read more here: Unpublishing a GitHub Pages site — GitHub Docs

Another simpler solution is to push a blank index html for your angular application so that the page looks empty until you maintain your app.

Hope it helps!

Love podcasts or audiobooks? Learn on the go with our new app.