If you get a good grip on one end of that goop strip, you might be able to peel it all up in one piece. Maybe try pliers lined with a shop rag for gripping without cutting/tearing. If not, a putty knife will help...

I would definitely try to get as much of that old material off as possible before laying down new GOOP. It looks very bubbly...