Yeah, everybody has different things that annoy them most, but many romance animes have that kind of trope because the story's usually over after they started dating so I guess I'm just used to it.

Exactly! Which makes me hate the trope even more! It's bad enough they "tease" the audience throughout the series. But once they have the legitimate kiss, the show thinks the shark has been jumped so it's the finale.
It's why I have an appreciation for
Miraculous: Tales of Ladybug & Chat Noir. It's a decent animated superhero with a rather "monster of the week" format. And pretty much built on the "Will they, won't they?" trope. I liked it because I found it a charming series even though Marinette's behaviour around Adrian was annoying at times due to "will they, won't they?". I really thought Season 5 would be the finale now that Marinette and Adrian are together and Hawkmoth defeated. But Thomas Astruc said "Hold my baguette!" and started season 6 in Unreal Engine where Marinette and Adrian are still dating and it's more of them overcoming various teen relationship issues, their friends problems and a new villain wit the butterfly miraculous.
Whenever you like the show or not, I simply have the appreciation that they ditched the "Will they, won't they?" trope and legit trying to continue it from there.