I see a lot of /wp-json/wp/v2/* calls in the slow pages. Makes a lot of sense because they are basically DB queries and might not be cached. I would love to know where the calls are coming from. The referring page perhaps.