Trip to Bay of Fundy - New Brunswick

Since I have changed the trip to NB only (mostly), I am wondering if I should do Fredericton instead of small Nova Scotia bit I have planned (Joggins Fossil Cliffs, Advocate Harbour, Cape Chignecto Provincial Park)

Looking at the guide books nothing really jumps at me (Kings Landing maybe?) but maybe there are some things I am missing?

We just booked Moncton for May 25-30, we have friends who moved there from Regina (RCMP posting). We are renting a vehicle. Any must see spots? Want to do PEI as a day trip during the weekend when they are working...looks like bay of fundy is a good choice based on this thread....cape breton worth it? Any good cheap and/or great seafood places in the area that you would recommend? are the whales out during this time? thanks!