Trump didn’t go to the dinner over multiple years purely because a lot of reporters use it to poke fun (in good fun) at the President, and occasionally actually lobby for something too. The man cannot take being made fun of, at all. Making it a Presidential event makes sure that he can exclude anybody that’s not the most sycophantic.