Playing the new AI player (Bruce Cropley's) doesn't affect your (or his) rating, even when you play a set, the games also don't make it into the (searchable) database. I do store the games, but they are not retrievable for now.
In short, the difficulty you set the AI player on tells you what you're getting into, the AI player will (for now) also not improve with every game. The difficulty setting determines how many moves it is allowed to think ahead.