Maintain in-memory copy of the board image