First of all lets see what work is;
"Work is a force causing an object to move in the same direction as the force."
For work to happen;
1. A force must be applied to an object.
2. The object must move in the same direction as the force.
*Now, for your question; since the book(object) is not moving in the same direction as your force, no work is being done!!
Hope that helps! Have a nice day:D