The home side went in front after 19 minutes when Argyle goalkeeper Rene Gilmartin could only palm out an inswinging corner from Fabian Broghammer and Anyinsah fired the ball pack past him with a fierce drive from 12 yards.
Another Broghammer corner from the opposite left side saw Lund make it 2-0 with a stunning volley after 25 minutes, while all Plymouth could offer in the first half were a couple of off-target headers from Onismor Bhasera and Nick Chadwick.
The visitors improved after the break and Conor Hourihane shot them back into the game from Durrell Berry's right-wing cross after 62 minutes.
Hourihane then hit a post with a shot from the edge of the box, but Rovers defended solidly and held out without further alarms.
The result meant four points from Ward's first two games in charge and on this form the experienced manager will inspire Football League survival.