I prefer Concentration as Voodoo levels can be vital when wielding the staff, and some of the spells, it also helps the Voodoo doll as well in this fashion.
Second, I like Spirit Lore, nothing like charging that spell fast when your in a pinch, but since it doesnt also benefit the doll, I vote Concentration.
Conservation, I dont see as being that overall effective when using Concentration.
Spirit Mastery is cool, benefits both Staff and Doll, but not something I use until done leveling these weapons.