Add the option to enable or disable announce achievements in the properties section. I can't disable it in-game and that is kind of annoying. My server is on 1.8 and the feature doesn't seem to be there for me.
If you have Multiverse-core installed try using this command /mv gamerule {RULE} {VALUE} [WORLD]
but if you do not have it installed /gamerule