Marijuana is a gateway drug. So it is possible that if everyone can have marijuana, then everyone could move on to more hardcore drugs. Then you go from everyone on marijuana to everyone on meth, heroin, cocaine, etc.
Marijuana, through research, is showing some promise in treating illnesses and helping people cope with pain. If people actually need it you may as well not make it harder for them. Why make them suffer?