I don't know of anybody who considers penicillin and any of that family of drugs "unsafe". People acknowledge that these antibiotics save lives.
I have a daughter, however, that is allergic to anything cillin. We found out when she was pretty young, when she had a serious adverse reaction. I don't know, but I've always wondered if she developed some other health issues as a result of the penicillin.
That said, every other child in my family uses that family of antibiotics. I have never suggested to anybody else they shouldn't use penicillin. Why? Because that would be stupid. It's literally a life-saving drug. My daughter's experience would almost certainly NOT be their experience. I don't remember for sure, but I believe when I looked it up, the percentage of adverse reactions with cillins is greater than adverse reactions from MMR. Yet for some reason, the anti-vaxxers haven't become anti-cillin.