If her psychiatrist doesn't think that her threats are serious, and judging by what you said they don't, it is definitely time to find a new one.
If you're frightened of what she may do, and it looks like she's already harmed herself, it is definitely time to think about removing her from the situation and getting inpatient treatment, where she can get the in depth help she needs.