I know it is anxious around opposite sex.
I will recommend secular/atheists meetings. You might find lots of women there.
You can began from there.
And why don't you go to Ex-muslims meeting again and ask them to help you find social circle mostly of women.
You will have to sit with men too though.
You have learn to deal with them too.
I don't feel uncomfortable with men, it's just I prefer female company or more mixed.
Thanks for the suggestion.