"They tell me I’m his first cousin twice removed"

Means other children of your great great grandparents, which means your grandmothers cousin. Probably unlikely you would trace who it was, the family tree could have split 8 times since then.