In Hereditary, we learn from Annie that her father starved himself to death.

I don't fully understand how that happened. 

Did the cult/grandmother kill him?