There are many things on which it depends and cause of which you can find difficult to gain or loose weight. Genetics also play very important role in it. You should get some
dna fitness test it will prove that is this the case or not. Then you can follow the diet according to it.