Usually the seed part of the fruit will not be tasty (may taste bitter) why?

Explanation

If the seeds are tasty then the animals will consume the seeds along with the fruits. To enable dispersion of seeds, mother nature has made some of the seeds bitter so that animals just discard those enabling seed dispersion. (Mangalore Cucumber is a classic example)