I never got one nanosecond of warmth from him or tenderness or parental anything — and that’s when he was in a good mood,” the actor tells Page Six.