Lepton flavor of four-fermion operator and fermion portal dark matter