Using an ultracompact groove-slit-groove (GSG) structure, a refractive index sensor with a broadband response is proposed and experimentally demonstrated. Due to the interference of surface plasmon polaritons (SPPs), the transmission spectra in the GSG structure exhibit oscillation behaviors in a broad bandwidth, and they are quite sensitive to the refractive index of the surroundings. Based on the principle, the characteristics of its refractive index sensing are demonstrated experimentally. In the experiment, the structure is illuminated with a bulk light source (not a tightly focused light source) from the back side. This decreases the difficulty of the experimental measurement and can protect strong light sources from damaging the detection samples. Meanwhile, the whole structure of the sensor can be made more ultracompact without considering the influence of the incident waves.