Perceptual learning, which improves stimulus discrimination, typically results from training with a single stimulus condition. Two major learning mechanisms, early cortical neural plasticity and response reweighting, have been proposed. Here we report a new format of perceptual learning that by design may have bypassed these mechanisms. Instead it is more likely based on abstracted stimulus evidence from multiple stimulus conditions. Specifically, we had observers practice orientation discrimination with Gabors or symmetric dot patterns at up to 47 random or rotating location´orientation conditions. Although each condition received sparse trials (16 trials/session), the practice produced significant orientation learning. Learning also transferred to a Gabor at a single untrained condition with 2-3 time lower orientation thresholds. Moreover, practicing a single stimulus condition with matched trial frequency (16 trials/session) failed to produce significant learning. These results suggested that learning with multiple stimulus conditions may not come from early cortical plasticity or response reweighting with each particular condition. Rather, it may materialize through a new format of perceptual learning, in which orientation evidence invariant to particular orientations and locations is first abstracted from multiple stimulus conditions, and then reweighted by later learning mechanisms. The coarse-to-fine transfer of orientation learning from multiple Gabors or symmetric-dot-patterns to a single Gabor also suggested the involvement of orientation concept learning by the learning mechanisms.