Passive radiative cooling promises great potential for cooling in buildings and automobiles to alleviate the challenge of escalating electricity demand and carbon dioxide emission. Colored radiative coolers (CRCs) have been drawing growing interest recently to provide visual comfort in addition to the passive cooling effect. However, since coloration usually accompanies a certain absorption of solar energy, it is rather difficult to achieve sub-ambient cooling with enough color variation. Moreover, angular dependence, a key consideration factor in actual applications, has rarely been investigated in previous work. In this paper, we design angle-insensitive and wide-color-gamut CRCs by stacking a solar-transparent selective emitter on an asymmetric Ag-TiO₂-Al cavity structure. In order to pursue a near-ideal emissivity in the atmospheric transparency windows, a mixed-integer memetic algorithm is applied to simultaneously search for the layer materials and thicknesses of top emitter. The optimized selective emitter achieves a net cooling power density of 126.6 W/m². Cyan, magenta, and yellow CRCs were then designed by choosing appropriate structural parameters of bottom cavities. Sub-ambient cooling of 3.5, 4.5, and 6.2 °C can be achieved at an ambient temperature of 30 °C and a parasitic heat transfer coefficient of 6.0 W/m²·K. Satisfactory cooling performance as well as the produced colors can be maintained even if the incident angle is increased to 50°. The angular tolerance and wide color variation of designed reflective CRCs are favorable to many practical applications beyond colored cooling roof and vehicle decoration.