Many people have heard about that dress, that some people perceived as white and gold and others perceived as black and blue, but you may have missed the news about Homer's apparent inability to see the color blue, as evidenced by his use of phrases like wine-dark sea  and violet sheep. You can read more about it in Business Insider: No one could see the color blue until modern times and the New Republic: Does Color Even Exist: The Philosophy of Color. Color perception changes with how different people view different wavelengths of light, and depending on where you live and when you live/lived, you may have a very different experience. For example, the idea of the color pink is a relatively new concept. The Secret Language of Color by Joann Eckstut discusses some popular ideas about color and how the emergence of things like colored textile dyes affected our cultural understanding of color. NYPL carries many titles on optical illusions and even Magic Eye puzzles, which supposedly can help improve eye sight. 

According to the Colour Blind Awareness website, 1 in 12 men and 1 in 200 women are colorblind. I didn't find many fiction titles that deal with colorblindness, other than Jasper Fforde's Shades of Grey, possibly because it's so common, but perhaps there are some writing opportunities there. 

Synesthesia is a  medical term for one type of stimulation evoking another, such as hearing a color or smelling a shape, but it has also become a literary term for that experience in a novel such as when Fitzgerald writes in The Great Gatsby: "now the orchestra is playing yellow cocktail music" (p. 42). The Great Gatsby does some interesting things with color symbolism in general, beyond the green light that is so central to the story.  While the use of synesthesia in literature is common, two well-known authors who were synaesthetes are Rimbaud (see his poem Voyelles)  and Nabokov.  Some nonfiction books on the subject are: Blue Cats and Chartreuse Kittens by Patricia Lynn Duffy and The Man Who Tasted Shapes by Richard E. Cytowic. Some young adult and children's books that employ synesthesia are: A Mango-Shaped Space by Wendy Mass, My Blue Is Happy by Jessica Young, and the poetry book Red Sings From Treetops: A Year in Colors by Joyce Sidman.

A reminder: the Andrew Heiskell branch of the NYPL offers closed circuit televisions and other assistive devices that can enlarge text and "can be adjusted for brightness, contrast, reverse image, and color scheme".