This paper addresses the problem of obtaining a concise description of spectral representation for color images. The proposed method is a graph-based formulation of the well-known Color Lines model. It generalizes the lines to piece-wise lines, been able to fit more complex structures. We illustrate the goodness of proposed method by measuring the quality of the simplified representations in images and videos. The quality of video sequences reconstructed by means of proposed color lines extracted from the first frame demonstrates the robustness of our representation. Our formalism allows to address applications such as image segmentation, shadow correction among others.