The creation and deployment of sex robots are accelerating. Sex robots are service robots that perform actions contributing directly towards improvement in the satisfaction of the sexual needs of a user. In this paper, we explore the potential use of these robots for elder and disabled care purposes,which is currently underexplored. Indeed, although every human should be able to enjoy physical touch, intimacy, and sexual pleasure, persons with disabilities are often not in the position to fully experience the joys of life in the same manner as abled people. Similarly, older adults may have sexual needs that public healthcare tend to ignore as an essential part of their well-being. We develop a conceptual analysis of how sex robots could empower persons with disabilities and older adults to exercise their sexual rights, which are too often disregarded in society. Our contribution seeks to understand whether sex robots could serve as a step forward in enhancing the care of (mainly but not exclusively) persons with disabilities and older adults. By identifying the potential need to incorporate sex within the concept of care, and by exploring the use of robot technology to ease its materialization, we hope to inform the policy debate around the regulation of robots and set the scene for further research.