As with any physical activity, a rested body increases performance. Lack of sleep, including lack of proper sleep, may be the culprit that decreases sex drive. Sleep apnea is a potential cause for lack of good sleep and lack of libido. Medical help may be needed if you or your partner suspect it.