Have done it many times chasing Elk and/or mules in the Rockies. Have noticed it effects different people, well, differently. I am hot blooded and love cooler temps and usually sleep in my long johns and the only time I will sleep with socks on. Main thing has been mentioned, plenty of warmth between you and the ground. I have slept on cots, air up beds and the ground and if you have enough insulation under you, the top is easy.
Another huge factor for what you may need is the sleeping arrangements, inside a tent, or outside exposed, done it both ways. Obviously outside exposed you need more layers of warmth. I get by in base camp woth the same few things. Generally will have a cheap tarp on the bottom, 1 unfolded sleeping bag, or heavy blanket, then the actual bag I crawl into, then I always have a thick blanket as a throw over, this set up lets me take off, unzip the bag I'm in, or layer up depending on the conditions.
I have slept on the trail as well and that usually is just a damn good 0* bag and lite wool type over blanket . I put the blanket down full open, then the bag, then pull the blanket over the bag after I crawl in, kind of like a "people burrito"
What heat source you are using makes a big difference as well, tent is no big deal with gas, or wood stove. Outside no biggy either with a fire going, just got to watch if the wood likes to "pop", you can get burn holes in the bag.
BTW, I like to take my wool house slippers, lost a few over the years, but great getting out of the rack, putting on the slippers to keep the feet warm and clean, then vegetate with coffee around the heat.