Just keep putting them in there for now. They will eventually get the idea. You might try enticing them up the ramp with treats.
Heat lamps, IMHO, can be a problem. Most chickens actually do very well in cold. It's heat that they have trouble tolerating. You want them to get used to the...