Without seeing a picture of your box, I would not venture to get too specific about your problem.
If your house is uninsulated, its going to be hard to keep warm. If you leave the window open, your heat will exit said window.
Meat thermometers are usually in the ball park, but you can do better for only a few $$