Replacement glass chimney for oil lamp