There is now what I view as an 85% chance that if you even take them off now, your "all season's" will be fine in Toronto, despite the fact that they are only decent in typical conditions in 3 out of 4 seasons. But in this case, I see an 85% chance that you won't need winter tires.
But then again, I don't even know where you are located. If you are in or very near the city of Toronto, the above applies to you. If you are not, then you might need to wait a little longer.