When you use : scene.remove(object); The object is removed from the scene, but the collision with it is still enabled !
To remove also the collsion with the object, you can use that (for an array) : objectsArray.splice(i, 1);
Example :
for (var i = 0; i < objectsArray.length; i++) {
//::: each object ::://
var object = objectsArray[i];
//::: remove all objects from the scene ::://
scene.remove(object);
//::: remove all objects from the array ::://
objectsArray.splice(i, 1);
}