The high delay produced by the two-stage Object detection methods is limiting their use in video surveillance scenario. Therefore, most of the existing works use only light object detection method to be applied on IoT devices. The problem of these detectors is the low accuracy. To find a trade off between thelatency and the accuracy we proposed multi configuration framework where each group of cameras are set under one configuration. After solving the optimization problem, the system will be able to decide where to process the tasks based on the minimum cost for all the configurations.The computation decision can be done locally (Edge) or remotely (cloud). The experiment result demonstrates that the proposed multi-configuration object detection framework outperforms the existing uni configuration system in terms of lower latency and higher accuracy.