This article describes an encoder design for 3D stereoscopic video coding. This encoder can support 2D video coding by H.264/AVC and 3D stereoscopic video coding by MVC. The 3D stereoscopic video coding is required to process multiple views captured at the same time instant. In addition, the inter-view prediction is performed to further reduce redundancy. Consequently, the requirement of its computing power is much greater than traditional 2D video coding by H.264/AVC. To reduce the computation time of the MVC encoder under negligible video quality decay, several novel fast algorithms and architectures are proposed for intra prediction, inter-picture prediction, inter-view prediction, CABAC, and de-blocking filter.