Abstract In this paper, we propose an efficient technique to synchronize video sequences of events that are acquired via uncalibrated cameras at unknown and dynamically varying temporal offsets. Unlike other existing techniques that just take unidirectional alignment into consideration, the proposed technique considers symmetric alignments and compute the optimal alignment. We also establish sub-frame accuracy video alignment. The advantages of our approach are validated by tests conducted on several pairs of real and synthetic sequences. We present qualitative and quantitative comparisons with other existing techniques. A unique application of this work in generating high-resolution 4D MRI data from multiple low-resolution MRI scans is described.