The aim of this study was to describe the clinical and sonographic features of ovarian metastases originating from colorectal cancer (mCRC), and to discriminate mCRC from primary ovarian cancer (OC). We conducted a multi-institutional, retrospective study of consecutive patients with ovarian mCRC who had undergone ultrasound examination using the International Ovarian Tumor Analysis (IOTA) terminology, with the addition of evaluating signs of necrosis and abdominal staging. A control group included patients with primary OC. Clinical and ultrasound data, subjective assessment (SA), and an assessment of different neoplasias in the adnexa (ADNEX) model were evaluated. Fisher’s exact and Student’s t -tests, the area under the receiver–operating characteristic curve (AUC), and classification and regression trees (CART) were used to conduct statistical analyses. In total, 162 patients (81 with OC and 81 with ovarian mCRC) were included. None of the patients with OC had undergone chemotherapy for CRC in the past, compared with 40% of patients with ovarian mCRC ( p < 0.001). The ovarian mCRC tumors were significantly larger, a necrosis sign was more frequently present, and tumors had an irregular wall or were fixed less frequently; ascites, omental cake, and carcinomatosis were less common in mCRC than in primary OC. In a subgroup of patients with ovarian mCRC who had not undergone treatment for CRC in anamnesis, tumors were larger, and had fewer papillations and more locules compared with primary OC. The highest AUC for the discrimination of ovarian mCRC from primary OC was for CART (0.768), followed by SA (0.735) and ADNEX calculated with CA-125 (0.680). Ovarian mCRC and primary OC can be distinguished based on patient anamnesis, ultrasound pattern recognition, a proposed decision tree model, and an ADNEX model with CA-125 levels.