As the world faces the challenge of the COVID-19 pandemic, it has become an urgent need of the hour to understand how our immune system sense and respond to RNA viruses that are often life-threatening. While most vaccine strategies for these viruses are developed around a programmed antibody response, relatively less attention is paid to our innate immune defenses that can determine the outcome of a viral infection via the production of antiviral cytokines like Type I Interferons. However, it is becoming increasingly evident that the “cytokine storm” induced by aberrant activation of the innate immune response against a viral pathogen may sometimes offer replicative advantage to the virus thus promoting disease pathogenesis. Thus, it is important to fine tune the responses of the innate immune network that can be achieved via a deeper insight into the candidate molecules involved. Several pattern recognition receptors (PRRs) like the Toll like receptors (TLRs), NOD-like receptors (NLRs), and the retinoic acid inducible gene-I (RIG-I) like receptors (RLRs) recognize cytosolic RNA viruses and mount an antiviral immune response. RLRs recognize invasive viral RNA produced during infection and mediate the induction of Type I Interferons via the mitochondrial antiviral signaling (MAVS) molecule. It is an intriguing fact that the mitochondrion, one of the cell’s most vital organelle, has evolved to be a central hub in this antiviral defense. However, cytokine responses and interferon signaling via MAVS signalosome at the mitochondria must be tightly regulated to prevent overactivation of the immune responses. This review focuses on our current understanding of the innate immune sensing of the host mitochondria by the RLR-MAVS signalosome and its specificity against some of the emerging/re-emerging RNA viruses like Ebola, Zika, Influenza A virus (IAV), and severe acute respiratory syndrome-coronavirus (SARS-CoV) that may expand our understanding for novel pharmaceutical development.