Immune evasion is a key phenomenon in understanding tumor recurrence, metastasis, and other critical steps in tumor progression. The tumor microenvironment (TME) is in constant flux due to the tumor's ability to release signals that affect it, while immune cells within it can impact cancer cell behavior. Cancer cells undergo several changes, which can change the enrichment of different immune cells and modulate the activity of existing immune cells in the tumor microenvironment. Cancer cells can evade immune surveillance by downregulating antigen presentation or expressing immune checkpoint molecules. High levels of tumor-infiltrating lymphocytes (TILs) correlate with better outcomes, and robust immune responses can control tumor growth. On the contrary, increased enrichment of Tregs, myeloid-derived suppressor cells, and M2-like anti-inflammatory macrophages can hinder effective immune surveillance and predict poor prognosis. Overall, understanding these immune evasion mechanisms guides therapeutic strategies. Researchers aim to modulate the TME to enhance immune surveillance and improve patient outcomes. In this review article, we strive to summarize the composition of the tumor immune microenvironment, factors affecting the tumor immune microenvironment (TIME), and different therapeutic modalities targeting the immune cells. This review is a first-hand reference to understand the basics of immune surveillance and immune evasion.