A Pilot / Feasibility Study of Autologous CMV-Specific CD19-CAR T Cells Plus CMV-MVA Triplex Vaccine in Patients With Intermediate or High Grade B-Lineage Non-Hodgkin Lymphoma

Inclusion Criteria: * Documented informed consent of the participant and/or legally authorized representative * Assent, when appropriate, will be obtained per institutional guidelines * Agreement to allow the use of archival tissue from diagnostic tumor biopsies * If unavailable, exceptions may be granted with study principal investigator (PI) approval * Note: For research participants who do not speak English, a short form consent may be used with a City of Hope (COH) certified interpreter/translator to proceed with screening and leukapheresis, while the request for a translated full consent is processed * Age: \>= 18 years * Karnofsky Performance Status (KPS) \>= 70 * Life expectancy \>= 16 weeks at the time of enrollment * Patients requiring treatment for relapsed or refractory intermediate or high-grade B cell NHL (e.g., diffuse large B-cell lymphoma \[DLBCL\], mantle cell lymphoma \[MCL\], or transformed NHL) who are not eligible for, or who refuse, or have previously received autologous hematopoietic cell transplantation (autoHCT) * Note: COH pathology review should confirm that research participant's diagnostic material is consistent with history of intermediate or high-grade CD19+ malignancy * No known contraindications to leukapheresis, lymphodepleting chemotherapy, steroids or tocilizumab, smallpox vaccine and any other MVA-based vaccines * Patient must be CMV seropositive * Total serum bilirubin =\< 2.0 mg/dL * Participants with Gilbert syndrome may be included if their total bilirubin is =\< 3.0 * Aspartate aminotransferase (AST) \< 2.5 x upper limit of normal (ULN) * Alanine aminotransferase (ALT) \< 2.5 x ULN * Serum creatinine =\< 2.5 x ULN or estimated creatinine clearance of \>= 40 mL/min per the Cockcroft-Gault formula, and the participant is not on hemodialysis * Absolute neutrophil count \>= 1000/uL (Transfusions and growth factors must not be used to meet these requirements at initial screening) * Hemoglobin (Hb) \>= 8 g/dl (Transfusions and growth factors must not be used to meet these requirements at initial screening) * Platelet count \>= 50,000/uL (\>= 30,000/uL if bone marrow plasma cells are \>= 50% of cellularity) (Transfusions and growth factors must not be used to meet these requirements at initial screening) * Left ventricular ejection fraction \>= 45% within 8 weeks before enrollment * Oxygen (O2) saturation \> 92% without requiring supplemental oxygen * Women of childbearing potential (WOCBP): negative urine or serum pregnancy test * If the urine test is positive or cannot be confirmed as negative, a serum pregnancy test will be required * Agreement by females and males of childbearing potential to use an effective method of birth control or abstain from heterosexual activity for the course of the study through at least 6 months after the last dose of protocol therapy * Childbearing potential defined as not being surgically sterilized (men and women) or have not been free from menses for \> 1 year (women only) Exclusion Criteria: * Prior allogeneic stem cell transplant unless the participant has recovered from transplantation and does not have active graft versus host disease (GVHD) * Growth factors within 14 days of enrollment * Platelet transfusions within 7 days of enrollment * Concurrent use of systemic steroids or chronic use of immunosuppressant medications. Recent or current use of inhaled or topical steroids in standard doses is not exclusionary. Physiologic replacement of steroids (prednisone =\< 5 mg/day, or equivalent doses of other corticosteroids) is allowed * Patients with active autoimmune disease requiring systemic immune suppressive therapy are not allowed * Participants may not be receiving any other investigational agents or concurrent biological therapy, chemotherapy, or radiation therapy * Any standard contraindications to lymphodepleting chemotherapy and/or CAR T-cell therapy per standard of care practices at COH * Subjects with clinically significant arrhythmia or arrhythmias not stable on medical management within two weeks of screening * Subjects with a known history or prior diagnosis of optic neuritis or other immunologic or inflammatory disease affecting the central nervous system (CNS), including seizure disorder, any measurable masses of CNS, or any other active CNS disease * Note: Research participants with a history of CNS disease that has been effectively treated to complete remission (\< 5 white blood cell \[WBC\]/mm\^3 and no blasts in cerebral spinal fluid \[CSF\]) will be eligible * History of allergic reactions attributed to compounds of similar chemical or biologic composition to study agents or cetuximab * Known bleeding disorders (e.g., von Willebrand's disease) or hemophilia * History of stroke or intracranial hemorrhage within 6 months prior to screening * History of other malignancies, except for malignancy surgically resected (or treated with other modalities) with curative intent, basal cell carcinoma of the skin or localized squamous cell carcinoma of the skin; non-muscle invasive bladder cancer; malignancy treated with curative intent with no known active disease present for \>= 3 years * Clinically significant uncontrolled illness * Active infection requiring antibiotics * Immunodeficiency virus (human immunodeficiency virus \[HIV\]) positive * Active viral hepatitis * Females only: Pregnant or breastfeeding * Any other condition that would, in the investigator's judgment, contraindicate the subject's participation in the clinical study due to safety concerns with clinical study procedures * Prospective participants who, in the opinion of the investigator, may not be able to comply with all study procedures (including compliance issues related to feasibility/logistics)