Sarcoidosis is a systemic inflammatory disease characterized by noncaseating epithelioid cell granulomas. However, certain infections can exhibit similar histological findings. We present a case of a 69-year-old man who was initially diagnosed with sarcoidosis and later was confirmed, through 16S rRNA sequencing, to have disseminated infection. Acid-fast bacteria were detected in the bone marrow biopsy using Ziehl-Neelsen staining, but routine clinical tests did not provide a definitive diagnosis. The patient tested negative for HIV, anti-interferon-gamma antibodies, and genetic immunodeficiency disorders. He was treated with multiple drugs, including aminoglycosides and macrolides, but showed no improvement in fever and pancytopenia. However, these clinical signs responded favorably to steroid therapy. We reviewed 17 Japanese cases of infection. All cases were in males; 7/17 (41%) were HIV-negative; and 12/17 (71%) had a decreased CD4 count. Genetic analysis confirmed isolation, and macrolides were used universally. infection is challenging to identify and mimics other systemic inflammatory diseases such as sarcoidosis. There are no standard treatment protocols. Our case report and Japanese case review contribute to understanding this rare disease.