With the extensive use of antibiotics in medicine, agriculture and food chemistry, the emergence of multi-drug resistant bacteria become more and more frequent and posed great threats to human health and life. So novel antimicrobial agents were urgently needed to defend the resistant bacteria. Jelleine-I was a small antimicrobial peptide (AMP) with eight amino acids in its sequence. It was believed to be an ideal template for developing antimicrobial agents. In the present study, the possible action mode against both gram-negative bacteria and gram-positive bacteria and in vivo antimicrobial activity was explored. Our results showed that Jelleine-I exhibits its antimicrobial activity mainly by disrupting the integrity of the cell membrane, which would not be affected by the conventional resistant mechanism. It also aims at some intracellular targets such as genomic DNA to inhibit the growth of microbes. In addition, the result of in vivo antimicrobial activity experiment showed that Jelleine-I performed a good therapeutic effect toward the mice with Escherichia coli infected peritonitis. Notably, Jelleine-I has negligible cytotoxicity toward the tested mammalian cells, indicating excellent cell selectivity between prokaryotic cells and eurkayotic cells. In summary, our results showed that Jelleine-I would be a potential candidate to be developed as a novel antimicrobial agent.