In vitro differentiation of stem cells into various cell lineages is valuable in developmental studies and an important source of cells for modelling physiology and pathology, particularly for complex tissues such as the brain. Conventional protocols for in vitro neuronal differentiation often suffer from complicated procedures, high variability and low reproducibility. Over the last decade, the identification of cell fate-determining transcription factors has provided new tools for cellular studies in neuroscience and enabled rapid differentiation driven by ectopic transcription factor expression. As a proneural transcription factor, Neurogenin 2 (Ngn2) expression alone is sufficient to trigger rapid and robust neurogenesis from pluripotent cells. Here, we established a stable cell line, by piggyBac (PB) transposition, that conditionally expresses Ngn2 for generation of excitatory neurons from mouse embryonic stem cells (ESCs) using an all-in-one PB construct. Our results indicate that Ngn2-induced excitatory neurons have mature and functional characteristics consistent with previous studies using conventional differentiation methods. This approach provides an all-in-one PB construct for rapid and high copy number gene delivery of dox-inducible transcription factors to induce differentiation. This approach is a valuable in vitro cell model for disease modeling, drug screening and cell therapy.