One of the major challenges of bottom-up synthetic biology is rebuilding a minimal cell division machinery. From a reconstitution perspective, the animal cell division apparatus is mechanically the simplest and therefore attractive to rebuild. An actin-based ring produces contractile force to constrict the membrane. By contrast, microbes and plant cells have a cell wall, so division requires concerted membrane constriction and cell wall synthesis. Furthermore, reconstitution of the actin division machinery helps in understanding the physical and molecular mechanisms of cytokinesis in animal cells and thus our own cells. In this review, we describe the state-of-the-art research on reconstitution of minimal actin-mediated cytokinetic machineries. Based on the conceptual requirements that we obtained from the physics of the shape changes involved in cell division, we propose two major routes for building a minimal actin apparatus capable of division. Importantly, we acknowledge both the passive and active roles that the confining lipid membrane can play in synthetic cytokinesis. We conclude this review by identifying the most pressing challenges for future reconstitution work, thereby laying out a roadmap for building a synthetic cell equipped with a minimal actin division machinery.