The microbial colonization profiles on microplastics (MPs) in marine environments have recently sparked global interest. However, many studies have characterized plastisphere microbiomes without considering the ecological processes that underly microbiome assembly. Here, we carried out a three-timepoint exposure experiment at 1-, 4-, and 8-week and investigated the colonization dynamics for polyethylene, polypropylene, polystyrene, polyvinyl chloride, and acrylonitrile-butadiene-styrene MP pellets in natural coastal water. Using high-throughput sequencing of 16S rRNA, we found diversity and evenness were higher (p < 0.05) in the plastisphere communities than those in seawater, and microorganisms colonizing were co-influenced by environmental factors, polymer types, and exposure duration. Functional potential and co-occurrence network analysis revealed that MP exposure enriched the xenobiotic biodegradation potential and reduced the complexity of the MP microbial network. Simultaneously, null-model analyses indicated that stochastic processes contributed a bigger role than deterministic processes in shaping plastisphere microbial community structure with dispersal limitations contributing to a greater extent to microbial succession trajectories. These results implied the plastic surface had a more important role as a raft onto which microbes attach rather than selectively recruiting plastic-specific microbial colonizers. Our work strengthened the understanding of the ecological mechanisms by which microbial community patterns are controlled during colonization by plastic-associated microbes.