The coarse-grained Martini model is employed extensively to study membrane protein oligomerization. While this approach is exceptionally promising given its computational efficiency, it is alarming that a significant fraction of these studies demonstrate unrealistic protein clusters, whose formation is essentially an irreversible process. This suggests that the protein-protein interactions are exaggerated in the Martini model. If this held true, then it would limit the applicability of Martini to study multi-protein complexes, as the rapidly clustering proteins would not be able to properly sample the correct dimerization conformations. In this work we first demonstrate the excessive protein aggregation by comparing the dimerization free energies of helical transmembrane peptides obtained with the Martini model to those determined from FRET experiments. Second, we show that the predictions provided by the Martini model for the structures of transmembrane domain dimers are in poor agreement with the corresponding structures resolved using NMR. Next, we demonstrate that the first issue can be overcome by slightly scaling down the Martini protein-protein interactions in a manner, which does not interfere with the other Martini interaction parameters. By preventing excessive, irreversible, and non-selective aggregation of membrane proteins, this approach renders the consideration of lateral dynamics and protein-lipid interactions in crowded membranes by the Martini model more realistic. However, this adjusted model does not lead to an improvement in the predicted dimer structures. This implicates that the poor agreement between the Martini model and NMR structures cannot be cured by simply uniformly reducing the interactions between all protein beads. Instead, a careful amino-acid specific adjustment of the protein-protein interactions is likely required.