Actin assembly facilitates vesicle formation in several trafficking pathways, including clathrin-mediated endocytosis (CME). Interestingly, actin does not assemble at all CME sites in mammalian cells. How actin networks are organized with respect to mammalian CME sites and how assembly forces are harnessed, are not fully understood. Here, branched actin network geometry at CME sites was analyzed using three different advanced imaging approaches. When endocytic dynamics of unperturbed CME sites are compared, sites with actin assembly show a distinct signature, a delay between completion of coat expansion and vesicle scission, indicating that actin assembly occurs preferentially at stalled CME sites. In addition, N-WASP and the Arp2/3 complex are recruited to one side of CME sites, where they are positioned to stimulate asymmetric actin assembly and force production. We propose that actin assembles preferentially at stalled CME sites where it pulls vesicles into the cell asymmetrically, much as a bottle opener pulls off a bottle cap.