We studied the efficacy of grafting zwitterionic polymer brushes for the antifouling modification of ultrafiltration (UF) membranes. Poly(vinylidene fluoride) (PVDF) UF membranes were modified by surface initiated atom transfer radical polymerization (SI-ATRP) to graft poly(sulfobetaine methacrylate) (PSBMA) brushes to the membrane surface. Protein adsorption tests and chemical force microscopy show that a large brush layer thickness (greater than 100 nm) is necessary in order to impart effective fouling resistance. In dynamic fouling experiments with bovine serum albumin (BSA) as a model foulant, however, the modified membranes exhibited only a slight increase of flux recovery after fouling compared to pristine PVDF membranes. Despite the thick PSBMA brush layer, this low water flux recovery indicates that internal fouling takes place within the membrane pores. To prevent internal fouling, we grafted PSBMA brushes to both the surface and internal structure of the membranes. Nevertheless, dynamic fouling experiments again showed only a minute improvement in water flux recovery. While a thick brush layer is required for effective fouling resistance, we note that the small pore size of UF membranes imposes a fundamental limit on the brush layer thickness inside the pores. Finally, we discuss the challenges of polymer brush grafting for antifouling UF membrane modification and suggest possible alternative methods to create fouling resistant UF membranes.