The protesters blocked the doors to Wells Fargo's corporate headquarters.
Dozens of demonstrators are sitting down in front of the building, located at 420 Montgomery St. between Sacramento and California streets, while others are standing by or marching around the block.
About 200 protesters gathered at Market and Drumm streets at 7 a.m. for an anti-Wall Street rally and march to highlight a number of issues including foreclosures and unemployment. The group is made up of people of all ages, including some parents who brought their children.
Some demonstrators held signs reading "Foreclose Wall Street," "Stop the corporate greed," and "We are the 99 percent."
San Francisco Supervisor John Avalos, who is running for mayor, was among them and addressed the crowd.
"I welcome your fight and I join you in the effort," he said.
They began marching shortly after 7:30 a.m. and headed to the Wells Fargo building.
The march is organized by a number of groups including Causa Justa Just Cause, Unite Here Local 2850, the California Partnership, Young Workers United and the Chinese Progressive Association.
The groups stated in a press release that they want banks to pay their fair share of taxes and be held accountable for their role in causing the economic crisis.
They say they are rallying in solidarity with the "Occupy Wall Street" movement, which has sparked protests across the country.
In San Francisco's version, "Occupy SF," protesters have been camping out in front of the Federal Reserve Bank of San Francisco at Market and Spear streets.
As the crowd gathered for the march Wednesday morning, dozens of "Occupy SF" protesters remained in their sleeping bags on the sidewalk, some of them still asleep.