The tumor microenvironment (TME) is a heterogeneous, complex organization composed of tumor, stroma, and endothelial cells that is characterized by cross talk between tumor and innate and adaptive immune cells. Over the last decade, it has become increasingly clear that the immune cells in the TME play a critical role in controlling or promoting tumor growth. The function of T lymphocytes in this process has been well characterized. On the other hand, the function of B lymphocytes is less clear, although recent data from our group and others have strongly indicated a critical role for B cells in antitumor immunity. There are, however, a multitude of populations of B cells found within the TME, ranging from naive B cells all the way to terminally differentiated plasma cells and memory B cells. Here, we characterize the role of B cells in the TME in both animal models and patients, with an emphasis on dissecting how B cell heterogeneity contributes to the immune response to cancer.