Structural differences between the left and right sides of the brain exist throughout the vertebrate lineage. By studying the zebrafish pineal complex, which exhibits notable asymmetries, both the genes and the cell movements that result in left-right differences can be characterized. The pineal complex consists of the midline pineal organ and the left-sided parapineal organ. The parapineal is responsible for instructing the asymmetric architecture of the bilateral habenulae, the brain nuclei that flank the pineal complex. Using in vivo time-lapse confocal microscopy, we find that the cells that form the parapineal organ migrate as a cluster of cells from the pineal complex anlage to the left side of the brain. In a screen for mutations that disrupted brain laterality, we identified a nonsense mutation in the T-box2b (tbx2b) gene, which encodes a transcription factor expressed in the pineal complex anlage. The tbx2b mutant makes fewer parapineal cells, and they remain as individuals near the midline rather than migrating leftward as a group. The reduced number and incorrect placement of parapineal cells result in symmetric development of the adjacent habenular nuclei. We conclude that tbx2b functions to specify the correct number of parapineal cells and to regulate their asymmetric migration.