Maestro Bay has appeared with seventy-five different orchestras including the National, Chicago, St. Louis, Houston, Dallas, Baltimore, New Jersey, North Carolina, Tucson, West Virginia, Colorado, Hawaii, Sarasota, Fort Worth, Bochum (Germany), Carinthian (Austria), Lithuanian National, and Ecuador National Symphonies, the Minnesota and Algarve (Portugal) Orchestras, the Louisiana, Buffalo, Rhode Island Philharmonics, the St. Paul Chamber Orchestra, the Eastman (Postcard from Morocco) and Aspen (The Ballad of Baby Doe) Opera Theaters, and the Theater Chamber Players of the Kennedy Center. Summer music festival appearances have included Aspen and Music in the Mountains (CO), Grant Park and Ravinia (IL), Round Top (TX), OK Mozart (OK) and Skaneateles (NY).  

Peter is the primary conductor for Ballet Austin. For Austin Opera he has conducted A Streetcar Named Desire, La Traviata, Turandot, and The Marriage of Figaro.

Other positions held by Bay have included Music Director of the Erie Philharmonic, Annapolis Symphony Orchestra, Breckenridge Music Festival (CO), Britt Festival Orchestra (OR), and posts with the Rochester Philharmonic Orchestra and Richmond Symphony. Bay and the ASO with pianist Anton Nel released a critically acclaimed Bridge CD of Edward Burlingame Hill’s music. With the Richmond Symphony he recorded the US premiere of Britten’s The Sword in the Stone for Opus One Records, and with the Rochester Philharmonic Orchestra Voices, featuring the percussion ensemble NEXUS.

In 1994, he was one of two conductors selected to participate in the Leonard Bernstein American Conductors Program. He was the first prize winner of the 1980 Baltimore Symphony Orchestra Young Conductors Competition and a prize winner of the 1987 Leopold Stokowski Competition sponsored by the American Symphony Orchestra. In July 2012 he appeared in Solo Symphony, a choreographic work created for him by Allison Orr of Forklift Danceworks.  

Peter is married to soprano Mela Dailey and they have a son Colin.